-- Logs begin at Mon 2022-09-05 11:33:59 UTC, end at Mon 2022-09-05 12:32:41 UTC. -- Sep 05 12:02:12.260492 dv-cinder-855189-1-smb systemd[1]: Starting Devstack devstack@keystone.service... Sep 05 12:02:12.268394 dv-cinder-855189-1-smb devstack@keystone.service[81706]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 05 12:02:12.272149 dv-cinder-855189-1-smb devstack@keystone.service[81706]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Sep 5 12:02:12 2022] *** Sep 05 12:02:12.272149 dv-cinder-855189-1-smb devstack@keystone.service[81706]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 05 12:02:12.272149 dv-cinder-855189-1-smb devstack@keystone.service[81706]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 05 12:02:12.272149 dv-cinder-855189-1-smb devstack@keystone.service[81706]: nodename: dv-cinder-855189-1-smb Sep 05 12:02:12.272149 dv-cinder-855189-1-smb devstack@keystone.service[81706]: machine: x86_64 Sep 05 12:02:12.272149 dv-cinder-855189-1-smb devstack@keystone.service[81706]: clock source: unix Sep 05 12:02:12.272149 dv-cinder-855189-1-smb devstack@keystone.service[81706]: pcre jit disabled Sep 05 12:02:12.272149 dv-cinder-855189-1-smb devstack@keystone.service[81706]: detected number of CPU cores: 4 Sep 05 12:02:12.272149 dv-cinder-855189-1-smb devstack@keystone.service[81706]: current working directory: / Sep 05 12:02:12.272149 dv-cinder-855189-1-smb devstack@keystone.service[81706]: detected binary path: /usr/bin/uwsgi-core Sep 05 12:02:12.272149 dv-cinder-855189-1-smb devstack@keystone.service[81706]: your processes number limit is 47680 Sep 05 12:02:12.272149 dv-cinder-855189-1-smb devstack@keystone.service[81706]: your memory page size is 4096 bytes Sep 05 12:02:12.272149 dv-cinder-855189-1-smb devstack@keystone.service[81706]: detected max file descriptor number: 2048 Sep 05 12:02:12.272149 dv-cinder-855189-1-smb devstack@keystone.service[81706]: lock engine: pthread robust mutexes Sep 05 12:02:12.272149 dv-cinder-855189-1-smb devstack@keystone.service[81706]: thunder lock: enabled Sep 05 12:02:12.272149 dv-cinder-855189-1-smb devstack@keystone.service[81706]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 05 12:02:12.272149 dv-cinder-855189-1-smb devstack@keystone.service[81706]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 05 12:02:12.311457 dv-cinder-855189-1-smb devstack@keystone.service[81706]: Python main interpreter initialized at 0x55c3ce20d9c0 Sep 05 12:02:12.311457 dv-cinder-855189-1-smb devstack@keystone.service[81706]: python threads support enabled Sep 05 12:02:12.311457 dv-cinder-855189-1-smb devstack@keystone.service[81706]: your server socket listen backlog is limited to 100 connections Sep 05 12:02:12.311457 dv-cinder-855189-1-smb devstack@keystone.service[81706]: your mercy for graceful operations on workers is 90 seconds Sep 05 12:02:12.311861 dv-cinder-855189-1-smb devstack@keystone.service[81706]: mapped 403077 bytes (393 KB) for 2 cores Sep 05 12:02:12.311943 dv-cinder-855189-1-smb devstack@keystone.service[81706]: *** Operational MODE: preforking *** Sep 05 12:02:12.312162 dv-cinder-855189-1-smb devstack@keystone.service[81706]: *** uWSGI is running in multiple interpreter mode *** Sep 05 12:02:12.312162 dv-cinder-855189-1-smb devstack@keystone.service[81706]: spawned uWSGI master process (pid: 81706) Sep 05 12:02:12.312369 dv-cinder-855189-1-smb systemd[1]: Started Devstack devstack@keystone.service. Sep 05 12:02:12.312955 dv-cinder-855189-1-smb devstack@keystone.service[81706]: spawned uWSGI worker 1 (pid: 81719, cores: 1) Sep 05 12:02:12.313300 dv-cinder-855189-1-smb devstack@keystone.service[81706]: spawned uWSGI worker 2 (pid: 81720, cores: 1) Sep 05 12:02:12.313456 dv-cinder-855189-1-smb devstack@keystone.service[81706]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 05 12:02:16.621410 dv-cinder-855189-1-smb devstack@keystone.service[81720]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 05 12:02:16.621410 dv-cinder-855189-1-smb devstack@keystone.service[81720]: from cryptography.utils import int_from_bytes Sep 05 12:02:16.622229 dv-cinder-855189-1-smb devstack@keystone.service[81720]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 05 12:02:16.622229 dv-cinder-855189-1-smb devstack@keystone.service[81720]: from cryptography.utils import int_from_bytes Sep 05 12:02:16.622345 dv-cinder-855189-1-smb devstack@keystone.service[81719]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 05 12:02:16.622345 dv-cinder-855189-1-smb devstack@keystone.service[81719]: from cryptography.utils import int_from_bytes Sep 05 12:02:16.622345 dv-cinder-855189-1-smb devstack@keystone.service[81719]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 05 12:02:16.622345 dv-cinder-855189-1-smb devstack@keystone.service[81719]: from cryptography.utils import int_from_bytes Sep 05 12:02:16.672361 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 05 12:02:16.672545 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 05 12:02:16.672727 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] command line args: [] {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 05 12:02:16.672818 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 05 12:02:16.673020 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 05 12:02:16.673113 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 05 12:02:16.673193 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ================================================================================ {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 05 12:02:16.673277 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] command line args: [] {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 05 12:02:16.673448 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] admin_token = **** {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:02:16.673535 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 05 12:02:16.673638 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] ================================================================================ {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 05 12:02:16.673724 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] config_dir = [] {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:02:16.673873 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:02:16.673959 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] admin_token = **** {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:02:16.674056 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] config_source = [] {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:02:16.674136 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] config_dir = [] {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:02:16.674237 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] debug = True {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:02:16.674316 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:02:16.674436 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:02:16.674739 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] config_source = [] {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:02:16.674739 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] debug = True {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:02:16.674945 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:02:16.675056 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:02:16.675186 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:02:16.675291 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:02:16.675396 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:02:16.675499 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:02:16.675603 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:02:16.675718 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:02:16.675823 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] list_limit = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:02:16.675921 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:02:16.676023 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] log_config_append = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:02:16.676126 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] list_limit = None {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:02:16.676229 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:02:16.676334 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] log_config_append = None {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:02:16.676438 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] log_dir = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:02:16.676541 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:02:16.676647 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] log_file = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:02:16.676751 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] log_dir = None {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:02:16.676884 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:02:16.677015 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] log_file = None {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:02:16.677141 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:02:16.677224 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:02:16.677302 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:02:16.677418 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:02:16.677500 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:02:16.677583 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:02:16.677699 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:02:16.677783 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:02:16.677909 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:02:16.677986 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:02:16.678070 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:02:16.678188 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:02:16.678265 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:02:16.678381 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:02:16.678463 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:02:16.678547 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:02:16.678628 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:02:16.678751 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:02:16.678834 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:02:16.678914 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:02:16.679031 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:02:16.679113 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:02:16.679197 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:02:16.679275 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:02:16.679396 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:02:16.679479 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:02:16.679664 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:02:16.679751 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:02:16.679969 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:02:16.680155 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.50/identity {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:02:16.680340 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] publish_errors = False {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:02:16.680455 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.50/identity {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:02:16.680575 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:02:16.680660 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] publish_errors = False {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:02:16.680804 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:02:16.680907 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:02:16.680998 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:02:16.681106 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:02:16.681244 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:02:16.681328 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:02:16.681473 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:02:16.681559 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:02:16.681701 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] standard_threads = False {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:02:16.681780 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:02:16.681931 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:02:16.682014 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] standard_threads = False {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:02:16.682171 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:02:16.682252 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:02:16.682346 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:02:16.682431 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:02:16.682510 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] use_journal = False {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:02:16.682582 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:02:16.682704 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] use_json = False {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:02:16.682779 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] use_journal = False {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:02:16.682855 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] use_stderr = False {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:02:16.682932 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] use_json = False {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:02:16.683003 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] use_syslog = False {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:02:16.683080 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] use_stderr = False {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:02:16.683225 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:02:16.683312 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] use_syslog = False {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:02:16.683455 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 12:02:16.683539 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.683702 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.683781 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.683947 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.684032 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.684186 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.684264 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.684433 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.684512 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.684673 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.684752 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.684949 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.685035 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.685201 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.685291 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.685441 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.685521 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.685692 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.685770 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.685943 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.686021 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.686193 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.686273 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.686427 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.686506 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.686660 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.686737 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.686904 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.686983 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.687148 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.687233 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.687386 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.687466 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.687621 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.687701 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.687876 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.687955 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.688120 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.688275 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.688356 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.688428 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.688592 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.688684 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.688845 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.688952 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.689122 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.689296 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.689370 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.689441 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.689588 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.689676 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.689818 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.689904 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.690046 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.690124 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.690277 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.690364 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.690516 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.690595 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.690757 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.690834 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.690986 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.691073 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.691215 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.691301 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.691444 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.691521 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.691691 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.691777 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.691926 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.692009 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.692168 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.692245 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.692395 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.692485 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.692629 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.692709 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.692862 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.693011 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.693115 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.693211 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.693345 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.693423 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.693571 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.693649 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.693800 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.693959 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.694034 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.694104 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.694260 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.694338 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.694487 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.694577 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.694723 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.694803 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.694951 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.695030 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.695181 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.695267 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.695412 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.695490 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.695646 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.695725 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.695878 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.695969 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.696116 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.696208 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.696352 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.696430 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.696589 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.696678 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.696828 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.696996 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.697139 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.697248 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.697355 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.697461 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.697560 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.697658 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.697756 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.697853 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.697984 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.698068 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.698215 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.698304 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.698454 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.698545 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.698697 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.698820 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.698930 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.699012 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.699162 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.699241 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.699395 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.699477 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.699631 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.699759 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.699886 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.699965 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.700128 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.700207 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.700370 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.700450 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.700628 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.700710 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.700865 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.701005 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.701122 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.701204 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.701360 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.701487 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.701596 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.701675 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.701833 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.701914 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.702070 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.702154 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.702304 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.702384 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.702541 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.702621 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.702778 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.702856 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.703013 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.703093 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.703247 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.703325 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.703479 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.703556 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.703712 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.703792 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.703954 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.704033 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.704198 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.704277 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.704443 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.704521 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.704681 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.704760 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.704937 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.705032 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.705179 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.705257 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.705407 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.705480 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.705636 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.705715 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.705871 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.705960 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.706101 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.706190 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.706331 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.706411 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.706560 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.706639 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.706790 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.706877 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.707017 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.707097 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.707248 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.707326 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.707480 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.707567 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.707716 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.707794 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.707949 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.708028 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.708193 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.708280 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.708444 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.708531 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.708683 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.708764 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.708925 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] auth.external = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.709020 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.709159 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.709248 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] auth.external = None {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.709397 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.709483 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.709666 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.709748 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.709895 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] auth.password = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.709984 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.710123 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] auth.token = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.710204 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] auth.password = None {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.710351 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] auth.token = None {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.710430 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.710584 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.710672 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.710819 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.710898 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.711047 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.711127 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.711291 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.711379 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.711537 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.711617 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.711768 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.711848 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.712004 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] credential.caching = True {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.712093 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.712240 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] credential.caching = True {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.712320 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.712484 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.712564 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.712731 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.712819 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.713003 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.713086 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.713252 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.713332 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.713484 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.713576 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.713725 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.713805 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.713972 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.714052 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.714208 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.714297 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.714451 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.714531 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.714707 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.714788 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.714965 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.715053 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.715228 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.715309 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.715472 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.715562 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.715724 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.715811 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.715956 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] federation.caching = True {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.716035 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.716705 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.716794 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] federation.caching = True {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.716976 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.717074 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.717223 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.717331 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.717453 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.717585 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.717699 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.717820 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.717935 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.718071 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.718188 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.718313 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.718425 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.718569 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.718678 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.718809 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.718917 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.719067 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.719159 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.719311 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.719398 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] identity.caching = True {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.719564 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.719645 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.719803 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] identity.caching = True {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.719965 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.720043 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.720116 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.720292 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.720373 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.720531 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.720623 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.720760 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.720840 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.721020 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.721101 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.721254 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.721345 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.721495 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.721576 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.721724 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.721794 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.721954 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.722043 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.722182 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.722263 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.722428 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.722511 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.722653 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.722741 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.722901 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.722981 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.723147 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.723234 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.723395 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.723483 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.723649 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.723729 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.723888 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.723975 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.724128 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.724217 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.724360 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.724441 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.724600 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.724680 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.724830 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.724984 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.725092 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.725174 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.725324 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.725411 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.725562 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.725650 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.725801 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.725881 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.726027 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.726107 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.726272 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.726361 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.726503 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.726584 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.726738 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.726818 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.726983 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.727065 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.727217 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.727296 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.727443 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.727522 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.727682 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.727763 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.727911 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.727991 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.728149 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.728230 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.728377 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.728457 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.728614 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.728693 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.728851 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.728948 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.729115 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.729197 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.729354 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.729434 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.729596 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.729720 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.729847 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.729955 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.730188 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.730268 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.730439 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.730527 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.730673 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.730753 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.730911 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.730991 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.731149 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.731230 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.731387 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.731469 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.731618 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.user = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.731698 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.731909 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.732542 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.732662 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] ldap.user = None {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.732745 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.732928 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.733012 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.733195 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.733276 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.733432 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.733515 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.733683 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.733764 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.733934 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.734015 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.734162 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.734243 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.734397 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.734478 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.734631 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.734711 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.734866 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.734948 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.735093 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.735238 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.735316 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.735389 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.735552 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.735635 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.735801 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.735883 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.736044 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.736124 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.736289 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.736371 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.736519 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.736601 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.736764 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.736845 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.737017 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.737100 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.737255 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.737335 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.737491 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.737573 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.737728 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.737809 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.737968 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.738049 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.738209 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.738290 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.738445 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.738527 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.738694 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.738774 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.738920 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.738999 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.739164 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.739246 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.739395 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.739475 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.739628 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.739707 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.739865 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.739947 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.740101 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.740181 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.740338 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.740418 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.740570 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.740653 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.740805 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.740886 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.741059 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.741140 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] resource.caching = True {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.741297 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.741380 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.741542 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.741622 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] resource.caching = True {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.741777 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.741858 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.742025 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.742107 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.742260 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.742341 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.742500 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.742580 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.742746 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.742829 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.742981 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.743062 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.743217 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.743369 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.743446 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] role.caching = True {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.743519 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.743687 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.743768 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] role.driver = sql {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.743915 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.744004 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] role.caching = True {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.744161 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] role.driver = sql {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.744241 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.744394 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.744475 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.744637 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.744727 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.744883 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.744998 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.745149 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.745230 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.745396 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.745488 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.745637 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.745718 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.745881 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.745962 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.746115 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.746271 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.746364 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.746439 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.746589 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.746677 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.746827 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.746925 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.747071 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.747172 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.747320 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.747530 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.747620 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.747768 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.747984 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.748073 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.748223 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.748311 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.748474 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.748571 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.748720 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.748807 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.748975 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.749066 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.749228 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.749315 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.749465 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.749552 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.749702 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.749788 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.749933 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.750021 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.750163 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.750252 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.750393 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.750481 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.750624 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.750710 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.750856 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.750950 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.751114 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.751193 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.751341 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.751418 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.751576 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.751653 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.751805 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.751882 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.752043 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] token.caching = True {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.752120 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.752324 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.752401 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.752565 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] token.caching = True {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.752641 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.752797 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.752874 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.753069 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.753145 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.753307 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.753396 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.753549 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.753652 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.753795 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.753883 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.754034 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.754125 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.754277 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.754364 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.754515 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.754602 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.754753 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.754841 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.754988 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.755076 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.755229 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.755316 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.755467 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.755555 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.755714 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.755801 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.755959 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.756043 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.758746 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.758865 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.758944 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.759008 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] database.connection = **** {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.759008 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.759123 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.759184 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.759244 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] database.connection = **** {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.759304 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.759363 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.759422 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.759490 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.759551 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.759609 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.759675 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.759736 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.759795 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.759861 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.759922 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.759981 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.760040 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.760099 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.760157 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.760224 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.760285 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.760344 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.760403 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.760461 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.760520 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.760587 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.760649 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.760708 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.760767 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.760826 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.760886 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.760992 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.761055 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.761130 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.761201 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.761272 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.761343 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 05 12:02:16.761429 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.761429 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 12:02:16.761429 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81719) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 05 12:02:16.790560 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81720) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 12:02:16.790793 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81720) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 12:02:16.791020 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81720) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 12:02:16.791111 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81719) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 12:02:16.791259 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81719) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 12:02:16.791487 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81719) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 12:02:16.799967 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81720) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 12:02:16.800558 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81719) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 12:02:16.827791 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81720) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 12:02:16.828017 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81720) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 12:02:16.828379 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81719) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 12:02:16.828613 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81719) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 12:02:16.881816 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81720) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 12:02:16.881981 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81719) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 12:02:16.930939 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81720) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 12:02:16.931167 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81720) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 12:02:16.931595 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81719) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 12:02:16.931837 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81719) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 12:02:17.088663 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81720) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 12:02:17.088910 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81720) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 12:02:17.089092 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81719) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 12:02:17.089180 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81720) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 12:02:17.089327 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81719) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 12:02:17.089411 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81720) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 12:02:17.089543 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81720) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 12:02:17.089625 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81719) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 12:02:17.089756 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81720) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 12:02:17.089849 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81719) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 12:02:17.089974 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81719) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 12:02:17.090190 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81719) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 12:02:17.113591 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81720) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 12:02:17.113752 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81719) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 12:02:17.113839 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81720) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 12:02:17.113939 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81719) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 12:02:17.114021 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81720) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 12:02:17.114161 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81719) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 12:02:17.114249 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81720) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 12:02:17.114386 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81719) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 12:02:17.114481 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81720) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 12:02:17.114606 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81719) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 12:02:17.114692 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81720) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 12:02:17.114821 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81720) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 12:02:17.114905 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81719) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 12:02:17.115034 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81719) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 12:02:17.126186 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81720) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 12:02:17.126412 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81719) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 12:02:17.139425 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81720) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 12:02:17.139607 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81720) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 12:02:17.139695 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81719) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 12:02:17.139829 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81720) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 12:02:17.139915 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81719) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 12:02:17.140046 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81720) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 12:02:17.140132 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81719) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 12:02:17.140258 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81720) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 12:02:17.140353 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81719) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 12:02:17.140467 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81720) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 12:02:17.140551 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81719) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 12:02:17.140676 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81720) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 12:02:17.140762 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81719) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 12:02:17.140920 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81719) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 05 12:02:17.157984 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.158191 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 05 12:02:17.158532 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.158616 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.158733 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 05 12:02:17.158838 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 05 12:02:17.159011 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.159105 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.159269 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.159354 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 05 12:02:17.159526 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.159612 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.159780 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.159862 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.160050 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.160312 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.169304 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.169586 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.169857 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.169941 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.170140 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.170239 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.170480 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.170766 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.177043 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81720) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 12:02:17.177729 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81719) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 12:02:17.179909 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81720) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 12:02:17.180190 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.180479 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.180604 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81719) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 12:02:17.180767 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.180906 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.181080 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.181204 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.181343 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.181492 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.181613 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.181781 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.181890 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.182047 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.182161 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.182321 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.182434 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.182598 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.182701 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.182876 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.183156 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.183429 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.205538 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.206362 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.206982 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81720) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 12:02:17.207275 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.207828 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81719) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 12:02:17.208121 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.211872 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81720) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 12:02:17.212162 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.212444 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.212764 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81719) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 12:02:17.213080 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.213370 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.219365 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81720) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 12:02:17.219650 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.220206 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81719) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 12:02:17.220499 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.225263 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81720) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 12:02:17.225564 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.225851 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.226134 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.226218 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81719) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 12:02:17.226411 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.226505 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.226684 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.226770 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.226955 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.227050 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.227228 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.227311 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.227527 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.227798 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.228066 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.242485 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.242783 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.243468 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.243769 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.246602 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81720) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 12:02:17.247644 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81719) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 12:02:17.249852 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.250151 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.250868 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.251179 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.254312 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81720) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 12:02:17.255373 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81719) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 12:02:17.257397 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81720) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 12:02:17.258499 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81719) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 12:02:17.260589 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.260910 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.261261 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.261554 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.261742 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.261826 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.262062 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.262146 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.262368 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.262665 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.262947 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.263752 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.278450 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81720) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 12:02:17.279347 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.279616 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.279880 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.280190 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81719) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 12:02:17.280484 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.280759 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.281061 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.286678 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.287850 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.288227 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.289483 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.289800 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.290081 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.291019 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.291302 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.292747 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81720) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 12:02:17.293057 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.293351 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.293635 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.294015 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81719) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 12:02:17.294109 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.294328 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.294623 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.294911 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.295301 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.305058 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81720) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 12:02:17.305346 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.305627 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.305906 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.306284 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.306378 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81719) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 12:02:17.306565 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.306648 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.306844 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.306928 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.307193 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.307577 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.307860 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.308142 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.322020 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81720) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 12:02:17.323391 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81719) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 12:02:17.324907 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81720) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 12:02:17.326826 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81719) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 12:02:17.328269 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.329744 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.329910 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.332067 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81720) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 12:02:17.332222 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.332372 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.332790 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.333760 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81719) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 12:02:17.334074 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.334485 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.339184 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.340650 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81720) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 12:02:17.340857 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.342915 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81719) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 12:02:17.344156 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.344546 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.344835 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.345140 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.345820 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.346226 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.346517 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.346792 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.352802 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81720) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 12:02:17.353135 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.353424 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.354545 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81719) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 12:02:17.354860 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.355148 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.360237 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81720) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 12:02:17.360521 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.360802 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.361107 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.361395 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.361677 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.361951 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.362042 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81719) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 05 12:02:17.362218 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.362301 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.362487 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.362570 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.362770 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.362862 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.363048 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.363130 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.363324 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.363407 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.363588 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.363670 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.363846 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81720) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.363927 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.364149 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.364435 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.364718 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.365021 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.365292 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.365554 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81719) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 05 12:02:17.398536 dv-cinder-855189-1-smb devstack@keystone.service[81720]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55c3ce20d9c0 pid: 81720 (default app) Sep 05 12:02:17.400803 dv-cinder-855189-1-smb devstack@keystone.service[81719]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55c3ce20d9c0 pid: 81719 (default app) Sep 05 12:02:17.402068 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a212fb9-e66f-4815-a464-d795e5b04f29 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:17.402355 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a212fb9-e66f-4815-a464-d795e5b04f29 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:17.402627 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a212fb9-e66f-4815-a464-d795e5b04f29 None None] PATH_INFO: `/v3` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:17.406774 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1/1] 10.222.0.50 () {50 vars in 791 bytes} [Mon Sep 5 12:02:17 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:02:24.032260 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98d4592-d055-4a44-9dc9-0d76285adc1b None None] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:24.032931 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98d4592-d055-4a44-9dc9-0d76285adc1b None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:24.032931 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98d4592-d055-4a44-9dc9-0d76285adc1b None None] PATH_INFO: `/` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:24.037079 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1/2] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:02:24 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 12:02:24.043142 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a71f443-f32d-469e-8158-d07bba33a3e6 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:24.043752 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a71f443-f32d-469e-8158-d07bba33a3e6 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:24.043752 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a71f443-f32d-469e-8158-d07bba33a3e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:24.114830 dv-cinder-855189-1-smb devstack@keystone.service[81720]: INFO dbcounter [None req-2a71f443-f32d-469e-8158-d07bba33a3e6 None None] Registered counter for database keystone Sep 05 12:02:24.134721 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG oslo_db.sqlalchemy.engines [None req-2a71f443-f32d-469e-8158-d07bba33a3e6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81720) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 05 12:02:24.142078 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writer thread running {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 05 12:02:24.323922 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG passlib.handlers.bcrypt [None req-2a71f443-f32d-469e-8158-d07bba33a3e6 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81720) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 05 12:02:24.324234 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG passlib.handlers.bcrypt [None req-2a71f443-f32d-469e-8158-d07bba33a3e6 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81720) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 05 12:02:24.383869 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-2a71f443-f32d-469e-8158-d07bba33a3e6 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:02:24.385525 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-2a71f443-f32d-469e-8158-d07bba33a3e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:02:24.517805 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 2/3] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:02:24 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 476 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 05 12:02:24.970624 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98d4592-d055-4a44-9dc9-0d76285adc1b None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:02:25.040536 dv-cinder-855189-1-smb devstack@keystone.service[81719]: INFO dbcounter [None req-c98d4592-d055-4a44-9dc9-0d76285adc1b None None] Registered counter for database keystone Sep 05 12:02:25.062882 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG oslo_db.sqlalchemy.engines [None req-c98d4592-d055-4a44-9dc9-0d76285adc1b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81719) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 05 12:02:25.076040 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writer thread running {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 05 12:02:25.195453 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98d4592-d055-4a44-9dc9-0d76285adc1b None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:02:25.199682 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d969fa0-b2c7-4440-ba5c-231fe7ad2bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:02:25.200316 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d969fa0-b2c7-4440-ba5c-231fe7ad2bec admin admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:25.200605 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d969fa0-b2c7-4440-ba5c-231fe7ad2bec admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:25.200875 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d969fa0-b2c7-4440-ba5c-231fe7ad2bec admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:25.209119 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d969fa0-b2c7-4440-ba5c-231fe7ad2bec admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:02:25.260078 dv-cinder-855189-1-smb devstack@keystone.service[81719]: WARNING keystone.common.rbac_enforcer.enforcer [None req-5d969fa0-b2c7-4440-ba5c-231fe7ad2bec admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 05 12:02:25.260413 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d969fa0-b2c7-4440-ba5c-231fe7ad2bec admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:02:25.271111 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 2/4] 10.222.0.50 () {58 vars in 1324 bytes} [Mon Sep 5 12:02:24 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 05 12:02:25.277476 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a71f443-f32d-469e-8158-d07bba33a3e6 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:02:25.292271 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a71f443-f32d-469e-8158-d07bba33a3e6 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:02:25.296698 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f906ae52-d08a-4103-ab7e-19aa9c03112a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:02:25.297870 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f906ae52-d08a-4103-ab7e-19aa9c03112a admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:25.298149 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f906ae52-d08a-4103-ab7e-19aa9c03112a admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:25.298416 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f906ae52-d08a-4103-ab7e-19aa9c03112a admin admin] PATH_INFO: `/v3/projects/f7dbd9a59249418592cb2f883c3937fa` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:25.300015 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f906ae52-d08a-4103-ab7e-19aa9c03112a admin admin] RBAC: Authorizing `identity:get_project(project_id=f7dbd9a59249418592cb2f883c3937fa)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:02:25.351828 dv-cinder-855189-1-smb devstack@keystone.service[81720]: WARNING keystone.common.rbac_enforcer.enforcer [None req-f906ae52-d08a-4103-ab7e-19aa9c03112a admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 05 12:02:25.352166 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f906ae52-d08a-4103-ab7e-19aa9c03112a admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:02:25.356884 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 3/5] 10.222.0.50 () {56 vars in 1207 bytes} [Mon Sep 5 12:02:25 2022] GET /identity/v3/projects/f7dbd9a59249418592cb2f883c3937fa => generated 344 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:02:27.262276 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdb052e-1318-48b4-99b4-56c01fb23650 None None] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:27.262847 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdb052e-1318-48b4-99b4-56c01fb23650 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:27.263521 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdb052e-1318-48b4-99b4-56c01fb23650 None None] PATH_INFO: `/` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:27.267716 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 3/6] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:02:27 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 12:02:27.273408 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d474a42-1cab-4180-861d-2134d529ee21 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:27.274101 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d474a42-1cab-4180-861d-2134d529ee21 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:27.274220 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d474a42-1cab-4180-861d-2134d529ee21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:27.294270 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-6d474a42-1cab-4180-861d-2134d529ee21 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:02:27.295961 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-6d474a42-1cab-4180-861d-2134d529ee21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:02:27.303858 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 4/7] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:02:27 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 05 12:02:27.584435 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdb052e-1318-48b4-99b4-56c01fb23650 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:02:27.596731 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdb052e-1318-48b4-99b4-56c01fb23650 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:02:27.600967 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14285e49-b906-4fca-b27d-3999cbdf4c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:02:27.601586 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14285e49-b906-4fca-b27d-3999cbdf4c4d admin admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:27.601870 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14285e49-b906-4fca-b27d-3999cbdf4c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:27.602142 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14285e49-b906-4fca-b27d-3999cbdf4c4d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:27.611016 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14285e49-b906-4fca-b27d-3999cbdf4c4d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:02:27.612816 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14285e49-b906-4fca-b27d-3999cbdf4c4d admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:02:27.622230 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 4/8] 10.222.0.50 () {58 vars in 1324 bytes} [Mon Sep 5 12:02:27 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 05 12:02:27.628564 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d474a42-1cab-4180-861d-2134d529ee21 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:02:27.638099 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d474a42-1cab-4180-861d-2134d529ee21 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:02:27.642572 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e60548-fdba-4707-9104-8296d3c65704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:02:27.643211 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e60548-fdba-4707-9104-8296d3c65704 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:27.643497 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e60548-fdba-4707-9104-8296d3c65704 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:27.643775 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e60548-fdba-4707-9104-8296d3c65704 admin admin] PATH_INFO: `/v3/users/5ec42edb9cd44e278afe2e10f9b7de4c` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:27.645131 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e60548-fdba-4707-9104-8296d3c65704 admin admin] RBAC: Authorizing `identity:get_user(user_id=5ec42edb9cd44e278afe2e10f9b7de4c)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:02:27.647007 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e60548-fdba-4707-9104-8296d3c65704 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:02:27.648578 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 5/9] 10.222.0.50 () {56 vars in 1198 bytes} [Mon Sep 5 12:02:27 2022] GET /identity/v3/users/5ec42edb9cd44e278afe2e10f9b7de4c => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:02:29.620748 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2295a77-df80-4e38-ac37-f99af8eb5a34 None None] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:29.621496 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2295a77-df80-4e38-ac37-f99af8eb5a34 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:29.621496 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2295a77-df80-4e38-ac37-f99af8eb5a34 None None] PATH_INFO: `/` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:29.622641 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 5/10] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:02:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:02:29.627810 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdbed59-1f9a-4b24-9e4b-bf8ff5860639 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:29.628261 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdbed59-1f9a-4b24-9e4b-bf8ff5860639 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:29.628362 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdbed59-1f9a-4b24-9e4b-bf8ff5860639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:29.647620 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-7fdbed59-1f9a-4b24-9e4b-bf8ff5860639 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:02:29.649141 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-7fdbed59-1f9a-4b24-9e4b-bf8ff5860639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:02:29.682172 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68792d1c-cb5d-48ba-902c-d399c3a927e9 None None] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:29.682572 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68792d1c-cb5d-48ba-902c-d399c3a927e9 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:29.682733 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68792d1c-cb5d-48ba-902c-d399c3a927e9 None None] PATH_INFO: `/` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:29.684063 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 6/11] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:02:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:02:29.689715 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566fc749-d097-497f-b2e1-e166fbcf962b None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:29.690057 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566fc749-d097-497f-b2e1-e166fbcf962b None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:29.690261 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566fc749-d097-497f-b2e1-e166fbcf962b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:29.735597 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG passlib.handlers.bcrypt [None req-566fc749-d097-497f-b2e1-e166fbcf962b None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81719) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 05 12:02:29.736215 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG passlib.handlers.bcrypt [None req-566fc749-d097-497f-b2e1-e166fbcf962b None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81719) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 05 12:02:29.743445 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 6/12] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:02:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:02:29.791148 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-566fc749-d097-497f-b2e1-e166fbcf962b None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:02:29.793881 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-566fc749-d097-497f-b2e1-e166fbcf962b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:02:29.914348 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 7/13] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:02:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:02:30.046364 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdbed59-1f9a-4b24-9e4b-bf8ff5860639 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:02:30.071999 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:02:30.158262 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdbed59-1f9a-4b24-9e4b-bf8ff5860639 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:02:30.182348 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566fc749-d097-497f-b2e1-e166fbcf962b None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:02:30.193554 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7ff37d-2afe-41e8-b68f-8ebd322f8e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:02:30.194207 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7ff37d-2afe-41e8-b68f-8ebd322f8e7a None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:30.194493 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7ff37d-2afe-41e8-b68f-8ebd322f8e7a None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:30.194774 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7ff37d-2afe-41e8-b68f-8ebd322f8e7a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:30.206926 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7ff37d-2afe-41e8-b68f-8ebd322f8e7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:02:30.215850 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-bb7ff37d-2afe-41e8-b68f-8ebd322f8e7a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 12:02:30.215850 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:02:30.215850 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:02:30.215850 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:02:30.215850 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:02:30.215850 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:02:30.215850 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:02:30.215850 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:02:30.215850 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:02:30.215850 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:02:30.215850 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:02:30.215850 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:02:30.215850 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:02:30.215850 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:02:30.215850 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:02:30.215850 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:02:30.216780 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:02:30.216780 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:02:30.216780 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:02:30.216780 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:02:30.216780 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:02:30.216780 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:02:30.216780 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:02:30.216780 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:02:30.216780 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:02:30.216780 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:02:30.216780 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:02:30.216780 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:02:30.216780 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:02:30.216780 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:02:30.216780 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:02:30.216780 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:02:30.217674 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:02:30.217674 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:02:30.217674 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:02:30.217674 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:02:30.217674 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:02:30.217674 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:02:30.217674 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:02:30.217674 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:02:30.217674 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:02:30.217674 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:02:30.217674 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 12:02:30.217674 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:02:30.217674 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 7/14] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Sep 5 12:02:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:02:30.224354 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7ff37d-2afe-41e8-b68f-8ebd322f8e7a None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:02:30.289791 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566fc749-d097-497f-b2e1-e166fbcf962b None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:02:30.292083 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:02:30.308607 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:02:30.329228 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7ff37d-2afe-41e8-b68f-8ebd322f8e7a None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:02:30.331011 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84ce1ed-4762-4225-a8fb-03aa3d105553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:02:30.331902 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84ce1ed-4762-4225-a8fb-03aa3d105553 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:30.332190 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84ce1ed-4762-4225-a8fb-03aa3d105553 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:30.332465 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84ce1ed-4762-4225-a8fb-03aa3d105553 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:30.364803 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4c82f9-8844-44a2-bba8-660850b9cfa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:02:30.365461 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4c82f9-8844-44a2-bba8-660850b9cfa4 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:30.365747 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4c82f9-8844-44a2-bba8-660850b9cfa4 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:30.366024 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4c82f9-8844-44a2-bba8-660850b9cfa4 None admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:30.366707 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4c82f9-8844-44a2-bba8-660850b9cfa4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:02:30.367014 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4c82f9-8844-44a2-bba8-660850b9cfa4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:02:30.368435 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4c82f9-8844-44a2-bba8-660850b9cfa4 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:02:30.381708 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 8/15] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Sep 5 12:02:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:02:30.387210 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4c82f9-8844-44a2-bba8-660850b9cfa4 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:02:30.402054 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84ce1ed-4762-4225-a8fb-03aa3d105553 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:02:30.403639 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84ce1ed-4762-4225-a8fb-03aa3d105553 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:02:30.500737 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4c82f9-8844-44a2-bba8-660850b9cfa4 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:02:30.503744 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 8/16] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Sep 5 12:02:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 05 12:02:30.509250 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84ce1ed-4762-4225-a8fb-03aa3d105553 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:02:30.512132 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:02:30.535692 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e931f971-47ee-4f58-bcc5-75a585b57057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:02:30.536340 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e931f971-47ee-4f58-bcc5-75a585b57057 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:30.536631 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e931f971-47ee-4f58-bcc5-75a585b57057 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:30.536922 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e931f971-47ee-4f58-bcc5-75a585b57057 None admin] PATH_INFO: `/v3/users/5ec42edb9cd44e278afe2e10f9b7de4c` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:30.538095 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e931f971-47ee-4f58-bcc5-75a585b57057 None admin] RBAC: Authorizing `identity:get_user(user_id=5ec42edb9cd44e278afe2e10f9b7de4c)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:02:30.539575 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e931f971-47ee-4f58-bcc5-75a585b57057 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:02:30.541207 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 9/17] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Sep 5 12:02:30 2022] GET /identity/v3/users/5ec42edb9cd44e278afe2e10f9b7de4c => generated 247 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:02:30.547281 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e931f971-47ee-4f58-bcc5-75a585b57057 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:02:30.564191 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:02:30.612710 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84ce1ed-4762-4225-a8fb-03aa3d105553 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:02:30.648021 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e06eda-fc83-4f81-b712-276bb93c8756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:02:30.649187 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e06eda-fc83-4f81-b712-276bb93c8756 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:30.649472 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e06eda-fc83-4f81-b712-276bb93c8756 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:30.649749 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e06eda-fc83-4f81-b712-276bb93c8756 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:30.652763 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e931f971-47ee-4f58-bcc5-75a585b57057 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:02:30.668842 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e06eda-fc83-4f81-b712-276bb93c8756 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:02:30.670860 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e06eda-fc83-4f81-b712-276bb93c8756 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:02:30.687825 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179d1dda-dc5b-4771-8eac-8e5ddd9e61b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:02:30.688458 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179d1dda-dc5b-4771-8eac-8e5ddd9e61b9 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:30.688737 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179d1dda-dc5b-4771-8eac-8e5ddd9e61b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:30.689037 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179d1dda-dc5b-4771-8eac-8e5ddd9e61b9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:30.690100 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application [None req-93e06eda-fc83-4f81-b712-276bb93c8756 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:02:30.690100 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:02:30.690100 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:02:30.690100 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:02:30.690100 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:02:30.690100 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:02:30.690100 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:02:30.690100 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:02:30.690100 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:02:30.690100 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:02:30.690100 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:02:30.690100 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:02:30.690100 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:02:30.690100 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:02:30.690100 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:02:30.690100 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:02:30.691021 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:02:30.691021 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:02:30.691021 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:02:30.691021 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:02:30.691021 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:02:30.691021 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:02:30.691021 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:02:30.691021 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application with Lock( Sep 05 12:02:30.691021 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:02:30.691021 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:02:30.691021 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:02:30.691021 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:02:30.691021 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:02:30.691021 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:02:30.691021 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:02:30.691021 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:02:30.691021 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:02:30.691835 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:02:30.691835 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:02:30.691835 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:02:30.692002 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179d1dda-dc5b-4771-8eac-8e5ddd9e61b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:02:30.692074 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 9/18] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 5 12:02:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 12:02:30.692139 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179d1dda-dc5b-4771-8eac-8e5ddd9e61b9 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:02:30.693351 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 10/19] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 5 12:02:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:02:30.697116 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e06eda-fc83-4f81-b712-276bb93c8756 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:02:30.698807 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179d1dda-dc5b-4771-8eac-8e5ddd9e61b9 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:02:30.756597 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:02:30.785901 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:02:30.806524 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179d1dda-dc5b-4771-8eac-8e5ddd9e61b9 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:02:30.807549 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e06eda-fc83-4f81-b712-276bb93c8756 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:02:30.842062 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c149163-bb9c-425c-8b5d-9d18546480d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:02:30.842691 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c149163-bb9c-425c-8b5d-9d18546480d0 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:30.842976 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c149163-bb9c-425c-8b5d-9d18546480d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:30.843136 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d766c3-23da-499a-a772-fe0d5f241beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:02:30.843239 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c149163-bb9c-425c-8b5d-9d18546480d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:30.843749 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d766c3-23da-499a-a772-fe0d5f241beb None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:30.843984 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c149163-bb9c-425c-8b5d-9d18546480d0 None admin] RBAC: Adding query filter params (role.id=16e2ccc8bd1b497d8cee780c1c7df0d2, scope.domain.id=default, user.id=5ec42edb9cd44e278afe2e10f9b7de4c) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:02:30.844087 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d766c3-23da-499a-a772-fe0d5f241beb None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:30.844295 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d766c3-23da-499a-a772-fe0d5f241beb None admin] PATH_INFO: `/v3/domains` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:30.844384 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c149163-bb9c-425c-8b5d-9d18546480d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:02:30.844977 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d766c3-23da-499a-a772-fe0d5f241beb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:02:30.845347 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d766c3-23da-499a-a772-fe0d5f241beb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:02:30.845794 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c149163-bb9c-425c-8b5d-9d18546480d0 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:02:30.846738 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d766c3-23da-499a-a772-fe0d5f241beb None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:02:30.853252 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 11/20] 10.222.0.50 () {56 vars in 1322 bytes} [Mon Sep 5 12:02:30 2022] GET /identity/v3/role_assignments?user.id=5ec42edb9cd44e278afe2e10f9b7de4c&scope.domain.id=default&role.id=16e2ccc8bd1b497d8cee780c1c7df0d2 => generated 233 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:02:30.867364 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 10/21] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 5 12:02:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:02:32.964980 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cd11d9-7b39-4925-9174-63bdc7913682 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:32.966048 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cd11d9-7b39-4925-9174-63bdc7913682 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:32.966563 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cd11d9-7b39-4925-9174-63bdc7913682 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:32.968112 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 12/22] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:02:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:02:32.973851 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2079741a-1c4b-4fa2-a322-59e7e3adccba None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:32.974769 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2079741a-1c4b-4fa2-a322-59e7e3adccba None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:32.975285 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2079741a-1c4b-4fa2-a322-59e7e3adccba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:33.001922 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-2079741a-1c4b-4fa2-a322-59e7e3adccba None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:02:33.003495 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-2079741a-1c4b-4fa2-a322-59e7e3adccba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:02:33.091894 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 11/23] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:02:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:02:33.284633 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a38b2a1-6a36-49da-8c7e-abbd9785e373 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:33.285428 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a38b2a1-6a36-49da-8c7e-abbd9785e373 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:33.285916 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a38b2a1-6a36-49da-8c7e-abbd9785e373 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:33.287460 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 13/24] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:02:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:02:33.306005 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b305d7fd-4ea3-4dde-b19a-e447d0449a88 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:33.306617 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b305d7fd-4ea3-4dde-b19a-e447d0449a88 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:33.307121 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b305d7fd-4ea3-4dde-b19a-e447d0449a88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:33.337941 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-b305d7fd-4ea3-4dde-b19a-e447d0449a88 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:02:33.339594 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-b305d7fd-4ea3-4dde-b19a-e447d0449a88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:02:33.396153 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:02:33.436123 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 12/25] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:02:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:02:33.613979 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd40b9-2989-4776-a727-b403bcb8bc97 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:33.614361 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd40b9-2989-4776-a727-b403bcb8bc97 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:33.614552 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd40b9-2989-4776-a727-b403bcb8bc97 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:33.616076 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 14/26] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:02:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:02:33.621182 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c16eb01-86fd-4d89-9724-031054147c88 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:33.621478 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c16eb01-86fd-4d89-9724-031054147c88 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:33.623442 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fd40b9-2989-4776-a727-b403bcb8bc97 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:02:33.623889 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c16eb01-86fd-4d89-9724-031054147c88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:33.669583 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-8c16eb01-86fd-4d89-9724-031054147c88 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:02:33.671227 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-8c16eb01-86fd-4d89-9724-031054147c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:02:33.798275 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fd40b9-2989-4776-a727-b403bcb8bc97 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:02:33.832787 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 13/27] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:02:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:02:33.860509 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd0c6ac-dae3-4ba6-9c48-d3cc23405323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:02:33.861427 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd0c6ac-dae3-4ba6-9c48-d3cc23405323 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:33.861856 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd0c6ac-dae3-4ba6-9c48-d3cc23405323 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:33.862303 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd0c6ac-dae3-4ba6-9c48-d3cc23405323 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:33.878872 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd0c6ac-dae3-4ba6-9c48-d3cc23405323 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:02:33.884201 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-6dd0c6ac-dae3-4ba6-9c48-d3cc23405323 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 12:02:33.884201 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:02:33.884201 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:02:33.884201 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:02:33.884201 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:02:33.884201 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:02:33.884201 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:02:33.884201 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:02:33.884201 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:02:33.884201 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:02:33.884201 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:02:33.884201 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:02:33.884201 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:02:33.884201 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:02:33.884201 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:02:33.884201 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:02:33.885082 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:02:33.885082 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:02:33.885082 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:02:33.885082 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:02:33.885082 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:02:33.885082 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:02:33.885082 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:02:33.885082 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:02:33.885082 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:02:33.885082 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:02:33.885082 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:02:33.885082 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:02:33.885082 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:02:33.885082 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:02:33.885082 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:02:33.885082 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:02:33.885857 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:02:33.885857 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:02:33.885857 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:02:33.885857 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:02:33.885857 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:02:33.885857 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:02:33.885857 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:02:33.885857 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:02:33.885857 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:02:33.885857 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:02:33.885857 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 12:02:33.885857 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:02:33.885857 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 15/28] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Sep 5 12:02:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:02:33.894060 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c16eb01-86fd-4d89-9724-031054147c88 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:02:33.954094 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1d7816-e7d2-41b6-946e-805b9df96b83 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:33.954689 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1d7816-e7d2-41b6-946e-805b9df96b83 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:33.955154 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1d7816-e7d2-41b6-946e-805b9df96b83 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:33.957175 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 16/29] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:02:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:02:33.962210 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc6f966-a467-4dbe-b132-9521d26a69f2 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:33.962773 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc6f966-a467-4dbe-b132-9521d26a69f2 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:33.963356 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc6f966-a467-4dbe-b132-9521d26a69f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:33.978032 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:02:33.996763 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-3bc6f966-a467-4dbe-b132-9521d26a69f2 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:02:33.998411 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-3bc6f966-a467-4dbe-b132-9521d26a69f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:02:34.016427 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c16eb01-86fd-4d89-9724-031054147c88 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:02:34.026663 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:02:34.089150 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1e3f46-d96f-43e1-9f2d-fba28fdd5d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:02:34.090133 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1e3f46-d96f-43e1-9f2d-fba28fdd5d4d None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:34.090622 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1e3f46-d96f-43e1-9f2d-fba28fdd5d4d None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:34.091618 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1e3f46-d96f-43e1-9f2d-fba28fdd5d4d None admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:34.092502 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1e3f46-d96f-43e1-9f2d-fba28fdd5d4d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:02:34.093036 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1e3f46-d96f-43e1-9f2d-fba28fdd5d4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:02:34.094617 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1e3f46-d96f-43e1-9f2d-fba28fdd5d4d None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:02:34.113490 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 14/30] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Sep 5 12:02:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:02:34.114650 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1e3f46-d96f-43e1-9f2d-fba28fdd5d4d None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:02:34.150290 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 17/31] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:02:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:02:34.152838 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc6f966-a467-4dbe-b132-9521d26a69f2 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:02:34.303969 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc6f966-a467-4dbe-b132-9521d26a69f2 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:02:34.339239 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1e3f46-d96f-43e1-9f2d-fba28fdd5d4d None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:02:34.381524 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d958a9c-b060-4fde-b198-16a9de716133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:02:34.382178 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d958a9c-b060-4fde-b198-16a9de716133 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:34.382462 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d958a9c-b060-4fde-b198-16a9de716133 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:34.382742 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d958a9c-b060-4fde-b198-16a9de716133 None admin] PATH_INFO: `/v3/users/5ec42edb9cd44e278afe2e10f9b7de4c` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:34.385657 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d958a9c-b060-4fde-b198-16a9de716133 None admin] RBAC: Authorizing `identity:get_user(user_id=5ec42edb9cd44e278afe2e10f9b7de4c)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:02:34.387180 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d958a9c-b060-4fde-b198-16a9de716133 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:02:34.394741 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 18/32] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Sep 5 12:02:34 2022] GET /identity/v3/users/5ec42edb9cd44e278afe2e10f9b7de4c => generated 247 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:02:34.396658 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d958a9c-b060-4fde-b198-16a9de716133 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:02:34.403292 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:02:34.417178 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d9f121-b8e2-4ca1-b120-0a9c48c69e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:02:34.417811 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d9f121-b8e2-4ca1-b120-0a9c48c69e30 None admin] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:34.418095 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d9f121-b8e2-4ca1-b120-0a9c48c69e30 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:34.418373 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d9f121-b8e2-4ca1-b120-0a9c48c69e30 None admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:34.419161 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d9f121-b8e2-4ca1-b120-0a9c48c69e30 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:02:34.420630 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d9f121-b8e2-4ca1-b120-0a9c48c69e30 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:02:34.520069 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d958a9c-b060-4fde-b198-16a9de716133 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:02:34.551796 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 15/33] 10.222.0.50 () {60 vars in 1131 bytes} [Mon Sep 5 12:02:34 2022] POST /identity/v3/roles => generated 219 bytes in 437 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:02:34.552817 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d9f121-b8e2-4ca1-b120-0a9c48c69e30 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:02:34.555862 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea618096-8df2-4c39-9cd7-ff837dcded22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:02:34.556441 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea618096-8df2-4c39-9cd7-ff837dcded22 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:34.556720 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea618096-8df2-4c39-9cd7-ff837dcded22 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:34.561125 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea618096-8df2-4c39-9cd7-ff837dcded22 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:34.577136 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea618096-8df2-4c39-9cd7-ff837dcded22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:02:34.579261 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea618096-8df2-4c39-9cd7-ff837dcded22 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:02:34.587066 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:02:34.599557 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-ea618096-8df2-4c39-9cd7-ff837dcded22 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:02:34.599557 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:02:34.599557 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:02:34.599557 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:02:34.599557 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:02:34.599557 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:02:34.599557 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:02:34.599557 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:02:34.599557 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:02:34.599557 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:02:34.599557 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:02:34.599557 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:02:34.599557 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:02:34.599557 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:02:34.599557 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:02:34.599557 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:02:34.600515 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:02:34.600515 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:02:34.600515 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:02:34.600515 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:02:34.600515 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:02:34.600515 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:02:34.600515 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:02:34.600515 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:02:34.600515 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:02:34.600515 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:02:34.600515 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:02:34.600515 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:02:34.600515 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:02:34.600515 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:02:34.600515 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:02:34.600515 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:02:34.600515 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:02:34.601413 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:02:34.601413 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:02:34.601413 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:02:34.604624 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 19/34] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 5 12:02:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:02:34.606591 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bbc07b-6e5e-48f8-afa5-8b61646dc363 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:34.607135 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bbc07b-6e5e-48f8-afa5-8b61646dc363 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:34.607640 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bbc07b-6e5e-48f8-afa5-8b61646dc363 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:34.609385 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 20/35] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:02:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:02:34.614641 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bbc07b-6e5e-48f8-afa5-8b61646dc363 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:02:34.679519 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d9f121-b8e2-4ca1-b120-0a9c48c69e30 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:02:34.682805 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:02:34.724091 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87ce3dd-1d73-4c9b-a166-3a6cba135d2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:02:34.724877 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87ce3dd-1d73-4c9b-a166-3a6cba135d2a None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:34.725190 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87ce3dd-1d73-4c9b-a166-3a6cba135d2a None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:34.725467 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87ce3dd-1d73-4c9b-a166-3a6cba135d2a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:34.727275 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87ce3dd-1d73-4c9b-a166-3a6cba135d2a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:02:34.728879 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87ce3dd-1d73-4c9b-a166-3a6cba135d2a None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:02:34.730884 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 16/36] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 5 12:02:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:02:34.731815 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87ce3dd-1d73-4c9b-a166-3a6cba135d2a None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:02:34.738985 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bbc07b-6e5e-48f8-afa5-8b61646dc363 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:02:34.785091 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8373aa4-64a9-4d99-869a-6b2fce939487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:02:34.785817 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8373aa4-64a9-4d99-869a-6b2fce939487 None admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:34.785817 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8373aa4-64a9-4d99-869a-6b2fce939487 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:34.786065 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8373aa4-64a9-4d99-869a-6b2fce939487 None admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:34.786659 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8373aa4-64a9-4d99-869a-6b2fce939487 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:02:34.788087 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8373aa4-64a9-4d99-869a-6b2fce939487 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:02:34.846234 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:02:34.852812 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87ce3dd-1d73-4c9b-a166-3a6cba135d2a None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:02:34.886347 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3993e7db-8201-4df0-8a5c-2b8dacfa0bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:02:34.886956 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3993e7db-8201-4df0-8a5c-2b8dacfa0bb0 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:34.887237 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3993e7db-8201-4df0-8a5c-2b8dacfa0bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:34.887510 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3993e7db-8201-4df0-8a5c-2b8dacfa0bb0 None admin] PATH_INFO: `/v3/domains` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:34.888725 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3993e7db-8201-4df0-8a5c-2b8dacfa0bb0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:02:34.889052 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3993e7db-8201-4df0-8a5c-2b8dacfa0bb0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:02:34.890444 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3993e7db-8201-4df0-8a5c-2b8dacfa0bb0 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:02:34.903155 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 17/37] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 5 12:02:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:02:34.904544 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0047746-0bff-4540-a0fc-c8db4217465e None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:34.904832 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0047746-0bff-4540-a0fc-c8db4217465e None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:34.905133 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0047746-0bff-4540-a0fc-c8db4217465e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:34.912336 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 21/38] 10.222.0.50 () {60 vars in 1131 bytes} [Mon Sep 5 12:02:34 2022] POST /identity/v3/roles => generated 225 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:02:34.913326 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8373aa4-64a9-4d99-869a-6b2fce939487 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:02:34.924801 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-f0047746-0bff-4540-a0fc-c8db4217465e None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:02:34.926554 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-f0047746-0bff-4540-a0fc-c8db4217465e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:02:35.020930 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 18/39] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:02:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:02:35.020930 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eae3df5-e31a-49af-bb28-9af0fc154dff None None] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:35.020930 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eae3df5-e31a-49af-bb28-9af0fc154dff None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:35.020930 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eae3df5-e31a-49af-bb28-9af0fc154dff None None] PATH_INFO: `/` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:35.020930 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 19/40] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:02:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:02:35.021908 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eae3df5-e31a-49af-bb28-9af0fc154dff None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:02:35.030220 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8373aa4-64a9-4d99-869a-6b2fce939487 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:02:35.047545 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:02:35.074039 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da111a2-8f68-4c0a-abad-e0058da1a838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:02:35.075176 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da111a2-8f68-4c0a-abad-e0058da1a838 None admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:35.075517 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da111a2-8f68-4c0a-abad-e0058da1a838 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:35.075833 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da111a2-8f68-4c0a-abad-e0058da1a838 None admin] PATH_INFO: `/v3/domains/default/users/5ec42edb9cd44e278afe2e10f9b7de4c/roles/16e2ccc8bd1b497d8cee780c1c7df0d2` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:35.080672 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da111a2-8f68-4c0a-abad-e0058da1a838 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=5ec42edb9cd44e278afe2e10f9b7de4c, role_id=16e2ccc8bd1b497d8cee780c1c7df0d2)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:02:35.083451 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da111a2-8f68-4c0a-abad-e0058da1a838 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:02:35.103046 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 22/41] 10.222.0.50 () {58 vars in 1361 bytes} [Mon Sep 5 12:02:34 2022] PUT /identity/v3/domains/default/users/5ec42edb9cd44e278afe2e10f9b7de4c/roles/16e2ccc8bd1b497d8cee780c1c7df0d2 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:02:35.104243 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b381960d-ce88-4e43-9ac7-b36aba075415 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:35.104633 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b381960d-ce88-4e43-9ac7-b36aba075415 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:35.104801 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b381960d-ce88-4e43-9ac7-b36aba075415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:35.126852 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-b381960d-ce88-4e43-9ac7-b36aba075415 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:02:35.128471 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-b381960d-ce88-4e43-9ac7-b36aba075415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:02:35.145157 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:02:35.168688 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eae3df5-e31a-49af-bb28-9af0fc154dff None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:02:35.218910 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d90541-af1c-4049-a0c7-3c59141b593d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:02:35.219551 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d90541-af1c-4049-a0c7-3c59141b593d None admin] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:35.219837 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d90541-af1c-4049-a0c7-3c59141b593d None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:35.220117 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d90541-af1c-4049-a0c7-3c59141b593d None admin] PATH_INFO: `/v3/projects` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:35.220935 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d90541-af1c-4049-a0c7-3c59141b593d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:02:35.221043 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 23/42] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:02:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:02:35.222467 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d90541-af1c-4049-a0c7-3c59141b593d None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:02:35.257921 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 20/43] 10.222.0.50 () {60 vars in 1141 bytes} [Mon Sep 5 12:02:35 2022] POST /identity/v3/projects => generated 301 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:02:35.317786 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b381960d-ce88-4e43-9ac7-b36aba075415 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:02:35.446155 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b381960d-ce88-4e43-9ac7-b36aba075415 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:02:35.448990 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:02:35.505020 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d90541-af1c-4049-a0c7-3c59141b593d None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:02:35.597914 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f380fa6-79fc-4035-831b-22aa7fe91549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:02:35.598562 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f380fa6-79fc-4035-831b-22aa7fe91549 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:35.598834 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f380fa6-79fc-4035-831b-22aa7fe91549 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:35.599109 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f380fa6-79fc-4035-831b-22aa7fe91549 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:35.600415 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f380fa6-79fc-4035-831b-22aa7fe91549 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:02:35.601929 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f380fa6-79fc-4035-831b-22aa7fe91549 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:02:35.603869 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 24/44] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 5 12:02:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:02:35.609782 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f380fa6-79fc-4035-831b-22aa7fe91549 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:02:35.623192 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d90541-af1c-4049-a0c7-3c59141b593d None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:02:35.665990 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84bba75-e72a-4551-9964-6ca330fcb524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:02:35.666924 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84bba75-e72a-4551-9964-6ca330fcb524 None admin] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:35.667214 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84bba75-e72a-4551-9964-6ca330fcb524 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:35.667493 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84bba75-e72a-4551-9964-6ca330fcb524 None admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:35.668204 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84bba75-e72a-4551-9964-6ca330fcb524 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:02:35.670693 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84bba75-e72a-4551-9964-6ca330fcb524 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:02:35.680878 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:02:35.687966 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 21/45] 10.222.0.50 () {60 vars in 1131 bytes} [Mon Sep 5 12:02:35 2022] POST /identity/v3/roles => generated 223 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 12:02:35.731256 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f380fa6-79fc-4035-831b-22aa7fe91549 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:02:35.774812 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6033ec9-0ed1-494d-ad73-f527c9750bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:02:35.775454 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6033ec9-0ed1-494d-ad73-f527c9750bef None admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:35.775740 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6033ec9-0ed1-494d-ad73-f527c9750bef None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:35.776016 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6033ec9-0ed1-494d-ad73-f527c9750bef None admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:35.776711 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6033ec9-0ed1-494d-ad73-f527c9750bef None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:02:35.778888 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6033ec9-0ed1-494d-ad73-f527c9750bef None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:02:35.813835 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 25/46] 10.222.0.50 () {60 vars in 1141 bytes} [Mon Sep 5 12:02:35 2022] POST /identity/v3/projects => generated 312 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 12:02:37.157899 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687c2429-2840-471e-8ed2-6e06b987ab2c None None] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:37.158436 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687c2429-2840-471e-8ed2-6e06b987ab2c None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:37.158436 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687c2429-2840-471e-8ed2-6e06b987ab2c None None] PATH_INFO: `/` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:37.159955 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 22/47] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:02:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:02:37.165139 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddc34ed-e13a-4065-8b44-e97a279d16fc None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:37.165585 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddc34ed-e13a-4065-8b44-e97a279d16fc None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:37.165701 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddc34ed-e13a-4065-8b44-e97a279d16fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:37.184437 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-cddc34ed-e13a-4065-8b44-e97a279d16fc None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:02:37.185659 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-cddc34ed-e13a-4065-8b44-e97a279d16fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:02:37.203536 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:02:37.253245 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 26/48] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:02:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:02:37.523955 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687c2429-2840-471e-8ed2-6e06b987ab2c None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:02:37.634490 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687c2429-2840-471e-8ed2-6e06b987ab2c None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:02:37.667945 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edeca32-243f-44dd-9f9b-3a3a0ae4640a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:02:37.668577 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edeca32-243f-44dd-9f9b-3a3a0ae4640a None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:37.668855 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edeca32-243f-44dd-9f9b-3a3a0ae4640a None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:37.669153 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edeca32-243f-44dd-9f9b-3a3a0ae4640a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:37.680639 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edeca32-243f-44dd-9f9b-3a3a0ae4640a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:02:37.687130 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application [None req-5edeca32-243f-44dd-9f9b-3a3a0ae4640a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 12:02:37.687130 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:02:37.687130 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:02:37.687130 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:02:37.687130 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:02:37.687130 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:02:37.687130 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:02:37.687130 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:02:37.687130 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:02:37.687130 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:02:37.687130 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:02:37.687130 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:02:37.687130 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:02:37.687130 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:02:37.687130 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:02:37.687130 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:02:37.688111 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:02:37.688111 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:02:37.688111 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:02:37.688111 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:02:37.688111 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:02:37.688111 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:02:37.688111 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:02:37.688111 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:02:37.688111 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:02:37.688111 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:02:37.688111 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:02:37.688111 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application with Lock( Sep 05 12:02:37.688111 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:02:37.688111 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:02:37.688111 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:02:37.688111 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:02:37.688879 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:02:37.688879 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:02:37.688879 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:02:37.688879 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:02:37.688879 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:02:37.688879 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:02:37.688879 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:02:37.688879 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:02:37.688879 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:02:37.688879 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:02:37.688879 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 12:02:37.688879 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:02:37.688879 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 23/49] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Sep 5 12:02:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:02:37.694136 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddc34ed-e13a-4065-8b44-e97a279d16fc None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:02:37.755449 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e769de4a-8efe-4285-bcdd-c28f11fd206a None None] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:37.755741 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e769de4a-8efe-4285-bcdd-c28f11fd206a None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:37.756026 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e769de4a-8efe-4285-bcdd-c28f11fd206a None None] PATH_INFO: `/` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:37.757619 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 24/50] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:02:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 12:02:37.763225 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2ad182-c34d-4d0c-8bf9-72feb1ec2443 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:37.763518 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2ad182-c34d-4d0c-8bf9-72feb1ec2443 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:37.763803 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2ad182-c34d-4d0c-8bf9-72feb1ec2443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:37.783525 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-1a2ad182-c34d-4d0c-8bf9-72feb1ec2443 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:02:37.783743 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-1a2ad182-c34d-4d0c-8bf9-72feb1ec2443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:02:37.802283 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddc34ed-e13a-4065-8b44-e97a279d16fc None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:02:37.837748 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f06996-c745-47ab-b3a8-c77593b0cc68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:02:37.838364 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f06996-c745-47ab-b3a8-c77593b0cc68 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:37.838643 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f06996-c745-47ab-b3a8-c77593b0cc68 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:37.838911 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f06996-c745-47ab-b3a8-c77593b0cc68 None admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:37.839266 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:02:37.839584 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f06996-c745-47ab-b3a8-c77593b0cc68 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:02:37.839885 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f06996-c745-47ab-b3a8-c77593b0cc68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:02:37.841460 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f06996-c745-47ab-b3a8-c77593b0cc68 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:02:37.850572 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 27/51] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Sep 5 12:02:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:02:37.853674 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 25/52] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:02:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 05 12:02:37.856273 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f06996-c745-47ab-b3a8-c77593b0cc68 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:02:37.874692 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:02:37.955420 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f06996-c745-47ab-b3a8-c77593b0cc68 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:02:37.988579 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef70fe0-2ac7-4e84-be26-7d32d9979ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:02:37.989244 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef70fe0-2ac7-4e84-be26-7d32d9979ccc None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:37.989526 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef70fe0-2ac7-4e84-be26-7d32d9979ccc None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:37.989796 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef70fe0-2ac7-4e84-be26-7d32d9979ccc None admin] PATH_INFO: `/v3/users/5ec42edb9cd44e278afe2e10f9b7de4c` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:37.990921 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef70fe0-2ac7-4e84-be26-7d32d9979ccc None admin] RBAC: Authorizing `identity:get_user(user_id=5ec42edb9cd44e278afe2e10f9b7de4c)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:02:37.992404 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef70fe0-2ac7-4e84-be26-7d32d9979ccc None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:02:37.994007 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 28/53] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Sep 5 12:02:37 2022] GET /identity/v3/users/5ec42edb9cd44e278afe2e10f9b7de4c => generated 247 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:02:38.000271 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2ad182-c34d-4d0c-8bf9-72feb1ec2443 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:02:38.102842 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2ad182-c34d-4d0c-8bf9-72feb1ec2443 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:02:38.128232 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef70fe0-2ac7-4e84-be26-7d32d9979ccc None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:02:38.229305 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:02:38.245939 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f339f5d0-65ea-45e0-a44b-194165d93757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:02:38.246634 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f339f5d0-65ea-45e0-a44b-194165d93757 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:38.246970 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f339f5d0-65ea-45e0-a44b-194165d93757 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:38.247672 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef70fe0-2ac7-4e84-be26-7d32d9979ccc None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:02:38.247812 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f339f5d0-65ea-45e0-a44b-194165d93757 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:38.248992 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f339f5d0-65ea-45e0-a44b-194165d93757 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:02:38.250463 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f339f5d0-65ea-45e0-a44b-194165d93757 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:02:38.252073 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 26/54] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 5 12:02:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:02:38.257961 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f339f5d0-65ea-45e0-a44b-194165d93757 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:02:38.283738 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f2ab33-e3e4-4fea-b30e-c34f2c0d123d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:02:38.284373 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f2ab33-e3e4-4fea-b30e-c34f2c0d123d None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:38.284652 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f2ab33-e3e4-4fea-b30e-c34f2c0d123d None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:38.284945 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f2ab33-e3e4-4fea-b30e-c34f2c0d123d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:38.286049 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f2ab33-e3e4-4fea-b30e-c34f2c0d123d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:02:38.287505 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f2ab33-e3e4-4fea-b30e-c34f2c0d123d None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:02:38.289101 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 29/55] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 5 12:02:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:02:38.295328 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f2ab33-e3e4-4fea-b30e-c34f2c0d123d None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:02:38.315844 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:02:38.361058 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f339f5d0-65ea-45e0-a44b-194165d93757 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:02:38.395887 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f2ab33-e3e4-4fea-b30e-c34f2c0d123d None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:02:38.397681 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef809fd-7f8c-4a0b-bc2a-4b8a236af905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:02:38.398309 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef809fd-7f8c-4a0b-bc2a-4b8a236af905 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:38.398831 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef809fd-7f8c-4a0b-bc2a-4b8a236af905 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:38.399115 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef809fd-7f8c-4a0b-bc2a-4b8a236af905 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:38.399850 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef809fd-7f8c-4a0b-bc2a-4b8a236af905 None admin] RBAC: Adding query filter params (role.id=16e2ccc8bd1b497d8cee780c1c7df0d2, scope.domain.id=default, user.id=5ec42edb9cd44e278afe2e10f9b7de4c) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:02:38.400161 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef809fd-7f8c-4a0b-bc2a-4b8a236af905 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:02:38.401643 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef809fd-7f8c-4a0b-bc2a-4b8a236af905 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:02:38.411075 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 27/56] 10.222.0.50 () {56 vars in 1322 bytes} [Mon Sep 5 12:02:38 2022] GET /identity/v3/role_assignments?user.id=5ec42edb9cd44e278afe2e10f9b7de4c&scope.domain.id=default&role.id=16e2ccc8bd1b497d8cee780c1c7df0d2 => generated 530 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:02:38.442083 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d98c6b-280b-480f-bb6c-0396ad23905f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:02:38.442721 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d98c6b-280b-480f-bb6c-0396ad23905f None admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:38.443005 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d98c6b-280b-480f-bb6c-0396ad23905f None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:38.443282 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d98c6b-280b-480f-bb6c-0396ad23905f None admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:38.443959 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d98c6b-280b-480f-bb6c-0396ad23905f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:02:38.445548 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d98c6b-280b-480f-bb6c-0396ad23905f None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:02:38.477250 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 30/57] 10.222.0.50 () {60 vars in 1140 bytes} [Mon Sep 5 12:02:38 2022] POST /identity/v3/projects => generated 298 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 12:02:40.393319 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e047e29-a3f4-48c8-8080-ab3e5405bc4a None None] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:40.393870 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e047e29-a3f4-48c8-8080-ab3e5405bc4a None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:40.393870 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e047e29-a3f4-48c8-8080-ab3e5405bc4a None None] PATH_INFO: `/` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:40.395211 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 28/58] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:02:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:02:40.400540 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997b5dc5-6b2f-4e8c-b43e-41ff982f5428 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:40.400950 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997b5dc5-6b2f-4e8c-b43e-41ff982f5428 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:40.401119 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997b5dc5-6b2f-4e8c-b43e-41ff982f5428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:40.408954 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:02:40.420656 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-997b5dc5-6b2f-4e8c-b43e-41ff982f5428 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:02:40.421912 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-997b5dc5-6b2f-4e8c-b43e-41ff982f5428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:02:40.487169 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 31/59] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:02:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:02:40.751727 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e047e29-a3f4-48c8-8080-ab3e5405bc4a None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:02:40.850105 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e047e29-a3f4-48c8-8080-ab3e5405bc4a None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:02:40.869637 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:02:40.883095 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257c1e30-dd36-4a4f-a505-3b46869034e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:02:40.883726 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257c1e30-dd36-4a4f-a505-3b46869034e1 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:40.884007 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257c1e30-dd36-4a4f-a505-3b46869034e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:40.884280 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257c1e30-dd36-4a4f-a505-3b46869034e1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:40.885406 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257c1e30-dd36-4a4f-a505-3b46869034e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:02:40.886835 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257c1e30-dd36-4a4f-a505-3b46869034e1 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:02:40.888422 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 29/60] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 5 12:02:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:02:40.893888 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997b5dc5-6b2f-4e8c-b43e-41ff982f5428 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:02:40.991474 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997b5dc5-6b2f-4e8c-b43e-41ff982f5428 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:02:41.025462 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb1ca4b-6e79-42e7-96c3-cf42dfbb8694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:02:41.026009 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb1ca4b-6e79-42e7-96c3-cf42dfbb8694 None admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:41.026294 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb1ca4b-6e79-42e7-96c3-cf42dfbb8694 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:41.026579 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb1ca4b-6e79-42e7-96c3-cf42dfbb8694 None admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:41.027242 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb1ca4b-6e79-42e7-96c3-cf42dfbb8694 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:02:41.029335 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb1ca4b-6e79-42e7-96c3-cf42dfbb8694 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:02:41.039070 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:02:41.055755 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 32/61] 10.222.0.50 () {60 vars in 1132 bytes} [Mon Sep 5 12:02:40 2022] POST /identity/v3/users => generated 275 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:02:44.060203 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff69792-9603-4b58-85d5-35036b186982 None None] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:44.061159 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff69792-9603-4b58-85d5-35036b186982 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:44.061658 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff69792-9603-4b58-85d5-35036b186982 None None] PATH_INFO: `/` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:44.063268 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 30/62] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:02:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:02:44.068754 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c18775-1d17-492f-80bd-21e1e703f3aa None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:44.069244 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706a24f2-fdc3-4d4d-bd1b-e4f2ec3bddbb None None] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:44.069340 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706a24f2-fdc3-4d4d-bd1b-e4f2ec3bddbb None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:44.070896 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706a24f2-fdc3-4d4d-bd1b-e4f2ec3bddbb None None] PATH_INFO: `/` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:44.071135 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c18775-1d17-492f-80bd-21e1e703f3aa None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:44.071135 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c18775-1d17-492f-80bd-21e1e703f3aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:44.071279 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 31/63] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:02:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:02:44.077589 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bca010c-555c-4880-9296-2f5fce7cb2a6 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:44.078185 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bca010c-555c-4880-9296-2f5fce7cb2a6 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:44.078633 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bca010c-555c-4880-9296-2f5fce7cb2a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:44.110331 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-0bca010c-555c-4880-9296-2f5fce7cb2a6 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:02:44.111811 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-0bca010c-555c-4880-9296-2f5fce7cb2a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:02:44.114049 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-39c18775-1d17-492f-80bd-21e1e703f3aa None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:02:44.115770 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-39c18775-1d17-492f-80bd-21e1e703f3aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:02:44.216244 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 32/64] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:02:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:02:44.251796 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 33/65] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:02:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:02:44.352317 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e01764-f20d-408c-9ad4-1c181a48fb8d None None] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:44.352949 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e01764-f20d-408c-9ad4-1c181a48fb8d None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:44.353460 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e01764-f20d-408c-9ad4-1c181a48fb8d None None] PATH_INFO: `/` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:44.355047 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 33/66] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:02:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:02:44.361530 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1601dc62-0f56-45ee-90b4-27886e3210b8 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:44.362152 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1601dc62-0f56-45ee-90b4-27886e3210b8 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:44.362637 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1601dc62-0f56-45ee-90b4-27886e3210b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:44.393129 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-1601dc62-0f56-45ee-90b4-27886e3210b8 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:02:44.394696 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-1601dc62-0f56-45ee-90b4-27886e3210b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:02:44.486297 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 34/67] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:02:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:02:44.567142 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e01764-f20d-408c-9ad4-1c181a48fb8d None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:02:44.572294 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1601dc62-0f56-45ee-90b4-27886e3210b8 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:02:44.630517 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:02:44.694664 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1601dc62-0f56-45ee-90b4-27886e3210b8 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:02:44.737610 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f697067-5516-4834-b88c-12546ecd10d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:02:44.738286 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f697067-5516-4834-b88c-12546ecd10d2 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:44.738572 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f697067-5516-4834-b88c-12546ecd10d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:44.738851 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f697067-5516-4834-b88c-12546ecd10d2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:44.750023 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f697067-5516-4834-b88c-12546ecd10d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:02:44.755780 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e01764-f20d-408c-9ad4-1c181a48fb8d None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:02:44.755915 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-1f697067-5516-4834-b88c-12546ecd10d2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 05 12:02:44.755915 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:02:44.755915 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:02:44.755915 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:02:44.755915 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:02:44.755915 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:02:44.755915 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:02:44.755915 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:02:44.755915 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:02:44.755915 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:02:44.755915 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:02:44.755915 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:02:44.755915 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:02:44.755915 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:02:44.755915 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:02:44.755915 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:02:44.756719 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:02:44.756719 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:02:44.756719 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:02:44.756719 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:02:44.756719 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:02:44.756719 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:02:44.756719 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:02:44.756719 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:02:44.756719 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:02:44.756719 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:02:44.756719 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:02:44.756719 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:02:44.756719 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:02:44.756719 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:02:44.756719 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:02:44.756719 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:02:44.757916 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:02:44.757916 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:02:44.757916 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:02:44.757916 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:02:44.757916 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:02:44.757916 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:02:44.757916 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:02:44.757916 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:02:44.757916 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:02:44.757916 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:02:44.757916 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 05 12:02:44.757916 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:02:44.757916 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 35/68] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Sep 5 12:02:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 12:02:44.758836 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c32f09-9dfd-4ac1-8ca3-0f91a5af974c None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:44.758836 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c32f09-9dfd-4ac1-8ca3-0f91a5af974c None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:44.758836 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c32f09-9dfd-4ac1-8ca3-0f91a5af974c None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:44.760105 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 36/69] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:02:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:02:44.765816 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c32f09-9dfd-4ac1-8ca3-0f91a5af974c None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:02:44.785011 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:02:44.807414 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9efb3d-6b31-4411-a54f-21471bb9682f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:02:44.808344 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9efb3d-6b31-4411-a54f-21471bb9682f None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:44.808732 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9efb3d-6b31-4411-a54f-21471bb9682f None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:44.809180 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9efb3d-6b31-4411-a54f-21471bb9682f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:44.823668 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9efb3d-6b31-4411-a54f-21471bb9682f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:02:44.830611 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application [None req-fb9efb3d-6b31-4411-a54f-21471bb9682f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 12:02:44.830611 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:02:44.830611 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:02:44.830611 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:02:44.830611 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:02:44.830611 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:02:44.830611 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:02:44.830611 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:02:44.830611 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:02:44.830611 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:02:44.830611 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:02:44.830611 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:02:44.830611 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:02:44.830611 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:02:44.830611 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:02:44.830611 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:02:44.831582 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:02:44.831582 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:02:44.831582 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:02:44.831582 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:02:44.831582 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:02:44.831582 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:02:44.831582 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:02:44.831582 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:02:44.831582 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:02:44.831582 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:02:44.831582 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:02:44.831582 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application with Lock( Sep 05 12:02:44.831582 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:02:44.831582 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:02:44.831582 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:02:44.831582 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:02:44.832340 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:02:44.832340 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:02:44.832340 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:02:44.832340 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:02:44.832340 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:02:44.832340 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:02:44.832340 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:02:44.832340 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:02:44.832340 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:02:44.832340 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:02:44.832340 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 12:02:44.832340 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:02:44.832966 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 34/70] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Sep 5 12:02:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:02:44.834571 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc26fe44-d997-4b83-87ca-16496d55631a None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:44.834863 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc26fe44-d997-4b83-87ca-16496d55631a None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:44.835147 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc26fe44-d997-4b83-87ca-16496d55631a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:44.858070 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-cc26fe44-d997-4b83-87ca-16496d55631a None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:02:44.859281 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-cc26fe44-d997-4b83-87ca-16496d55631a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:02:44.888768 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c32f09-9dfd-4ac1-8ca3-0f91a5af974c None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:02:44.902341 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:02:44.929754 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 35/71] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:02:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:02:44.930848 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc26fe44-d997-4b83-87ca-16496d55631a None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:02:44.931260 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9111f0-6f2d-4337-bb23-33a5b8372f78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:02:44.932130 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9111f0-6f2d-4337-bb23-33a5b8372f78 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:44.932610 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9111f0-6f2d-4337-bb23-33a5b8372f78 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:44.933117 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9111f0-6f2d-4337-bb23-33a5b8372f78 None admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:44.933974 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9111f0-6f2d-4337-bb23-33a5b8372f78 None admin] RBAC: Adding query filter params (name=member) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:02:44.934323 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9111f0-6f2d-4337-bb23-33a5b8372f78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:02:44.935734 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9111f0-6f2d-4337-bb23-33a5b8372f78 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:02:44.945004 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 37/72] 10.222.0.50 () {56 vars in 1101 bytes} [Mon Sep 5 12:02:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:02:44.946024 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9111f0-6f2d-4337-bb23-33a5b8372f78 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:02:45.052027 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc26fe44-d997-4b83-87ca-16496d55631a None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:02:45.068180 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:02:45.068759 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9111f0-6f2d-4337-bb23-33a5b8372f78 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:02:45.094845 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37082e00-51eb-4bc2-be27-ad3ad52f02a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:02:45.095686 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37082e00-51eb-4bc2-be27-ad3ad52f02a4 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:45.096612 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37082e00-51eb-4bc2-be27-ad3ad52f02a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:45.097066 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37082e00-51eb-4bc2-be27-ad3ad52f02a4 None admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:45.098181 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37082e00-51eb-4bc2-be27-ad3ad52f02a4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:02:45.098629 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37082e00-51eb-4bc2-be27-ad3ad52f02a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:02:45.101034 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37082e00-51eb-4bc2-be27-ad3ad52f02a4 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:02:45.111886 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e66be65-337b-4f02-a568-731ef7cecd37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:02:45.112470 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 36/73] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Sep 5 12:02:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:02:45.112573 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e66be65-337b-4f02-a568-731ef7cecd37 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:45.112836 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e66be65-337b-4f02-a568-731ef7cecd37 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:45.113145 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e66be65-337b-4f02-a568-731ef7cecd37 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:45.117613 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37082e00-51eb-4bc2-be27-ad3ad52f02a4 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:02:45.128697 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e66be65-337b-4f02-a568-731ef7cecd37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:02:45.134600 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-4e66be65-337b-4f02-a568-731ef7cecd37 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 05 12:02:45.134600 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:02:45.134600 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:02:45.134600 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:02:45.134600 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:02:45.134600 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:02:45.134600 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:02:45.134600 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:02:45.134600 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:02:45.134600 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:02:45.134600 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:02:45.134600 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:02:45.134600 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:02:45.134600 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:02:45.134600 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:02:45.134600 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:02:45.135469 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:02:45.135469 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:02:45.135469 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:02:45.135469 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:02:45.135469 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:02:45.135469 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:02:45.135469 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:02:45.135469 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:02:45.135469 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:02:45.135469 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:02:45.135469 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:02:45.135469 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:02:45.135469 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:02:45.135469 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:02:45.135469 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:02:45.135469 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:02:45.136244 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:02:45.136244 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:02:45.136244 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:02:45.136244 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:02:45.136244 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:02:45.136244 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:02:45.136244 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:02:45.136244 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:02:45.136244 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:02:45.136244 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:02:45.136244 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 05 12:02:45.136244 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:02:45.138845 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 38/74] 10.222.0.50 () {56 vars in 1114 bytes} [Mon Sep 5 12:02:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:02:45.140261 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c4a300-eef0-4c2f-a8ed-e173afd816f1 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:45.140795 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c4a300-eef0-4c2f-a8ed-e173afd816f1 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:45.141098 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c4a300-eef0-4c2f-a8ed-e173afd816f1 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:45.142479 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 39/75] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:02:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:02:45.143051 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c4a300-eef0-4c2f-a8ed-e173afd816f1 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:02:45.186840 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:02:45.250784 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37082e00-51eb-4bc2-be27-ad3ad52f02a4 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:02:45.268966 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c4a300-eef0-4c2f-a8ed-e173afd816f1 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:02:45.288515 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c81e39-9354-4b0b-add8-c1283245fd49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:02:45.289194 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c81e39-9354-4b0b-add8-c1283245fd49 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:45.289482 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c81e39-9354-4b0b-add8-c1283245fd49 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:45.289743 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c81e39-9354-4b0b-add8-c1283245fd49 None admin] PATH_INFO: `/v3/users/5f0c885f940345c6b98a71ea1ff0ff13` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:45.305286 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c81e39-9354-4b0b-add8-c1283245fd49 None admin] RBAC: Authorizing `identity:get_user(user_id=5f0c885f940345c6b98a71ea1ff0ff13)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:02:45.306753 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c81e39-9354-4b0b-add8-c1283245fd49 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:02:45.306989 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7254c0fc-4906-40cc-a6f1-8cafd6c1e88a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:02:45.307627 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7254c0fc-4906-40cc-a6f1-8cafd6c1e88a None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:45.307911 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7254c0fc-4906-40cc-a6f1-8cafd6c1e88a None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:45.308187 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7254c0fc-4906-40cc-a6f1-8cafd6c1e88a None admin] PATH_INFO: `/v3/users/5ec42edb9cd44e278afe2e10f9b7de4c` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:45.308400 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 37/76] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Sep 5 12:02:45 2022] GET /identity/v3/users/5f0c885f940345c6b98a71ea1ff0ff13 => generated 275 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:02:45.309707 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c81e39-9354-4b0b-add8-c1283245fd49 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:02:45.310635 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7254c0fc-4906-40cc-a6f1-8cafd6c1e88a None admin] RBAC: Authorizing `identity:get_user(user_id=5ec42edb9cd44e278afe2e10f9b7de4c)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:02:45.312102 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7254c0fc-4906-40cc-a6f1-8cafd6c1e88a None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:02:45.314286 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 40/77] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Sep 5 12:02:45 2022] GET /identity/v3/users/5ec42edb9cd44e278afe2e10f9b7de4c => generated 247 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:02:45.315446 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f834254-8932-471f-a26e-f9bbd092da8c None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:45.315735 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f834254-8932-471f-a26e-f9bbd092da8c None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:45.316014 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f834254-8932-471f-a26e-f9bbd092da8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:45.334540 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-1f834254-8932-471f-a26e-f9bbd092da8c None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:02:45.335814 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-1f834254-8932-471f-a26e-f9bbd092da8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:02:45.340385 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:02:45.412464 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 41/78] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:02:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:02:45.413545 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f834254-8932-471f-a26e-f9bbd092da8c None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:02:45.428509 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c81e39-9354-4b0b-add8-c1283245fd49 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:02:45.448842 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:02:45.466876 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f76b8e-35e8-40e4-84a8-d80c16b7d451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:02:45.467693 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f76b8e-35e8-40e4-84a8-d80c16b7d451 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:45.467973 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f76b8e-35e8-40e4-84a8-d80c16b7d451 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:45.468243 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f76b8e-35e8-40e4-84a8-d80c16b7d451 None admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:45.469094 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f76b8e-35e8-40e4-84a8-d80c16b7d451 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:02:45.469315 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f76b8e-35e8-40e4-84a8-d80c16b7d451 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:02:45.470835 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f76b8e-35e8-40e4-84a8-d80c16b7d451 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:02:45.478610 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 38/79] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Sep 5 12:02:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:02:45.479394 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f76b8e-35e8-40e4-84a8-d80c16b7d451 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:02:45.530031 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f834254-8932-471f-a26e-f9bbd092da8c None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:02:45.565952 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59d5806-be36-4464-ba7a-2e4358858d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:02:45.566794 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59d5806-be36-4464-ba7a-2e4358858d53 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:45.567221 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59d5806-be36-4464-ba7a-2e4358858d53 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:45.567664 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59d5806-be36-4464-ba7a-2e4358858d53 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:45.577701 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:02:45.578781 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59d5806-be36-4464-ba7a-2e4358858d53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:02:45.584922 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-e59d5806-be36-4464-ba7a-2e4358858d53 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 05 12:02:45.584922 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:02:45.584922 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:02:45.584922 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:02:45.584922 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:02:45.584922 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:02:45.584922 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:02:45.584922 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:02:45.584922 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:02:45.584922 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:02:45.584922 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:02:45.584922 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:02:45.584922 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:02:45.584922 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:02:45.584922 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:02:45.584922 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:02:45.585798 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:02:45.585798 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:02:45.585798 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:02:45.585798 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:02:45.585798 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:02:45.585798 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:02:45.585798 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:02:45.585798 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:02:45.585798 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:02:45.585798 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:02:45.585798 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:02:45.585798 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:02:45.585798 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:02:45.585798 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:02:45.585798 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:02:45.585798 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:02:45.589579 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:02:45.589579 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:02:45.589579 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:02:45.589579 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:02:45.589579 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:02:45.589579 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:02:45.589579 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:02:45.589579 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:02:45.589579 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:02:45.589579 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:02:45.589579 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 05 12:02:45.589579 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:02:45.589579 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 42/80] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Sep 5 12:02:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:02:45.589579 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59d5806-be36-4464-ba7a-2e4358858d53 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:02:45.594006 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f76b8e-35e8-40e4-84a8-d80c16b7d451 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:02:45.633170 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b85cd0e-0f05-4965-b9cf-8052edee5529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:02:45.633783 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b85cd0e-0f05-4965-b9cf-8052edee5529 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:45.634064 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b85cd0e-0f05-4965-b9cf-8052edee5529 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:45.634346 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b85cd0e-0f05-4965-b9cf-8052edee5529 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:45.701136 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:02:45.711779 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59d5806-be36-4464-ba7a-2e4358858d53 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:02:45.717661 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b85cd0e-0f05-4965-b9cf-8052edee5529 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:02:45.719150 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b85cd0e-0f05-4965-b9cf-8052edee5529 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:02:45.745232 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11c9597-7fa7-4f96-b20d-9bd389518e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:02:45.745841 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11c9597-7fa7-4f96-b20d-9bd389518e1e None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:45.746124 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11c9597-7fa7-4f96-b20d-9bd389518e1e None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:45.746400 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11c9597-7fa7-4f96-b20d-9bd389518e1e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:45.809842 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:02:45.815706 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11c9597-7fa7-4f96-b20d-9bd389518e1e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:02:45.817398 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11c9597-7fa7-4f96-b20d-9bd389518e1e None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:02:45.824402 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 39/81] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Sep 5 12:02:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 12:02:45.824402 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b85cd0e-0f05-4965-b9cf-8052edee5529 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:02:45.906483 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:02:45.916997 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 43/82] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Sep 5 12:02:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 12:02:45.917954 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11c9597-7fa7-4f96-b20d-9bd389518e1e None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:02:45.919439 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b85cd0e-0f05-4965-b9cf-8052edee5529 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:02:45.954622 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba200c5a-4fb9-4e2e-bb59-915c2a6de511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:02:45.955180 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba200c5a-4fb9-4e2e-bb59-915c2a6de511 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:45.955462 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba200c5a-4fb9-4e2e-bb59-915c2a6de511 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:45.955738 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba200c5a-4fb9-4e2e-bb59-915c2a6de511 None admin] PATH_INFO: `/v3/users/5f0c885f940345c6b98a71ea1ff0ff13` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:45.957198 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba200c5a-4fb9-4e2e-bb59-915c2a6de511 None admin] RBAC: Authorizing `identity:get_user(user_id=5f0c885f940345c6b98a71ea1ff0ff13)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:02:45.958630 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba200c5a-4fb9-4e2e-bb59-915c2a6de511 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:02:45.960198 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 40/83] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Sep 5 12:02:45 2022] GET /identity/v3/users/5f0c885f940345c6b98a71ea1ff0ff13 => generated 275 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:02:45.960977 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba200c5a-4fb9-4e2e-bb59-915c2a6de511 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:02:46.016398 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11c9597-7fa7-4f96-b20d-9bd389518e1e None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:02:46.021771 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:02:46.052049 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4041ec-d727-423b-a1a2-0faa641c9f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:02:46.052813 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4041ec-d727-423b-a1a2-0faa641c9f70 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:46.053129 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4041ec-d727-423b-a1a2-0faa641c9f70 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:46.053410 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4041ec-d727-423b-a1a2-0faa641c9f70 None admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:46.054080 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4041ec-d727-423b-a1a2-0faa641c9f70 None admin] RBAC: Adding query filter params (name=member) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:02:46.054390 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4041ec-d727-423b-a1a2-0faa641c9f70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:02:46.055794 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4041ec-d727-423b-a1a2-0faa641c9f70 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:02:46.063010 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba200c5a-4fb9-4e2e-bb59-915c2a6de511 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:02:46.063917 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 44/84] 10.222.0.50 () {56 vars in 1101 bytes} [Mon Sep 5 12:02:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:02:46.064551 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4041ec-d727-423b-a1a2-0faa641c9f70 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:02:46.097463 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da85c32-6ee7-40ba-8ed2-82fa1e8cf627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:02:46.098093 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da85c32-6ee7-40ba-8ed2-82fa1e8cf627 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:46.098377 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da85c32-6ee7-40ba-8ed2-82fa1e8cf627 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:46.098655 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da85c32-6ee7-40ba-8ed2-82fa1e8cf627 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:46.099787 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da85c32-6ee7-40ba-8ed2-82fa1e8cf627 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:02:46.101253 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da85c32-6ee7-40ba-8ed2-82fa1e8cf627 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:02:46.102820 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 41/85] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 5 12:02:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:02:46.103866 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da85c32-6ee7-40ba-8ed2-82fa1e8cf627 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:02:46.118889 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:02:46.166650 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4041ec-d727-423b-a1a2-0faa641c9f70 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:02:46.200454 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d2fbc5-1455-4d2e-a659-71b9b3875e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:02:46.201118 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d2fbc5-1455-4d2e-a659-71b9b3875e40 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:46.201407 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d2fbc5-1455-4d2e-a659-71b9b3875e40 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:46.201685 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d2fbc5-1455-4d2e-a659-71b9b3875e40 None admin] PATH_INFO: `/v3/projects/2370f3588c6e4c5798f29493d9842333` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:46.202810 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d2fbc5-1455-4d2e-a659-71b9b3875e40 None admin] RBAC: Authorizing `identity:get_project(project_id=2370f3588c6e4c5798f29493d9842333)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:02:46.203400 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da85c32-6ee7-40ba-8ed2-82fa1e8cf627 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:02:46.204879 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d2fbc5-1455-4d2e-a659-71b9b3875e40 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:02:46.206494 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 45/86] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Sep 5 12:02:46 2022] GET /identity/v3/projects/2370f3588c6e4c5798f29493d9842333 => generated 298 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:02:46.207265 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d2fbc5-1455-4d2e-a659-71b9b3875e40 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:02:46.229384 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:02:46.238676 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d67a89a-d9ca-4ed4-86b2-5a1eb857998e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:02:46.239312 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d67a89a-d9ca-4ed4-86b2-5a1eb857998e None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:46.239593 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d67a89a-d9ca-4ed4-86b2-5a1eb857998e None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:46.239871 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d67a89a-d9ca-4ed4-86b2-5a1eb857998e None admin] PATH_INFO: `/v3/projects/2370f3588c6e4c5798f29493d9842333` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:46.241038 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d67a89a-d9ca-4ed4-86b2-5a1eb857998e None admin] RBAC: Authorizing `identity:get_project(project_id=2370f3588c6e4c5798f29493d9842333)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:02:46.242497 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d67a89a-d9ca-4ed4-86b2-5a1eb857998e None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:02:46.244125 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 42/87] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Sep 5 12:02:46 2022] GET /identity/v3/projects/2370f3588c6e4c5798f29493d9842333 => generated 298 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:02:46.244914 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d67a89a-d9ca-4ed4-86b2-5a1eb857998e None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:02:46.312741 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d2fbc5-1455-4d2e-a659-71b9b3875e40 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:02:46.332410 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:02:46.343809 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d67a89a-d9ca-4ed4-86b2-5a1eb857998e None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:02:46.347195 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14dbbf3-326e-4823-807f-fcf408224210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:02:46.347804 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14dbbf3-326e-4823-807f-fcf408224210 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:46.348085 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14dbbf3-326e-4823-807f-fcf408224210 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:46.348359 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14dbbf3-326e-4823-807f-fcf408224210 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:46.377486 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8dd296-1f52-4188-a2dc-db338453b203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:02:46.378110 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8dd296-1f52-4188-a2dc-db338453b203 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:46.378395 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8dd296-1f52-4188-a2dc-db338453b203 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:46.378673 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8dd296-1f52-4188-a2dc-db338453b203 None admin] PATH_INFO: `/v3/users/5f0c885f940345c6b98a71ea1ff0ff13` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:46.379807 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8dd296-1f52-4188-a2dc-db338453b203 None admin] RBAC: Authorizing `identity:get_user(user_id=5f0c885f940345c6b98a71ea1ff0ff13)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:02:46.381291 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8dd296-1f52-4188-a2dc-db338453b203 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:02:46.383030 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 43/88] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Sep 5 12:02:46 2022] GET /identity/v3/users/5f0c885f940345c6b98a71ea1ff0ff13 => generated 275 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:02:46.383607 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8dd296-1f52-4188-a2dc-db338453b203 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:02:46.418343 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14dbbf3-326e-4823-807f-fcf408224210 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:02:46.419955 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14dbbf3-326e-4823-807f-fcf408224210 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:02:46.444489 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:02:46.482989 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8dd296-1f52-4188-a2dc-db338453b203 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:02:46.518034 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d819bc1-2433-47d8-89a9-d2151ca12977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:02:46.518650 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d819bc1-2433-47d8-89a9-d2151ca12977 None admin] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:46.518945 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d819bc1-2433-47d8-89a9-d2151ca12977 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:46.519221 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d819bc1-2433-47d8-89a9-d2151ca12977 None admin] PATH_INFO: `/v3/users` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:46.519854 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 46/89] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Sep 5 12:02:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 12:02:46.519968 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d819bc1-2433-47d8-89a9-d2151ca12977 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:02:46.520701 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14dbbf3-326e-4823-807f-fcf408224210 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:02:46.521443 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d819bc1-2433-47d8-89a9-d2151ca12977 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:02:46.544119 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:02:46.551122 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 44/90] 10.222.0.50 () {60 vars in 1132 bytes} [Mon Sep 5 12:02:46 2022] POST /identity/v3/users => generated 289 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:02:46.551940 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d819bc1-2433-47d8-89a9-d2151ca12977 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:02:46.638013 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14dbbf3-326e-4823-807f-fcf408224210 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:02:46.674801 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6325c0ce-2172-45bc-93ec-583b72627552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:02:46.675423 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6325c0ce-2172-45bc-93ec-583b72627552 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:46.675706 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6325c0ce-2172-45bc-93ec-583b72627552 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:46.675981 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6325c0ce-2172-45bc-93ec-583b72627552 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:46.676723 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6325c0ce-2172-45bc-93ec-583b72627552 None admin] RBAC: Adding query filter params (role.id=ed72181e1403401facb77dcf33644757, scope.project.id=2370f3588c6e4c5798f29493d9842333, user.id=5f0c885f940345c6b98a71ea1ff0ff13) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:02:46.677064 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6325c0ce-2172-45bc-93ec-583b72627552 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:02:46.678563 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6325c0ce-2172-45bc-93ec-583b72627552 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:02:46.681309 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d819bc1-2433-47d8-89a9-d2151ca12977 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:02:46.685846 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 47/91] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Sep 5 12:02:46 2022] GET /identity/v3/role_assignments?user.id=5f0c885f940345c6b98a71ea1ff0ff13&scope.project.id=2370f3588c6e4c5798f29493d9842333&role.id=ed72181e1403401facb77dcf33644757 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:02:46.686278 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6325c0ce-2172-45bc-93ec-583b72627552 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:02:46.704063 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:02:46.730028 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9ebc0a-5cf1-4dc6-8e61-05ec7d4ccc2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:02:46.730652 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9ebc0a-5cf1-4dc6-8e61-05ec7d4ccc2e None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:46.730934 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9ebc0a-5cf1-4dc6-8e61-05ec7d4ccc2e None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:46.731243 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9ebc0a-5cf1-4dc6-8e61-05ec7d4ccc2e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:46.731984 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9ebc0a-5cf1-4dc6-8e61-05ec7d4ccc2e None admin] RBAC: Adding query filter params (role.id=16e2ccc8bd1b497d8cee780c1c7df0d2, scope.project.id=2370f3588c6e4c5798f29493d9842333, user.id=5ec42edb9cd44e278afe2e10f9b7de4c) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:02:46.732291 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9ebc0a-5cf1-4dc6-8e61-05ec7d4ccc2e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:02:46.733886 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9ebc0a-5cf1-4dc6-8e61-05ec7d4ccc2e None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:02:46.742048 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 45/92] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Sep 5 12:02:46 2022] GET /identity/v3/role_assignments?user.id=5ec42edb9cd44e278afe2e10f9b7de4c&scope.project.id=2370f3588c6e4c5798f29493d9842333&role.id=16e2ccc8bd1b497d8cee780c1c7df0d2 => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:02:46.750347 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9ebc0a-5cf1-4dc6-8e61-05ec7d4ccc2e None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:02:46.809860 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:02:46.839570 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6325c0ce-2172-45bc-93ec-583b72627552 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:02:46.882932 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2664d812-2a48-4d97-9da9-03cfc6a391b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:02:46.883973 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2664d812-2a48-4d97-9da9-03cfc6a391b6 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:46.884454 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2664d812-2a48-4d97-9da9-03cfc6a391b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:46.884953 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2664d812-2a48-4d97-9da9-03cfc6a391b6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:46.907882 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9ebc0a-5cf1-4dc6-8e61-05ec7d4ccc2e None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:02:46.951867 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51961fcb-74fc-4ed1-aa58-a6a740a19aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:02:46.952948 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51961fcb-74fc-4ed1-aa58-a6a740a19aac None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:46.953415 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51961fcb-74fc-4ed1-aa58-a6a740a19aac None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:46.953933 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51961fcb-74fc-4ed1-aa58-a6a740a19aac None admin] PATH_INFO: `/v3/projects/2370f3588c6e4c5798f29493d9842333` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:46.955276 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51961fcb-74fc-4ed1-aa58-a6a740a19aac None admin] RBAC: Authorizing `identity:get_project(project_id=2370f3588c6e4c5798f29493d9842333)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:02:46.957093 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51961fcb-74fc-4ed1-aa58-a6a740a19aac None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:02:46.959239 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 46/93] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Sep 5 12:02:46 2022] GET /identity/v3/projects/2370f3588c6e4c5798f29493d9842333 => generated 298 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:02:46.964587 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51961fcb-74fc-4ed1-aa58-a6a740a19aac None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:02:46.975337 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2664d812-2a48-4d97-9da9-03cfc6a391b6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:02:46.977378 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2664d812-2a48-4d97-9da9-03cfc6a391b6 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:02:47.032281 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:02:47.092347 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:02:47.096181 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51961fcb-74fc-4ed1-aa58-a6a740a19aac None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:02:47.117788 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 48/94] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Sep 5 12:02:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 12:02:47.125918 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2664d812-2a48-4d97-9da9-03cfc6a391b6 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:02:47.146197 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af971c39-6a48-40f2-b544-75d0329aa5c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:02:47.146868 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af971c39-6a48-40f2-b544-75d0329aa5c6 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:47.147092 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af971c39-6a48-40f2-b544-75d0329aa5c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:47.147364 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af971c39-6a48-40f2-b544-75d0329aa5c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:47.148102 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af971c39-6a48-40f2-b544-75d0329aa5c6 None admin] RBAC: Adding query filter params (role.id=bf853a508574493f9bc7d85f3c3b36fd, scope.project.id=2370f3588c6e4c5798f29493d9842333, user.id=5f0c885f940345c6b98a71ea1ff0ff13) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:02:47.148419 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af971c39-6a48-40f2-b544-75d0329aa5c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:02:47.150160 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af971c39-6a48-40f2-b544-75d0329aa5c6 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:02:47.162911 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 47/95] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Sep 5 12:02:46 2022] GET /identity/v3/role_assignments?user.id=5f0c885f940345c6b98a71ea1ff0ff13&scope.project.id=2370f3588c6e4c5798f29493d9842333&role.id=bf853a508574493f9bc7d85f3c3b36fd => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:02:47.280700 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2664d812-2a48-4d97-9da9-03cfc6a391b6 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:02:47.336141 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b435ef23-0f51-41e1-a81b-f45e1ef5b87f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:02:47.336711 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b435ef23-0f51-41e1-a81b-f45e1ef5b87f None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:47.337018 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b435ef23-0f51-41e1-a81b-f45e1ef5b87f None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:47.337301 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b435ef23-0f51-41e1-a81b-f45e1ef5b87f None admin] PATH_INFO: `/v3/projects/a42b9aa568b143b3a7550b45df2a4858` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:47.341705 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b435ef23-0f51-41e1-a81b-f45e1ef5b87f None admin] RBAC: Authorizing `identity:get_project(project_id=a42b9aa568b143b3a7550b45df2a4858)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:02:47.343213 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b435ef23-0f51-41e1-a81b-f45e1ef5b87f None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:02:47.345175 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 49/96] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Sep 5 12:02:47 2022] GET /identity/v3/projects/a42b9aa568b143b3a7550b45df2a4858 => generated 312 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:02:47.351134 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af971c39-6a48-40f2-b544-75d0329aa5c6 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:02:47.470678 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af971c39-6a48-40f2-b544-75d0329aa5c6 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:02:47.485682 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:02:47.507059 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05931ca4-041d-4117-b902-86b685a8e53c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:02:47.507672 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05931ca4-041d-4117-b902-86b685a8e53c None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:47.507954 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05931ca4-041d-4117-b902-86b685a8e53c None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:47.508228 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05931ca4-041d-4117-b902-86b685a8e53c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:47.509029 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05931ca4-041d-4117-b902-86b685a8e53c None admin] RBAC: Adding query filter params (role.id=ed72181e1403401facb77dcf33644757, scope.project.id=a42b9aa568b143b3a7550b45df2a4858, user.id=5f0c885f940345c6b98a71ea1ff0ff13) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:02:47.509342 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05931ca4-041d-4117-b902-86b685a8e53c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:02:47.510855 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05931ca4-041d-4117-b902-86b685a8e53c None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:02:47.516634 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 48/97] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Sep 5 12:02:47 2022] GET /identity/v3/role_assignments?user.id=5f0c885f940345c6b98a71ea1ff0ff13&scope.project.id=a42b9aa568b143b3a7550b45df2a4858&role.id=ed72181e1403401facb77dcf33644757 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:02:49.372793 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5476207f-9a74-4908-8d69-23afcce3faa1 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:49.373331 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5476207f-9a74-4908-8d69-23afcce3faa1 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:49.373438 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5476207f-9a74-4908-8d69-23afcce3faa1 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:49.374721 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 50/98] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:02:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:02:49.380126 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaf3423-338f-40e4-8e9a-567fd0e4e49e None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:49.380532 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaf3423-338f-40e4-8e9a-567fd0e4e49e None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:49.380713 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaf3423-338f-40e4-8e9a-567fd0e4e49e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:49.401988 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-cdaf3423-338f-40e4-8e9a-567fd0e4e49e None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:02:49.403237 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-cdaf3423-338f-40e4-8e9a-567fd0e4e49e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:02:49.489289 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 49/99] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:02:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 05 12:02:49.564320 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4d9f67-ac5e-439d-ae2e-2b7df005fcba None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:49.564617 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4d9f67-ac5e-439d-ae2e-2b7df005fcba None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:49.564881 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4d9f67-ac5e-439d-ae2e-2b7df005fcba None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:49.566393 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 51/100] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:02:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:02:49.571746 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f828fac1-42ff-48b0-be06-3a0028abb4a8 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:49.572041 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f828fac1-42ff-48b0-be06-3a0028abb4a8 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:49.572322 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f828fac1-42ff-48b0-be06-3a0028abb4a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:49.592047 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-f828fac1-42ff-48b0-be06-3a0028abb4a8 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:02:49.593281 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-f828fac1-42ff-48b0-be06-3a0028abb4a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:02:49.683343 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 50/101] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:02:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:02:50.016123 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf57e079-ec47-429d-bb74-8ce16f40d9b5 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:50.016454 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf57e079-ec47-429d-bb74-8ce16f40d9b5 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:50.016646 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf57e079-ec47-429d-bb74-8ce16f40d9b5 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:50.018254 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 52/102] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:02:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:02:50.023904 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99d2e4b-8e67-45b0-a036-cd840a2df343 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:50.024259 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99d2e4b-8e67-45b0-a036-cd840a2df343 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:50.024598 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99d2e4b-8e67-45b0-a036-cd840a2df343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:50.047372 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-d99d2e4b-8e67-45b0-a036-cd840a2df343 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:02:50.048444 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc9009e-c963-47dd-b84c-6479ae681c02 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:50.048625 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-d99d2e4b-8e67-45b0-a036-cd840a2df343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:02:50.048719 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc9009e-c963-47dd-b84c-6479ae681c02 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:50.049037 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc9009e-c963-47dd-b84c-6479ae681c02 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:50.050390 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 53/103] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:02:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:02:50.057985 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04377e5a-8dec-46ad-9456-28fb2112b780 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:50.058273 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04377e5a-8dec-46ad-9456-28fb2112b780 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:50.058553 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04377e5a-8dec-46ad-9456-28fb2112b780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:50.088147 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-04377e5a-8dec-46ad-9456-28fb2112b780 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:02:50.089463 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-04377e5a-8dec-46ad-9456-28fb2112b780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:02:50.091304 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:02:50.132839 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 51/104] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:02:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:02:50.134144 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99d2e4b-8e67-45b0-a036-cd840a2df343 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:02:50.184342 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:02:50.208294 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 54/105] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:02:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 05 12:02:50.209497 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79e2817-67ac-4555-ba37-3bd73b458357 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:50.209782 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79e2817-67ac-4555-ba37-3bd73b458357 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:50.210056 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79e2817-67ac-4555-ba37-3bd73b458357 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:50.211458 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 55/106] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:02:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:02:50.212758 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79e2817-67ac-4555-ba37-3bd73b458357 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:02:50.249505 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99d2e4b-8e67-45b0-a036-cd840a2df343 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:02:50.292706 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cbe215-801f-4975-897c-421618492412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:02:50.293331 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cbe215-801f-4975-897c-421618492412 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:50.293708 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cbe215-801f-4975-897c-421618492412 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:50.293992 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cbe215-801f-4975-897c-421618492412 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:50.306573 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cbe215-801f-4975-897c-421618492412 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:02:50.312849 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application [None req-43cbe215-801f-4975-897c-421618492412 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 05 12:02:50.312849 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:02:50.312849 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:02:50.312849 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:02:50.312849 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:02:50.312849 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:02:50.312849 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:02:50.312849 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:02:50.312849 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:02:50.312849 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:02:50.312849 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:02:50.312849 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:02:50.312849 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:02:50.312849 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:02:50.312849 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:02:50.312849 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:02:50.313712 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:02:50.313712 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:02:50.313712 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:02:50.313712 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:02:50.313712 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:02:50.313712 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:02:50.313712 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:02:50.313712 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:02:50.313712 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:02:50.313712 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:02:50.313712 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:02:50.313712 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application with Lock( Sep 05 12:02:50.313712 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:02:50.313712 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:02:50.313712 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:02:50.313712 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:02:50.314480 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:02:50.314480 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:02:50.314480 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:02:50.314480 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:02:50.314480 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:02:50.314480 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:02:50.314480 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:02:50.314480 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:02:50.314480 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:02:50.314480 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:02:50.314480 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 05 12:02:50.314480 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:02:50.314480 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 52/107] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Sep 5 12:02:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:02:50.321608 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4407f5c6-ae43-41a1-8225-a0340f8916f7 None None] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:50.321900 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4407f5c6-ae43-41a1-8225-a0340f8916f7 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:50.322173 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4407f5c6-ae43-41a1-8225-a0340f8916f7 None None] PATH_INFO: `/` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:50.324537 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 53/108] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:02:50 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:02:50.326852 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9cdc01-df92-4120-a803-44f59c03dddf None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:50.327145 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9cdc01-df92-4120-a803-44f59c03dddf None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:50.327422 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9cdc01-df92-4120-a803-44f59c03dddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:50.330764 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79e2817-67ac-4555-ba37-3bd73b458357 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:02:50.350932 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-3e9cdc01-df92-4120-a803-44f59c03dddf None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:02:50.352182 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-3e9cdc01-df92-4120-a803-44f59c03dddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:02:50.367072 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dfe027-bfaa-4047-abc9-0f20d22f7055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:02:50.367820 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dfe027-bfaa-4047-abc9-0f20d22f7055 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:50.368183 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dfe027-bfaa-4047-abc9-0f20d22f7055 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:50.368553 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dfe027-bfaa-4047-abc9-0f20d22f7055 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:50.379853 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dfe027-bfaa-4047-abc9-0f20d22f7055 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:02:50.381957 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:02:50.385058 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-48dfe027-bfaa-4047-abc9-0f20d22f7055 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 05 12:02:50.385058 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:02:50.385058 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:02:50.385058 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:02:50.385058 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:02:50.385058 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:02:50.385058 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:02:50.385058 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:02:50.385058 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:02:50.385058 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:02:50.385058 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:02:50.385058 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:02:50.385058 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:02:50.385058 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:02:50.385058 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:02:50.385058 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:02:50.386107 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:02:50.386107 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:02:50.386107 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:02:50.386107 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:02:50.386107 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:02:50.386107 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:02:50.386107 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:02:50.386107 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:02:50.386107 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:02:50.386107 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:02:50.386107 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:02:50.386107 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:02:50.386107 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:02:50.386107 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:02:50.386107 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:02:50.386107 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:02:50.387060 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:02:50.387060 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:02:50.387060 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:02:50.387060 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:02:50.387060 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:02:50.387060 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:02:50.387060 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:02:50.387060 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:02:50.387060 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:02:50.387060 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:02:50.387060 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 05 12:02:50.387060 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:02:50.392933 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 56/109] 10.222.0.50 () {56 vars in 1114 bytes} [Mon Sep 5 12:02:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:02:50.392933 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dfe027-bfaa-4047-abc9-0f20d22f7055 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:02:50.441340 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:02:50.447254 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 54/110] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:02:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:02:50.448416 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb5fc7c-015f-416d-b228-d4eb27bdf04d None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:50.448759 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb5fc7c-015f-416d-b228-d4eb27bdf04d None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:50.449067 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb5fc7c-015f-416d-b228-d4eb27bdf04d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:50.467501 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-4eb5fc7c-015f-416d-b228-d4eb27bdf04d None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:02:50.468668 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-4eb5fc7c-015f-416d-b228-d4eb27bdf04d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:02:50.509069 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dfe027-bfaa-4047-abc9-0f20d22f7055 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:02:50.545246 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 55/111] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:02:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:02:50.545971 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb5fc7c-015f-416d-b228-d4eb27bdf04d None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:02:50.553999 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2a06ae-48fe-4ae5-b840-eb8b143da22e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:02:50.554445 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2a06ae-48fe-4ae5-b840-eb8b143da22e None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:50.554786 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2a06ae-48fe-4ae5-b840-eb8b143da22e None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:50.555071 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2a06ae-48fe-4ae5-b840-eb8b143da22e None admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:50.555746 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2a06ae-48fe-4ae5-b840-eb8b143da22e None admin] RBAC: Adding query filter params (name=member) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:02:50.556053 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2a06ae-48fe-4ae5-b840-eb8b143da22e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:02:50.557698 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2a06ae-48fe-4ae5-b840-eb8b143da22e None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:02:50.572471 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 57/112] 10.222.0.50 () {56 vars in 1101 bytes} [Mon Sep 5 12:02:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:02:50.573512 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2a06ae-48fe-4ae5-b840-eb8b143da22e None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:02:50.658566 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:02:50.674873 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb5fc7c-015f-416d-b228-d4eb27bdf04d None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:02:50.691518 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2a06ae-48fe-4ae5-b840-eb8b143da22e None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:02:50.695090 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:02:50.726773 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f6efc0-93f8-4b8a-bd40-323e18dbf211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:02:50.727786 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f6efc0-93f8-4b8a-bd40-323e18dbf211 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:50.728212 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f6efc0-93f8-4b8a-bd40-323e18dbf211 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:50.728825 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f6efc0-93f8-4b8a-bd40-323e18dbf211 None admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:50.729840 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f6efc0-93f8-4b8a-bd40-323e18dbf211 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:02:50.730214 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f6efc0-93f8-4b8a-bd40-323e18dbf211 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:02:50.732289 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f6efc0-93f8-4b8a-bd40-323e18dbf211 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:02:50.734705 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae6e846-d3d1-4ed9-9430-4ecbd5896b83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:02:50.735566 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae6e846-d3d1-4ed9-9430-4ecbd5896b83 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:50.736041 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae6e846-d3d1-4ed9-9430-4ecbd5896b83 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:50.736527 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae6e846-d3d1-4ed9-9430-4ecbd5896b83 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:50.741429 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 56/113] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Sep 5 12:02:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:02:50.742491 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f6efc0-93f8-4b8a-bd40-323e18dbf211 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:02:50.748691 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae6e846-d3d1-4ed9-9430-4ecbd5896b83 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:02:50.754612 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-dae6e846-d3d1-4ed9-9430-4ecbd5896b83 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 12:02:50.754612 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:02:50.754612 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:02:50.754612 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:02:50.754612 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:02:50.754612 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:02:50.754612 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:02:50.754612 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:02:50.754612 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:02:50.754612 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:02:50.754612 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:02:50.754612 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:02:50.754612 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:02:50.754612 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:02:50.754612 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:02:50.754612 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:02:50.755472 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:02:50.755472 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:02:50.755472 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:02:50.755472 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:02:50.755472 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:02:50.755472 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:02:50.755472 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:02:50.755472 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:02:50.755472 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:02:50.755472 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:02:50.755472 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:02:50.755472 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:02:50.755472 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:02:50.755472 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:02:50.755472 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:02:50.755472 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:02:50.756244 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:02:50.756244 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:02:50.756244 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:02:50.756244 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:02:50.756244 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:02:50.756244 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:02:50.756244 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:02:50.756244 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:02:50.756244 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:02:50.756244 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:02:50.756244 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 12:02:50.756244 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:02:50.758525 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 58/114] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Sep 5 12:02:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:02:50.759524 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae6e846-d3d1-4ed9-9430-4ecbd5896b83 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:02:50.855008 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f6efc0-93f8-4b8a-bd40-323e18dbf211 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:02:50.870815 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae6e846-d3d1-4ed9-9430-4ecbd5896b83 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:02:50.890122 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59fae6d-e950-4747-9ad2-fc74c97b2857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:02:50.890769 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59fae6d-e950-4747-9ad2-fc74c97b2857 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:50.891052 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59fae6d-e950-4747-9ad2-fc74c97b2857 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:50.891330 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59fae6d-e950-4747-9ad2-fc74c97b2857 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:50.892457 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59fae6d-e950-4747-9ad2-fc74c97b2857 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:02:50.893927 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59fae6d-e950-4747-9ad2-fc74c97b2857 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:02:50.895853 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 57/115] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 5 12:02:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:02:50.896589 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59fae6d-e950-4747-9ad2-fc74c97b2857 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:02:50.911856 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8eff61-9625-458e-91cc-5165b6096e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:02:50.912490 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8eff61-9625-458e-91cc-5165b6096e6c None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:50.912767 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8eff61-9625-458e-91cc-5165b6096e6c None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:50.913072 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8eff61-9625-458e-91cc-5165b6096e6c None admin] PATH_INFO: `/v3/users/5f0c885f940345c6b98a71ea1ff0ff13` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:50.914199 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8eff61-9625-458e-91cc-5165b6096e6c None admin] RBAC: Authorizing `identity:get_user(user_id=5f0c885f940345c6b98a71ea1ff0ff13)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:02:50.916388 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:02:50.919820 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8eff61-9625-458e-91cc-5165b6096e6c None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:02:50.921530 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 59/116] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Sep 5 12:02:50 2022] GET /identity/v3/users/5f0c885f940345c6b98a71ea1ff0ff13 => generated 275 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:02:50.922303 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8eff61-9625-458e-91cc-5165b6096e6c None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:02:50.954930 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:02:50.998251 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59fae6d-e950-4747-9ad2-fc74c97b2857 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:02:51.025170 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8eff61-9625-458e-91cc-5165b6096e6c None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:02:51.031551 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5809f36d-0935-43f4-ba0a-43b638fd125b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:02:51.032209 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5809f36d-0935-43f4-ba0a-43b638fd125b None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:51.032488 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5809f36d-0935-43f4-ba0a-43b638fd125b None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:51.032761 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5809f36d-0935-43f4-ba0a-43b638fd125b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:51.042637 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5809f36d-0935-43f4-ba0a-43b638fd125b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:02:51.048356 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application [None req-5809f36d-0935-43f4-ba0a-43b638fd125b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 05 12:02:51.048356 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:02:51.048356 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:02:51.048356 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:02:51.048356 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:02:51.048356 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:02:51.048356 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:02:51.048356 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:02:51.048356 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:02:51.048356 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:02:51.048356 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:02:51.048356 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:02:51.048356 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:02:51.048356 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:02:51.048356 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:02:51.048356 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:02:51.049408 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:02:51.049408 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:02:51.049408 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:02:51.049408 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:02:51.049408 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:02:51.049408 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:02:51.049408 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:02:51.049408 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:02:51.049408 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:02:51.049408 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:02:51.049408 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:02:51.049408 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application with Lock( Sep 05 12:02:51.049408 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:02:51.049408 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:02:51.049408 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:02:51.049408 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:02:51.054338 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:02:51.054338 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:02:51.054338 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:02:51.054338 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:02:51.054338 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:02:51.054338 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:02:51.054338 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:02:51.054338 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:02:51.054338 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:02:51.054338 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:02:51.054338 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 05 12:02:51.054338 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:02:51.054338 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 58/117] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Sep 5 12:02:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:02:51.054338 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5809f36d-0935-43f4-ba0a-43b638fd125b None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:02:51.065494 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac2d4d1-31f9-4c1c-9d14-0158b75f2bc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:02:51.066133 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac2d4d1-31f9-4c1c-9d14-0158b75f2bc6 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:51.066418 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac2d4d1-31f9-4c1c-9d14-0158b75f2bc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:51.066693 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac2d4d1-31f9-4c1c-9d14-0158b75f2bc6 None admin] PATH_INFO: `/v3/users/5f0c885f940345c6b98a71ea1ff0ff13` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:51.067825 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac2d4d1-31f9-4c1c-9d14-0158b75f2bc6 None admin] RBAC: Authorizing `identity:get_user(user_id=5f0c885f940345c6b98a71ea1ff0ff13)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:02:51.069311 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac2d4d1-31f9-4c1c-9d14-0158b75f2bc6 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:02:51.070892 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 60/118] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Sep 5 12:02:50 2022] GET /identity/v3/users/5f0c885f940345c6b98a71ea1ff0ff13 => generated 275 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:02:51.071726 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac2d4d1-31f9-4c1c-9d14-0158b75f2bc6 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:02:51.135207 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:02:51.157027 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5809f36d-0935-43f4-ba0a-43b638fd125b None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:02:51.167846 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:02:51.171397 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac2d4d1-31f9-4c1c-9d14-0158b75f2bc6 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:02:51.190422 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dafd0d3-8de5-4257-9303-6012e30be63c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:02:51.191026 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dafd0d3-8de5-4257-9303-6012e30be63c None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:51.191309 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dafd0d3-8de5-4257-9303-6012e30be63c None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:51.191581 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dafd0d3-8de5-4257-9303-6012e30be63c None admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:51.192242 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dafd0d3-8de5-4257-9303-6012e30be63c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:02:51.192544 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dafd0d3-8de5-4257-9303-6012e30be63c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:02:51.193946 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dafd0d3-8de5-4257-9303-6012e30be63c None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:02:51.204533 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae99a0be-95e9-427f-ac85-4f71cb7ab499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:02:51.205280 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae99a0be-95e9-427f-ac85-4f71cb7ab499 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:51.205567 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae99a0be-95e9-427f-ac85-4f71cb7ab499 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:51.210184 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 59/119] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Sep 5 12:02:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:02:51.210301 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae99a0be-95e9-427f-ac85-4f71cb7ab499 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:51.210388 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dafd0d3-8de5-4257-9303-6012e30be63c None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:02:51.220055 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae99a0be-95e9-427f-ac85-4f71cb7ab499 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:02:51.225435 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-ae99a0be-95e9-427f-ac85-4f71cb7ab499 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 05 12:02:51.225435 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:02:51.225435 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:02:51.225435 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:02:51.225435 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:02:51.225435 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:02:51.225435 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:02:51.225435 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:02:51.225435 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:02:51.225435 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:02:51.225435 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:02:51.225435 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:02:51.225435 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:02:51.225435 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:02:51.225435 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:02:51.225435 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:02:51.226302 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:02:51.226302 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:02:51.226302 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:02:51.226302 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:02:51.226302 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:02:51.226302 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:02:51.226302 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:02:51.226302 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:02:51.226302 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:02:51.226302 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:02:51.226302 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:02:51.226302 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:02:51.226302 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:02:51.226302 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:02:51.226302 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:02:51.226302 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:02:51.227093 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:02:51.227093 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:02:51.227093 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:02:51.227093 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:02:51.227093 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:02:51.227093 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:02:51.227093 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:02:51.227093 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:02:51.227093 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:02:51.227093 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:02:51.227093 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 05 12:02:51.227093 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:02:51.227093 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 61/120] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Sep 5 12:02:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:02:51.229759 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae99a0be-95e9-427f-ac85-4f71cb7ab499 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:02:51.309310 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dafd0d3-8de5-4257-9303-6012e30be63c None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:02:51.335845 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae99a0be-95e9-427f-ac85-4f71cb7ab499 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:02:51.341833 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9b0354-32fb-4fb3-be09-d49e6572bcd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:02:51.342438 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9b0354-32fb-4fb3-be09-d49e6572bcd7 None admin] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:51.342721 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9b0354-32fb-4fb3-be09-d49e6572bcd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:51.343000 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9b0354-32fb-4fb3-be09-d49e6572bcd7 None admin] PATH_INFO: `/v3/projects` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:51.343652 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9b0354-32fb-4fb3-be09-d49e6572bcd7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:02:51.345135 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9b0354-32fb-4fb3-be09-d49e6572bcd7 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:02:51.356988 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:02:51.371035 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a24b66-1619-4c64-9d1f-8a7245f05d8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:02:51.372291 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a24b66-1619-4c64-9d1f-8a7245f05d8d None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:51.372577 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a24b66-1619-4c64-9d1f-8a7245f05d8d None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:51.372850 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a24b66-1619-4c64-9d1f-8a7245f05d8d None admin] PATH_INFO: `/v3/projects/2370f3588c6e4c5798f29493d9842333` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:51.373989 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a24b66-1619-4c64-9d1f-8a7245f05d8d None admin] RBAC: Authorizing `identity:get_project(project_id=2370f3588c6e4c5798f29493d9842333)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:02:51.374240 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 60/121] 10.222.0.50 () {60 vars in 1141 bytes} [Mon Sep 5 12:02:51 2022] POST /identity/v3/projects => generated 302 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:02:51.375046 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9b0354-32fb-4fb3-be09-d49e6572bcd7 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:02:51.375460 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a24b66-1619-4c64-9d1f-8a7245f05d8d None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:02:51.377282 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 62/122] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Sep 5 12:02:51 2022] GET /identity/v3/projects/2370f3588c6e4c5798f29493d9842333 => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:02:51.377884 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a24b66-1619-4c64-9d1f-8a7245f05d8d None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:02:51.417713 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:02:51.502300 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a24b66-1619-4c64-9d1f-8a7245f05d8d None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:02:51.502506 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9b0354-32fb-4fb3-be09-d49e6572bcd7 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:02:51.540187 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61e7996-c61d-4a59-8f75-1685a6ee1c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:02:51.540925 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61e7996-c61d-4a59-8f75-1685a6ee1c40 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:51.541138 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61e7996-c61d-4a59-8f75-1685a6ee1c40 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:51.541415 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61e7996-c61d-4a59-8f75-1685a6ee1c40 None admin] PATH_INFO: `/v3/projects/2370f3588c6e4c5798f29493d9842333` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:51.542552 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61e7996-c61d-4a59-8f75-1685a6ee1c40 None admin] RBAC: Authorizing `identity:get_project(project_id=2370f3588c6e4c5798f29493d9842333)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:02:51.544879 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61e7996-c61d-4a59-8f75-1685a6ee1c40 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:02:51.546582 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 63/123] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Sep 5 12:02:51 2022] GET /identity/v3/projects/2370f3588c6e4c5798f29493d9842333 => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:02:51.547020 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61e7996-c61d-4a59-8f75-1685a6ee1c40 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:02:51.552640 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e44698-c835-49a8-a31a-600fcaa2c8eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:02:51.553345 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e44698-c835-49a8-a31a-600fcaa2c8eb None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:51.553631 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e44698-c835-49a8-a31a-600fcaa2c8eb None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:51.555400 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e44698-c835-49a8-a31a-600fcaa2c8eb None admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:51.555400 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e44698-c835-49a8-a31a-600fcaa2c8eb None admin] RBAC: Adding query filter params (name=reader) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:02:51.555400 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e44698-c835-49a8-a31a-600fcaa2c8eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:02:51.556315 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e44698-c835-49a8-a31a-600fcaa2c8eb None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:02:51.571329 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 61/124] 10.222.0.50 () {56 vars in 1101 bytes} [Mon Sep 5 12:02:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:02:51.572177 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e44698-c835-49a8-a31a-600fcaa2c8eb None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:02:51.638972 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:02:51.656754 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:02:51.665533 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61e7996-c61d-4a59-8f75-1685a6ee1c40 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:02:51.690033 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e44698-c835-49a8-a31a-600fcaa2c8eb None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:02:51.701521 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2aa69b-44d6-408f-916f-0a161b50003b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:02:51.702178 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2aa69b-44d6-408f-916f-0a161b50003b None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:51.702453 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2aa69b-44d6-408f-916f-0a161b50003b None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:51.702731 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2aa69b-44d6-408f-916f-0a161b50003b None admin] PATH_INFO: `/v3/users/5ec42edb9cd44e278afe2e10f9b7de4c` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:51.703885 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2aa69b-44d6-408f-916f-0a161b50003b None admin] RBAC: Authorizing `identity:get_user(user_id=5ec42edb9cd44e278afe2e10f9b7de4c)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:02:51.705385 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2aa69b-44d6-408f-916f-0a161b50003b None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:02:51.706986 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 64/125] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Sep 5 12:02:51 2022] GET /identity/v3/users/5ec42edb9cd44e278afe2e10f9b7de4c => generated 247 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:02:51.707741 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2aa69b-44d6-408f-916f-0a161b50003b None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:02:51.730839 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9d669b-2bc3-412e-8178-ab81f919449f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:02:51.731996 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9d669b-2bc3-412e-8178-ab81f919449f None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:51.732276 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9d669b-2bc3-412e-8178-ab81f919449f None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:51.732553 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9d669b-2bc3-412e-8178-ab81f919449f None admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:51.733336 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9d669b-2bc3-412e-8178-ab81f919449f None admin] RBAC: Adding query filter params (name=member) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:02:51.733935 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9d669b-2bc3-412e-8178-ab81f919449f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:02:51.735015 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9d669b-2bc3-412e-8178-ab81f919449f None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:02:51.744223 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 62/126] 10.222.0.50 () {56 vars in 1101 bytes} [Mon Sep 5 12:02:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:02:51.744689 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9d669b-2bc3-412e-8178-ab81f919449f None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:02:51.836434 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2aa69b-44d6-408f-916f-0a161b50003b None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:02:51.864100 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9d669b-2bc3-412e-8178-ab81f919449f None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:02:51.872680 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb82010-7cec-43c0-92ec-76485b1e1720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:02:51.873385 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb82010-7cec-43c0-92ec-76485b1e1720 None admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:51.873676 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb82010-7cec-43c0-92ec-76485b1e1720 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:51.874171 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb82010-7cec-43c0-92ec-76485b1e1720 None admin] PATH_INFO: `/v3/projects/2370f3588c6e4c5798f29493d9842333/users/5f0c885f940345c6b98a71ea1ff0ff13/roles/ed72181e1403401facb77dcf33644757` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:51.875860 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb82010-7cec-43c0-92ec-76485b1e1720 None admin] RBAC: Authorizing `identity:create_grant(project_id=2370f3588c6e4c5798f29493d9842333, user_id=5f0c885f940345c6b98a71ea1ff0ff13, role_id=ed72181e1403401facb77dcf33644757)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:02:51.877351 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb82010-7cec-43c0-92ec-76485b1e1720 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:02:51.881562 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:02:51.890970 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 65/127] 10.222.0.50 () {58 vars in 1439 bytes} [Mon Sep 5 12:02:51 2022] PUT /identity/v3/projects/2370f3588c6e4c5798f29493d9842333/users/5f0c885f940345c6b98a71ea1ff0ff13/roles/ed72181e1403401facb77dcf33644757 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:02:51.892062 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb82010-7cec-43c0-92ec-76485b1e1720 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:02:51.913114 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a5d0ef-cbd4-4a6c-9f94-036bfa910aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:02:51.914107 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a5d0ef-cbd4-4a6c-9f94-036bfa910aad None admin] REQUEST_METHOD: `PUT` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:51.914457 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a5d0ef-cbd4-4a6c-9f94-036bfa910aad None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:51.914743 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a5d0ef-cbd4-4a6c-9f94-036bfa910aad None admin] PATH_INFO: `/v3/projects/2370f3588c6e4c5798f29493d9842333/users/5f0c885f940345c6b98a71ea1ff0ff13/roles/bf853a508574493f9bc7d85f3c3b36fd` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:51.917317 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a5d0ef-cbd4-4a6c-9f94-036bfa910aad None admin] RBAC: Authorizing `identity:create_grant(project_id=2370f3588c6e4c5798f29493d9842333, user_id=5f0c885f940345c6b98a71ea1ff0ff13, role_id=bf853a508574493f9bc7d85f3c3b36fd)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:02:51.919537 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a5d0ef-cbd4-4a6c-9f94-036bfa910aad None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:02:51.935989 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:02:51.937939 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 63/128] 10.222.0.50 () {58 vars in 1439 bytes} [Mon Sep 5 12:02:51 2022] PUT /identity/v3/projects/2370f3588c6e4c5798f29493d9842333/users/5f0c885f940345c6b98a71ea1ff0ff13/roles/bf853a508574493f9bc7d85f3c3b36fd => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:02:51.945591 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a5d0ef-cbd4-4a6c-9f94-036bfa910aad None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:02:52.042172 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb82010-7cec-43c0-92ec-76485b1e1720 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:02:52.097117 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4891b78b-f90c-449e-9463-9db03f72ee49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:02:52.097867 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4891b78b-f90c-449e-9463-9db03f72ee49 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:52.098229 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4891b78b-f90c-449e-9463-9db03f72ee49 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:52.098569 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4891b78b-f90c-449e-9463-9db03f72ee49 None admin] PATH_INFO: `/v3/users/ac2a596dc1524e7497011a613536dd9e` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:52.115025 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4891b78b-f90c-449e-9463-9db03f72ee49 None admin] RBAC: Authorizing `identity:get_user(user_id=ac2a596dc1524e7497011a613536dd9e)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:02:52.116554 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4891b78b-f90c-449e-9463-9db03f72ee49 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:02:52.118312 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 66/129] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Sep 5 12:02:51 2022] GET /identity/v3/users/ac2a596dc1524e7497011a613536dd9e => generated 289 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:02:52.119108 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4891b78b-f90c-449e-9463-9db03f72ee49 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:02:52.157545 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a5d0ef-cbd4-4a6c-9f94-036bfa910aad None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:02:52.199693 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32814d05-a671-430e-8487-acb62a510a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:02:52.200641 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32814d05-a671-430e-8487-acb62a510a3e None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:52.201088 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32814d05-a671-430e-8487-acb62a510a3e None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:52.201369 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32814d05-a671-430e-8487-acb62a510a3e None admin] PATH_INFO: `/v3/projects/2370f3588c6e4c5798f29493d9842333` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:52.202544 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32814d05-a671-430e-8487-acb62a510a3e None admin] RBAC: Authorizing `identity:get_project(project_id=2370f3588c6e4c5798f29493d9842333)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:02:52.204022 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32814d05-a671-430e-8487-acb62a510a3e None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:02:52.206151 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 64/130] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Sep 5 12:02:51 2022] GET /identity/v3/projects/2370f3588c6e4c5798f29493d9842333 => generated 298 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:02:52.206514 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32814d05-a671-430e-8487-acb62a510a3e None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:02:52.217273 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:02:52.242399 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4891b78b-f90c-449e-9463-9db03f72ee49 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:02:52.265615 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:02:52.304412 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc4f3b0-e4d9-445d-8b0e-26ca430807ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:02:52.305335 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc4f3b0-e4d9-445d-8b0e-26ca430807ff None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:52.305618 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc4f3b0-e4d9-445d-8b0e-26ca430807ff None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:52.307180 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc4f3b0-e4d9-445d-8b0e-26ca430807ff None admin] PATH_INFO: `/v3/users/5f0c885f940345c6b98a71ea1ff0ff13` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:52.311111 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc4f3b0-e4d9-445d-8b0e-26ca430807ff None admin] RBAC: Authorizing `identity:get_user(user_id=5f0c885f940345c6b98a71ea1ff0ff13)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:02:52.312596 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc4f3b0-e4d9-445d-8b0e-26ca430807ff None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:02:52.314219 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 67/131] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Sep 5 12:02:52 2022] GET /identity/v3/users/5f0c885f940345c6b98a71ea1ff0ff13 => generated 275 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:02:52.316792 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc4f3b0-e4d9-445d-8b0e-26ca430807ff None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:02:52.371032 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32814d05-a671-430e-8487-acb62a510a3e None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:02:52.410734 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fffca67-2778-4574-b5cb-66e1560ed255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:02:52.411456 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fffca67-2778-4574-b5cb-66e1560ed255 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:52.411775 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fffca67-2778-4574-b5cb-66e1560ed255 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:52.412118 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fffca67-2778-4574-b5cb-66e1560ed255 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:52.498229 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc4f3b0-e4d9-445d-8b0e-26ca430807ff None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:02:52.514564 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fffca67-2778-4574-b5cb-66e1560ed255 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:02:52.516060 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fffca67-2778-4574-b5cb-66e1560ed255 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:02:52.555657 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26077698-85c9-43e3-948f-9483c745db04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:02:52.556329 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26077698-85c9-43e3-948f-9483c745db04 None admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:52.556609 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26077698-85c9-43e3-948f-9483c745db04 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:52.556883 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26077698-85c9-43e3-948f-9483c745db04 None admin] PATH_INFO: `/v3/projects/2370f3588c6e4c5798f29493d9842333/users/5ec42edb9cd44e278afe2e10f9b7de4c/roles/16e2ccc8bd1b497d8cee780c1c7df0d2` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:52.559550 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26077698-85c9-43e3-948f-9483c745db04 None admin] RBAC: Authorizing `identity:create_grant(project_id=2370f3588c6e4c5798f29493d9842333, user_id=5ec42edb9cd44e278afe2e10f9b7de4c, role_id=16e2ccc8bd1b497d8cee780c1c7df0d2)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:02:52.561066 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26077698-85c9-43e3-948f-9483c745db04 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:02:52.577512 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:02:52.587769 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 68/132] 10.222.0.50 () {58 vars in 1439 bytes} [Mon Sep 5 12:02:52 2022] PUT /identity/v3/projects/2370f3588c6e4c5798f29493d9842333/users/5ec42edb9cd44e278afe2e10f9b7de4c/roles/16e2ccc8bd1b497d8cee780c1c7df0d2 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:02:52.588617 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26077698-85c9-43e3-948f-9483c745db04 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:02:52.614437 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:02:52.691966 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 65/133] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Sep 5 12:02:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 12:02:52.698067 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fffca67-2778-4574-b5cb-66e1560ed255 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:02:52.838906 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26077698-85c9-43e3-948f-9483c745db04 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:02:52.864577 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fffca67-2778-4574-b5cb-66e1560ed255 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:02:52.916424 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0170e955-d923-4d41-b6a4-38ae6aca1190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:02:52.917095 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0170e955-d923-4d41-b6a4-38ae6aca1190 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:52.917382 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0170e955-d923-4d41-b6a4-38ae6aca1190 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:52.917661 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0170e955-d923-4d41-b6a4-38ae6aca1190 None admin] PATH_INFO: `/v3/projects/2370f3588c6e4c5798f29493d9842333` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:52.917859 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f090218-3aa9-494f-8484-53b8659510a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:02:52.918631 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f090218-3aa9-494f-8484-53b8659510a0 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:52.918915 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f090218-3aa9-494f-8484-53b8659510a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:52.919193 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f090218-3aa9-494f-8484-53b8659510a0 None admin] PATH_INFO: `/v3/projects/a42b9aa568b143b3a7550b45df2a4858` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:52.920328 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f090218-3aa9-494f-8484-53b8659510a0 None admin] RBAC: Authorizing `identity:get_project(project_id=a42b9aa568b143b3a7550b45df2a4858)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:02:52.921583 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0170e955-d923-4d41-b6a4-38ae6aca1190 None admin] RBAC: Authorizing `identity:get_project(project_id=2370f3588c6e4c5798f29493d9842333)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:02:52.923049 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0170e955-d923-4d41-b6a4-38ae6aca1190 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:02:52.924989 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f090218-3aa9-494f-8484-53b8659510a0 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:02:52.925117 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 66/134] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Sep 5 12:02:52 2022] GET /identity/v3/projects/2370f3588c6e4c5798f29493d9842333 => generated 298 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:02:52.927318 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 69/135] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Sep 5 12:02:52 2022] GET /identity/v3/projects/a42b9aa568b143b3a7550b45df2a4858 => generated 312 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:02:52.930718 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0170e955-d923-4d41-b6a4-38ae6aca1190 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:02:52.933468 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f090218-3aa9-494f-8484-53b8659510a0 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:02:52.953257 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:02:53.068202 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0170e955-d923-4d41-b6a4-38ae6aca1190 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:02:53.089471 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:02:53.126628 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f090218-3aa9-494f-8484-53b8659510a0 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:02:53.133775 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550b5390-ecd8-4d53-b587-d9f50697d80e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:02:53.134419 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550b5390-ecd8-4d53-b587-d9f50697d80e None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:53.134707 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550b5390-ecd8-4d53-b587-d9f50697d80e None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:53.134989 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550b5390-ecd8-4d53-b587-d9f50697d80e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:53.135730 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550b5390-ecd8-4d53-b587-d9f50697d80e None admin] RBAC: Adding query filter params (role.id=7759eb25e244436aa0b1be6aee7ebd1e, scope.project.id=2370f3588c6e4c5798f29493d9842333, user.id=ac2a596dc1524e7497011a613536dd9e) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:02:53.136042 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550b5390-ecd8-4d53-b587-d9f50697d80e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:02:53.137520 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550b5390-ecd8-4d53-b587-d9f50697d80e None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:02:53.143606 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 67/136] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Sep 5 12:02:52 2022] GET /identity/v3/role_assignments?user.id=ac2a596dc1524e7497011a613536dd9e&scope.project.id=2370f3588c6e4c5798f29493d9842333&role.id=7759eb25e244436aa0b1be6aee7ebd1e => generated 259 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:02:53.167730 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8598b71-55bf-4227-9e99-9f94c890dd3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:02:53.168944 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8598b71-55bf-4227-9e99-9f94c890dd3d None admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:53.169233 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8598b71-55bf-4227-9e99-9f94c890dd3d None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:53.169507 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8598b71-55bf-4227-9e99-9f94c890dd3d None admin] PATH_INFO: `/v3/projects/a42b9aa568b143b3a7550b45df2a4858/users/5f0c885f940345c6b98a71ea1ff0ff13/roles/ed72181e1403401facb77dcf33644757` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:53.171512 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8598b71-55bf-4227-9e99-9f94c890dd3d None admin] RBAC: Authorizing `identity:create_grant(project_id=a42b9aa568b143b3a7550b45df2a4858, user_id=5f0c885f940345c6b98a71ea1ff0ff13, role_id=ed72181e1403401facb77dcf33644757)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:02:53.173028 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8598b71-55bf-4227-9e99-9f94c890dd3d None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:02:53.191566 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 70/137] 10.222.0.50 () {58 vars in 1439 bytes} [Mon Sep 5 12:02:52 2022] PUT /identity/v3/projects/a42b9aa568b143b3a7550b45df2a4858/users/5f0c885f940345c6b98a71ea1ff0ff13/roles/ed72181e1403401facb77dcf33644757 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 12:02:53.935861 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742931d0-6b86-4dec-b3e6-45523946365f None None] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:53.936361 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742931d0-6b86-4dec-b3e6-45523946365f None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:53.936468 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742931d0-6b86-4dec-b3e6-45523946365f None None] PATH_INFO: `/` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:53.938040 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 68/138] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:02:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:02:53.943469 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b9175d-06c2-4ce0-b12e-9b5f8e88d5ef None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:53.943895 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b9175d-06c2-4ce0-b12e-9b5f8e88d5ef None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:53.944070 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b9175d-06c2-4ce0-b12e-9b5f8e88d5ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:53.973919 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-78b9175d-06c2-4ce0-b12e-9b5f8e88d5ef None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:02:53.975145 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-78b9175d-06c2-4ce0-b12e-9b5f8e88d5ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:02:54.062176 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 71/139] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:02:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 05 12:02:54.460193 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742931d0-6b86-4dec-b3e6-45523946365f None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:02:54.555753 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:02:54.586166 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742931d0-6b86-4dec-b3e6-45523946365f None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:02:54.629039 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a7ec98-75d2-4cc3-812e-de6b548cd4ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:02:54.629681 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a7ec98-75d2-4cc3-812e-de6b548cd4ce None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:54.629999 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a7ec98-75d2-4cc3-812e-de6b548cd4ce None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:54.630284 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a7ec98-75d2-4cc3-812e-de6b548cd4ce None admin] PATH_INFO: `/v3/domains/default` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:54.634852 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a7ec98-75d2-4cc3-812e-de6b548cd4ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:02:54.638079 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a7ec98-75d2-4cc3-812e-de6b548cd4ce None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:02:54.639889 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 69/140] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 5 12:02:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:02:54.645199 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b9175d-06c2-4ce0-b12e-9b5f8e88d5ef None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:02:54.754515 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:02:54.808994 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b9175d-06c2-4ce0-b12e-9b5f8e88d5ef None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:02:54.822757 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47273342-996f-4c3a-9b94-98b99b3f5104 None None] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:54.823039 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47273342-996f-4c3a-9b94-98b99b3f5104 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:54.823324 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47273342-996f-4c3a-9b94-98b99b3f5104 None None] PATH_INFO: `/` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:54.824990 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 70/141] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:02:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:02:54.830036 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959f8330-e4aa-4425-8dec-599b70cfd135 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:54.830314 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959f8330-e4aa-4425-8dec-599b70cfd135 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:54.830594 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959f8330-e4aa-4425-8dec-599b70cfd135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:54.850976 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-959f8330-e4aa-4425-8dec-599b70cfd135 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:02:54.852174 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-959f8330-e4aa-4425-8dec-599b70cfd135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:02:54.867255 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706c3379-e87a-4a55-bba3-16327ed49178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:02:54.868032 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706c3379-e87a-4a55-bba3-16327ed49178 None admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:54.868312 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706c3379-e87a-4a55-bba3-16327ed49178 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:54.868982 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706c3379-e87a-4a55-bba3-16327ed49178 None admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:54.869920 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706c3379-e87a-4a55-bba3-16327ed49178 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:02:54.871596 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706c3379-e87a-4a55-bba3-16327ed49178 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:02:54.902011 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 72/142] 10.222.0.50 () {60 vars in 1132 bytes} [Mon Sep 5 12:02:54 2022] POST /identity/v3/users => generated 283 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:02:54.903905 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd80f77c-d3c0-44fc-9057-883c6e4301b1 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:54.904244 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd80f77c-d3c0-44fc-9057-883c6e4301b1 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:54.904524 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd80f77c-d3c0-44fc-9057-883c6e4301b1 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:54.905795 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 73/143] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:02:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:02:54.913179 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac1e110-f217-4bd9-bb74-b7d7ff6dee09 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:54.913483 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac1e110-f217-4bd9-bb74-b7d7ff6dee09 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:54.913743 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac1e110-f217-4bd9-bb74-b7d7ff6dee09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:54.952958 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-aac1e110-f217-4bd9-bb74-b7d7ff6dee09 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:02:54.955260 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-aac1e110-f217-4bd9-bb74-b7d7ff6dee09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:02:54.973989 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 71/144] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:02:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 05 12:02:55.039123 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871daa50-65b4-479d-9607-b520b57add71 None None] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:55.039395 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871daa50-65b4-479d-9607-b520b57add71 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:55.039610 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871daa50-65b4-479d-9607-b520b57add71 None None] PATH_INFO: `/` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:55.041291 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 72/145] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:02:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 12:02:55.047050 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac35b805-77a5-4818-8aa8-e9827a21ac9b None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:55.047340 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac35b805-77a5-4818-8aa8-e9827a21ac9b None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:55.047620 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac35b805-77a5-4818-8aa8-e9827a21ac9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:55.085052 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-ac35b805-77a5-4818-8aa8-e9827a21ac9b None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:02:55.086709 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-ac35b805-77a5-4818-8aa8-e9827a21ac9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:02:55.097977 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 74/146] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:02:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:02:55.204284 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 73/147] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:02:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 05 12:02:55.359205 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac1e110-f217-4bd9-bb74-b7d7ff6dee09 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:02:55.408934 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac35b805-77a5-4818-8aa8-e9827a21ac9b None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:02:55.413824 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:02:55.430021 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:02:55.477375 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac1e110-f217-4bd9-bb74-b7d7ff6dee09 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:02:55.515891 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b9df0c-7527-4c27-8d84-bbec78f554d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:02:55.516557 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b9df0c-7527-4c27-8d84-bbec78f554d5 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:55.516934 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b9df0c-7527-4c27-8d84-bbec78f554d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:55.517257 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b9df0c-7527-4c27-8d84-bbec78f554d5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:55.529015 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b9df0c-7527-4c27-8d84-bbec78f554d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:02:55.533979 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-55b9df0c-7527-4c27-8d84-bbec78f554d5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 05 12:02:55.533979 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:02:55.533979 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:02:55.533979 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:02:55.533979 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:02:55.533979 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:02:55.533979 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:02:55.533979 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:02:55.533979 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:02:55.533979 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:02:55.533979 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:02:55.533979 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:02:55.533979 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:02:55.533979 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:02:55.533979 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:02:55.533979 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:02:55.534818 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:02:55.534818 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:02:55.534818 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:02:55.534818 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:02:55.534818 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:02:55.534818 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:02:55.534818 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:02:55.534818 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:02:55.534818 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:02:55.534818 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:02:55.534818 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:02:55.534818 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:02:55.534818 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:02:55.534818 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:02:55.534818 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:02:55.534818 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:02:55.535610 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:02:55.535610 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:02:55.535610 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:02:55.535610 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:02:55.535610 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:02:55.535610 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:02:55.535610 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:02:55.535610 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:02:55.535610 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:02:55.535610 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:02:55.535610 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 05 12:02:55.535610 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:02:55.535610 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 75/148] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Sep 5 12:02:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:02:55.544821 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b9df0c-7527-4c27-8d84-bbec78f554d5 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:02:55.620878 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac35b805-77a5-4818-8aa8-e9827a21ac9b None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:02:55.659613 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b9df0c-7527-4c27-8d84-bbec78f554d5 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:02:55.670245 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cf0422-17c0-4376-a534-e20c80e4eb81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:02:55.670892 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cf0422-17c0-4376-a534-e20c80e4eb81 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:55.671180 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cf0422-17c0-4376-a534-e20c80e4eb81 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:55.671442 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cf0422-17c0-4376-a534-e20c80e4eb81 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:55.677257 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:02:55.684457 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cf0422-17c0-4376-a534-e20c80e4eb81 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:02:55.689819 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application [None req-a1cf0422-17c0-4376-a534-e20c80e4eb81 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 05 12:02:55.689819 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:02:55.689819 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:02:55.689819 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:02:55.689819 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:02:55.689819 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:02:55.689819 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:02:55.689819 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:02:55.689819 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:02:55.689819 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:02:55.689819 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:02:55.689819 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:02:55.689819 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:02:55.689819 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:02:55.689819 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:02:55.689819 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:02:55.690695 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:02:55.690695 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:02:55.690695 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:02:55.690695 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:02:55.690695 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:02:55.690695 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:02:55.690695 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:02:55.690695 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:02:55.690695 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:02:55.690695 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:02:55.690695 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:02:55.690695 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application with Lock( Sep 05 12:02:55.690695 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:02:55.690695 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:02:55.690695 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:02:55.690695 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:02:55.691469 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:02:55.691469 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:02:55.691469 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:02:55.691469 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:02:55.691469 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:02:55.691469 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:02:55.691469 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:02:55.691469 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:02:55.691469 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:02:55.691469 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:02:55.691469 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 05 12:02:55.691469 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:02:55.691469 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 74/149] 10.222.0.50 () {56 vars in 1114 bytes} [Mon Sep 5 12:02:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:02:55.692095 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cf0422-17c0-4376-a534-e20c80e4eb81 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:02:55.701677 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cdb68b-939d-4003-8fa7-9d155ef664ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:02:55.702399 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cdb68b-939d-4003-8fa7-9d155ef664ca None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:55.702683 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cdb68b-939d-4003-8fa7-9d155ef664ca None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:55.702953 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cdb68b-939d-4003-8fa7-9d155ef664ca None admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:55.703631 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cdb68b-939d-4003-8fa7-9d155ef664ca None admin] RBAC: Adding query filter params (name=member) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:02:55.704043 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cdb68b-939d-4003-8fa7-9d155ef664ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:02:55.705906 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cdb68b-939d-4003-8fa7-9d155ef664ca None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:02:55.716984 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 76/150] 10.222.0.50 () {56 vars in 1101 bytes} [Mon Sep 5 12:02:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:02:55.717711 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cdb68b-939d-4003-8fa7-9d155ef664ca None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:02:55.766884 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:02:55.818854 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cf0422-17c0-4376-a534-e20c80e4eb81 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:02:55.843398 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cdb68b-939d-4003-8fa7-9d155ef664ca None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:02:55.859178 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ed2cff-e912-4f75-924f-472d4e6180ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:02:55.859811 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ed2cff-e912-4f75-924f-472d4e6180ba None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:55.860086 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ed2cff-e912-4f75-924f-472d4e6180ba None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:55.860355 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ed2cff-e912-4f75-924f-472d4e6180ba None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:55.871972 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ed2cff-e912-4f75-924f-472d4e6180ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:02:55.876813 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application [None req-88ed2cff-e912-4f75-924f-472d4e6180ba None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 12:02:55.876813 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:02:55.876813 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:02:55.876813 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:02:55.876813 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:02:55.876813 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:02:55.876813 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:02:55.876813 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:02:55.876813 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:02:55.876813 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:02:55.876813 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:02:55.876813 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:02:55.876813 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:02:55.876813 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:02:55.876813 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:02:55.876813 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:02:55.877775 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:02:55.877775 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:02:55.877775 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:02:55.877775 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:02:55.877775 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:02:55.877775 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:02:55.877775 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:02:55.877775 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:02:55.877775 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:02:55.877775 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:02:55.877775 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:02:55.877775 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application with Lock( Sep 05 12:02:55.877775 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:02:55.877775 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:02:55.877775 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:02:55.877775 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:02:55.878531 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:02:55.878531 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:02:55.878531 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:02:55.878531 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:02:55.878531 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:02:55.878531 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:02:55.878531 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:02:55.878531 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:02:55.878531 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:02:55.878531 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:02:55.878531 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 12:02:55.878531 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:02:55.878531 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 75/151] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Sep 5 12:02:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:02:55.879167 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ed2cff-e912-4f75-924f-472d4e6180ba None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:02:55.883154 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38091048-fefc-4896-8746-8cbd875174f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:02:55.884041 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38091048-fefc-4896-8746-8cbd875174f9 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:55.884246 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38091048-fefc-4896-8746-8cbd875174f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:55.884587 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38091048-fefc-4896-8746-8cbd875174f9 None admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:55.885335 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38091048-fefc-4896-8746-8cbd875174f9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:02:55.885692 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38091048-fefc-4896-8746-8cbd875174f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:02:55.887303 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38091048-fefc-4896-8746-8cbd875174f9 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:02:55.897693 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 77/152] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Sep 5 12:02:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:02:55.898812 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38091048-fefc-4896-8746-8cbd875174f9 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:02:55.949485 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:02:55.997607 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ed2cff-e912-4f75-924f-472d4e6180ba None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:02:56.034267 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:02:56.037845 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38091048-fefc-4896-8746-8cbd875174f9 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:02:56.051451 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16385ff-e4bb-4ffa-a3af-fac8cdbaeecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:02:56.052098 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16385ff-e4bb-4ffa-a3af-fac8cdbaeecb None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:56.052382 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16385ff-e4bb-4ffa-a3af-fac8cdbaeecb None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:56.052645 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16385ff-e4bb-4ffa-a3af-fac8cdbaeecb None admin] PATH_INFO: `/v3/users/5f0c885f940345c6b98a71ea1ff0ff13` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:56.053851 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16385ff-e4bb-4ffa-a3af-fac8cdbaeecb None admin] RBAC: Authorizing `identity:get_user(user_id=5f0c885f940345c6b98a71ea1ff0ff13)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:02:56.055325 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16385ff-e4bb-4ffa-a3af-fac8cdbaeecb None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:02:56.058959 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 76/153] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Sep 5 12:02:55 2022] GET /identity/v3/users/5f0c885f940345c6b98a71ea1ff0ff13 => generated 275 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:02:56.059814 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16385ff-e4bb-4ffa-a3af-fac8cdbaeecb None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:02:56.086973 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d89d04a-dbbb-45db-8201-332fb06ac9c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:02:56.087610 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d89d04a-dbbb-45db-8201-332fb06ac9c3 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:56.087888 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d89d04a-dbbb-45db-8201-332fb06ac9c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:56.088157 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d89d04a-dbbb-45db-8201-332fb06ac9c3 None admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:56.088833 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d89d04a-dbbb-45db-8201-332fb06ac9c3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:02:56.091775 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d89d04a-dbbb-45db-8201-332fb06ac9c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:02:56.093216 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d89d04a-dbbb-45db-8201-332fb06ac9c3 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:02:56.103801 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 78/154] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Sep 5 12:02:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:02:56.104477 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d89d04a-dbbb-45db-8201-332fb06ac9c3 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:02:56.206851 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16385ff-e4bb-4ffa-a3af-fac8cdbaeecb None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:02:56.227373 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d89d04a-dbbb-45db-8201-332fb06ac9c3 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:02:56.233327 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:02:56.259416 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8744bce-70e9-4c17-b123-ec83899ded84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:02:56.260067 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8744bce-70e9-4c17-b123-ec83899ded84 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:56.260348 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8744bce-70e9-4c17-b123-ec83899ded84 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:56.260621 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8744bce-70e9-4c17-b123-ec83899ded84 None admin] PATH_INFO: `/v3/users/5f0c885f940345c6b98a71ea1ff0ff13` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:56.262613 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8744bce-70e9-4c17-b123-ec83899ded84 None admin] RBAC: Authorizing `identity:get_user(user_id=5f0c885f940345c6b98a71ea1ff0ff13)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:02:56.264255 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8744bce-70e9-4c17-b123-ec83899ded84 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:02:56.266796 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 77/155] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Sep 5 12:02:56 2022] GET /identity/v3/users/5f0c885f940345c6b98a71ea1ff0ff13 => generated 275 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:02:56.267596 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8744bce-70e9-4c17-b123-ec83899ded84 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:02:56.281160 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae7f921-b9e0-49eb-b9b5-126a3ecc600c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:02:56.282127 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae7f921-b9e0-49eb-b9b5-126a3ecc600c None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:56.282598 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae7f921-b9e0-49eb-b9b5-126a3ecc600c None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:56.283061 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae7f921-b9e0-49eb-b9b5-126a3ecc600c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:56.355766 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:02:56.379130 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae7f921-b9e0-49eb-b9b5-126a3ecc600c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:02:56.381680 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae7f921-b9e0-49eb-b9b5-126a3ecc600c None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:02:56.416554 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8744bce-70e9-4c17-b123-ec83899ded84 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:02:56.476764 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513ba018-ea33-4272-acd6-5ea4537d030b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:02:56.477821 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513ba018-ea33-4272-acd6-5ea4537d030b None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:56.478292 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513ba018-ea33-4272-acd6-5ea4537d030b None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:56.478780 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513ba018-ea33-4272-acd6-5ea4537d030b None admin] PATH_INFO: `/v3/users/5ec42edb9cd44e278afe2e10f9b7de4c` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:56.480181 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513ba018-ea33-4272-acd6-5ea4537d030b None admin] RBAC: Authorizing `identity:get_user(user_id=5ec42edb9cd44e278afe2e10f9b7de4c)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:02:56.483409 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513ba018-ea33-4272-acd6-5ea4537d030b None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:02:56.485274 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 78/156] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Sep 5 12:02:56 2022] GET /identity/v3/users/5ec42edb9cd44e278afe2e10f9b7de4c => generated 247 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:02:56.486622 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106f7304-29a4-4084-9cf3-f6ad9cd5f7b6 None None] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:56.487118 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106f7304-29a4-4084-9cf3-f6ad9cd5f7b6 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:56.487636 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106f7304-29a4-4084-9cf3-f6ad9cd5f7b6 None None] PATH_INFO: `/` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:56.493845 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 79/157] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:02:56 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:02:56.494926 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106f7304-29a4-4084-9cf3-f6ad9cd5f7b6 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:02:56.553463 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:02:56.559500 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 79/158] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Sep 5 12:02:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 12:02:56.560434 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae7f921-b9e0-49eb-b9b5-126a3ecc600c None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:02:56.637613 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106f7304-29a4-4084-9cf3-f6ad9cd5f7b6 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:02:56.687842 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:02:56.710484 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c381de71-808c-46e6-aca0-e948224fd553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:02:56.711099 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c381de71-808c-46e6-aca0-e948224fd553 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:56.711371 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c381de71-808c-46e6-aca0-e948224fd553 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:56.711684 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c381de71-808c-46e6-aca0-e948224fd553 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:56.722597 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae7f921-b9e0-49eb-b9b5-126a3ecc600c None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:02:56.761411 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d39ec1-cdbd-4f84-b654-0d878cc1eb5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:02:56.763015 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d39ec1-cdbd-4f84-b654-0d878cc1eb5c None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:56.763502 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d39ec1-cdbd-4f84-b654-0d878cc1eb5c None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:56.763964 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d39ec1-cdbd-4f84-b654-0d878cc1eb5c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:56.843667 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:02:56.847567 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d39ec1-cdbd-4f84-b654-0d878cc1eb5c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:02:56.849658 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d39ec1-cdbd-4f84-b654-0d878cc1eb5c None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:02:56.874021 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c381de71-808c-46e6-aca0-e948224fd553 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:02:56.875786 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c381de71-808c-46e6-aca0-e948224fd553 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:02:56.956574 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 80/159] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Sep 5 12:02:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 12:02:56.962199 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf85887-1045-4b0d-b3a4-6359e9c867c4 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:56.962562 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf85887-1045-4b0d-b3a4-6359e9c867c4 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:56.962903 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf85887-1045-4b0d-b3a4-6359e9c867c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:56.982948 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-cdf85887-1045-4b0d-b3a4-6359e9c867c4 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:02:56.984141 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-cdf85887-1045-4b0d-b3a4-6359e9c867c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:02:57.057093 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 81/160] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:02:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:02:57.057987 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf85887-1045-4b0d-b3a4-6359e9c867c4 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:02:57.090944 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:02:57.113503 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 80/161] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Sep 5 12:02:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 619 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 12:02:57.114939 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5792db58-3064-4360-8161-a7f83c4acb13 None None] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:57.115254 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5792db58-3064-4360-8161-a7f83c4acb13 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:57.115529 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5792db58-3064-4360-8161-a7f83c4acb13 None None] PATH_INFO: `/` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:57.116957 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 81/162] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:02:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:02:57.117649 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5792db58-3064-4360-8161-a7f83c4acb13 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:02:57.183610 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:02:57.196205 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf85887-1045-4b0d-b3a4-6359e9c867c4 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:02:57.281348 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303879f9-a098-462a-b083-fc72624bb271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:02:57.281996 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303879f9-a098-462a-b083-fc72624bb271 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:57.282272 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303879f9-a098-462a-b083-fc72624bb271 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:57.282544 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303879f9-a098-462a-b083-fc72624bb271 None admin] PATH_INFO: `/v3/projects/2370f3588c6e4c5798f29493d9842333` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:57.283675 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303879f9-a098-462a-b083-fc72624bb271 None admin] RBAC: Authorizing `identity:get_project(project_id=2370f3588c6e4c5798f29493d9842333)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:02:57.285167 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303879f9-a098-462a-b083-fc72624bb271 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:02:57.286925 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 82/163] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Sep 5 12:02:57 2022] GET /identity/v3/projects/2370f3588c6e4c5798f29493d9842333 => generated 298 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:02:57.287693 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303879f9-a098-462a-b083-fc72624bb271 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:02:57.339125 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5792db58-3064-4360-8161-a7f83c4acb13 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:02:57.406887 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e55d72-fd67-4c0c-a638-4df639494443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:02:57.407812 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e55d72-fd67-4c0c-a638-4df639494443 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:57.408093 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e55d72-fd67-4c0c-a638-4df639494443 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:57.408363 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e55d72-fd67-4c0c-a638-4df639494443 None admin] PATH_INFO: `/v3/projects/2370f3588c6e4c5798f29493d9842333` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:57.414114 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e55d72-fd67-4c0c-a638-4df639494443 None admin] RBAC: Authorizing `identity:get_project(project_id=2370f3588c6e4c5798f29493d9842333)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:02:57.417762 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e55d72-fd67-4c0c-a638-4df639494443 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:02:57.419719 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 82/164] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Sep 5 12:02:57 2022] GET /identity/v3/projects/2370f3588c6e4c5798f29493d9842333 => generated 298 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:02:57.421386 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02995c64-5c73-4f13-a6af-1f053d960155 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:57.421842 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02995c64-5c73-4f13-a6af-1f053d960155 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:57.422307 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02995c64-5c73-4f13-a6af-1f053d960155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:57.457902 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-02995c64-5c73-4f13-a6af-1f053d960155 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:02:57.459387 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-02995c64-5c73-4f13-a6af-1f053d960155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:02:57.471321 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:02:57.480435 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303879f9-a098-462a-b083-fc72624bb271 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:02:57.549607 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d664435-3b11-4f91-9489-47158012d60c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:02:57.551067 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d664435-3b11-4f91-9489-47158012d60c None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:57.551853 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d664435-3b11-4f91-9489-47158012d60c None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:57.553066 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d664435-3b11-4f91-9489-47158012d60c None admin] PATH_INFO: `/v3/projects/2370f3588c6e4c5798f29493d9842333` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:57.555632 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d664435-3b11-4f91-9489-47158012d60c None admin] RBAC: Authorizing `identity:get_project(project_id=2370f3588c6e4c5798f29493d9842333)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:02:57.561191 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d664435-3b11-4f91-9489-47158012d60c None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:02:57.565040 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 83/165] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Sep 5 12:02:57 2022] GET /identity/v3/projects/2370f3588c6e4c5798f29493d9842333 => generated 298 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:02:57.567837 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d664435-3b11-4f91-9489-47158012d60c None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:02:57.647438 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 83/166] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:02:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:02:57.648325 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02995c64-5c73-4f13-a6af-1f053d960155 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:02:57.712577 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:02:57.760256 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d664435-3b11-4f91-9489-47158012d60c None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:02:57.818502 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe80a8b-7dda-4b8e-aa7e-287405cef5b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:02:57.819451 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe80a8b-7dda-4b8e-aa7e-287405cef5b4 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:57.819894 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe80a8b-7dda-4b8e-aa7e-287405cef5b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:57.820338 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe80a8b-7dda-4b8e-aa7e-287405cef5b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:57.821288 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe80a8b-7dda-4b8e-aa7e-287405cef5b4 None admin] RBAC: Adding query filter params (role.id=ed72181e1403401facb77dcf33644757, scope.project.id=2370f3588c6e4c5798f29493d9842333, user.id=5f0c885f940345c6b98a71ea1ff0ff13) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:02:57.821829 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe80a8b-7dda-4b8e-aa7e-287405cef5b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:02:57.823657 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe80a8b-7dda-4b8e-aa7e-287405cef5b4 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:02:57.830686 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 84/167] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Sep 5 12:02:57 2022] GET /identity/v3/role_assignments?user.id=5f0c885f940345c6b98a71ea1ff0ff13&scope.project.id=2370f3588c6e4c5798f29493d9842333&role.id=ed72181e1403401facb77dcf33644757 => generated 608 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:02:57.831921 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe80a8b-7dda-4b8e-aa7e-287405cef5b4 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:02:57.857918 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02995c64-5c73-4f13-a6af-1f053d960155 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:02:57.895043 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:02:57.931302 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd827e88-8ef8-4f28-8c67-9ddce589ab95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:02:57.931858 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd827e88-8ef8-4f28-8c67-9ddce589ab95 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:57.932134 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd827e88-8ef8-4f28-8c67-9ddce589ab95 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:57.932402 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd827e88-8ef8-4f28-8c67-9ddce589ab95 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:57.933182 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd827e88-8ef8-4f28-8c67-9ddce589ab95 None admin] RBAC: Adding query filter params (role.id=16e2ccc8bd1b497d8cee780c1c7df0d2, scope.project.id=2370f3588c6e4c5798f29493d9842333, user.id=5ec42edb9cd44e278afe2e10f9b7de4c) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:02:57.933493 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd827e88-8ef8-4f28-8c67-9ddce589ab95 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:02:57.934994 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd827e88-8ef8-4f28-8c67-9ddce589ab95 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:02:57.952583 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 84/168] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Sep 5 12:02:57 2022] GET /identity/v3/role_assignments?user.id=5ec42edb9cd44e278afe2e10f9b7de4c&scope.project.id=2370f3588c6e4c5798f29493d9842333&role.id=16e2ccc8bd1b497d8cee780c1c7df0d2 => generated 608 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:02:57.957937 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd827e88-8ef8-4f28-8c67-9ddce589ab95 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:02:58.024395 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe80a8b-7dda-4b8e-aa7e-287405cef5b4 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:02:58.129595 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb115564-dba8-4552-be63-e78dc11efa8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:02:58.130238 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb115564-dba8-4552-be63-e78dc11efa8b None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:58.130537 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb115564-dba8-4552-be63-e78dc11efa8b None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:58.130811 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb115564-dba8-4552-be63-e78dc11efa8b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:58.131473 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb115564-dba8-4552-be63-e78dc11efa8b None admin] RBAC: Adding query filter params (role.id=bf853a508574493f9bc7d85f3c3b36fd, scope.project.id=2370f3588c6e4c5798f29493d9842333, user.id=5f0c885f940345c6b98a71ea1ff0ff13) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:02:58.131785 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb115564-dba8-4552-be63-e78dc11efa8b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:02:58.133262 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb115564-dba8-4552-be63-e78dc11efa8b None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:02:58.144337 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 85/169] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Sep 5 12:02:57 2022] GET /identity/v3/role_assignments?user.id=5f0c885f940345c6b98a71ea1ff0ff13&scope.project.id=2370f3588c6e4c5798f29493d9842333&role.id=bf853a508574493f9bc7d85f3c3b36fd => generated 608 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:02:58.193320 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:02:58.206840 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd827e88-8ef8-4f28-8c67-9ddce589ab95 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:02:58.251854 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3206c2ce-3e16-4372-b8ec-b68859b2b1e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:02:58.252994 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3206c2ce-3e16-4372-b8ec-b68859b2b1e2 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:58.253475 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3206c2ce-3e16-4372-b8ec-b68859b2b1e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:58.253966 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3206c2ce-3e16-4372-b8ec-b68859b2b1e2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:58.272470 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3206c2ce-3e16-4372-b8ec-b68859b2b1e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:02:58.280457 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application [None req-3206c2ce-3e16-4372-b8ec-b68859b2b1e2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 05 12:02:58.280457 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:02:58.280457 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:02:58.280457 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:02:58.280457 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:02:58.280457 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:02:58.280457 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:02:58.280457 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:02:58.280457 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:02:58.280457 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:02:58.280457 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:02:58.280457 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:02:58.280457 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:02:58.280457 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:02:58.280457 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:02:58.280457 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:02:58.281517 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:02:58.281517 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:02:58.281517 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:02:58.281517 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:02:58.281517 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:02:58.281517 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:02:58.281517 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:02:58.281517 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:02:58.281517 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:02:58.281517 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:02:58.281517 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:02:58.281517 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application with Lock( Sep 05 12:02:58.281517 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:02:58.281517 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:02:58.281517 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:02:58.281517 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:02:58.282316 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:02:58.282316 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:02:58.282316 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:02:58.282316 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:02:58.282316 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:02:58.282316 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:02:58.282316 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:02:58.282316 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:02:58.282316 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:02:58.282316 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:02:58.282316 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 05 12:02:58.282316 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:02:58.284923 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 85/170] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Sep 5 12:02:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:02:58.290745 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb115564-dba8-4552-be63-e78dc11efa8b None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:02:58.373481 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3206c2ce-3e16-4372-b8ec-b68859b2b1e2 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:02:58.451359 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb115564-dba8-4552-be63-e78dc11efa8b None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:02:58.457269 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:02:58.510789 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65213579-0605-4f70-b5e0-c18cbaf15e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:02:58.511619 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65213579-0605-4f70-b5e0-c18cbaf15e6c None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:58.512537 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65213579-0605-4f70-b5e0-c18cbaf15e6c None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:58.512817 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65213579-0605-4f70-b5e0-c18cbaf15e6c None admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:58.513583 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65213579-0605-4f70-b5e0-c18cbaf15e6c None admin] RBAC: Adding query filter params (name=reader) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:02:58.513889 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65213579-0605-4f70-b5e0-c18cbaf15e6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:02:58.515623 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65213579-0605-4f70-b5e0-c18cbaf15e6c None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:02:58.529059 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 86/171] 10.222.0.50 () {56 vars in 1101 bytes} [Mon Sep 5 12:02:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:02:58.535819 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65213579-0605-4f70-b5e0-c18cbaf15e6c None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:02:58.562808 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3206c2ce-3e16-4372-b8ec-b68859b2b1e2 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:02:58.625351 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc9e0dc-fc8e-4a66-8f35-d7bb1acbce57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:02:58.626389 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc9e0dc-fc8e-4a66-8f35-d7bb1acbce57 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:58.626865 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc9e0dc-fc8e-4a66-8f35-d7bb1acbce57 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:58.627350 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc9e0dc-fc8e-4a66-8f35-d7bb1acbce57 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:58.651291 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc9e0dc-fc8e-4a66-8f35-d7bb1acbce57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:02:58.656777 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application [None req-7dc9e0dc-fc8e-4a66-8f35-d7bb1acbce57 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 05 12:02:58.656777 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:02:58.656777 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:02:58.656777 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:02:58.656777 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:02:58.656777 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:02:58.656777 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:02:58.656777 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:02:58.656777 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:02:58.656777 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:02:58.656777 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:02:58.656777 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:02:58.656777 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:02:58.656777 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:02:58.656777 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:02:58.656777 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:02:58.657800 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:02:58.657800 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:02:58.657800 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:02:58.657800 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:02:58.657800 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:02:58.657800 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:02:58.657800 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:02:58.657800 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:02:58.657800 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:02:58.657800 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:02:58.657800 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:02:58.657800 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application with Lock( Sep 05 12:02:58.657800 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:02:58.657800 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:02:58.657800 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:02:58.657800 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:02:58.658600 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:02:58.658600 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:02:58.658600 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:02:58.658600 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:02:58.658600 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:02:58.658600 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:02:58.658600 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:02:58.658600 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:02:58.658600 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:02:58.658600 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:02:58.658600 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 05 12:02:58.658600 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:02:58.666417 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 86/172] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Sep 5 12:02:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:02:58.672565 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4889a5-b337-4bad-a491-dadda820b188 None None] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:58.673280 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4889a5-b337-4bad-a491-dadda820b188 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:58.673749 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4889a5-b337-4bad-a491-dadda820b188 None None] PATH_INFO: `/` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:58.675362 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 87/173] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:02:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:02:58.676284 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4889a5-b337-4bad-a491-dadda820b188 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:02:58.695839 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:02:58.741904 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65213579-0605-4f70-b5e0-c18cbaf15e6c None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:02:58.822735 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec25be9-01f1-4a77-adba-f2ee23d1a0d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:02:58.823389 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec25be9-01f1-4a77-adba-f2ee23d1a0d6 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:58.823668 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec25be9-01f1-4a77-adba-f2ee23d1a0d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:58.823943 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec25be9-01f1-4a77-adba-f2ee23d1a0d6 None admin] PATH_INFO: `/v3/users/ac2a596dc1524e7497011a613536dd9e` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:58.825782 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec25be9-01f1-4a77-adba-f2ee23d1a0d6 None admin] RBAC: Authorizing `identity:get_user(user_id=ac2a596dc1524e7497011a613536dd9e)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:02:58.827546 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec25be9-01f1-4a77-adba-f2ee23d1a0d6 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:02:58.832980 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 87/174] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Sep 5 12:02:58 2022] GET /identity/v3/users/ac2a596dc1524e7497011a613536dd9e => generated 289 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:02:58.832980 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b4c1e0-db0a-409c-8ecd-69e7e09dfbbf None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:58.832980 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b4c1e0-db0a-409c-8ecd-69e7e09dfbbf None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:58.832980 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b4c1e0-db0a-409c-8ecd-69e7e09dfbbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:58.852748 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4889a5-b337-4bad-a491-dadda820b188 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:02:58.853903 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-20b4c1e0-db0a-409c-8ecd-69e7e09dfbbf None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:02:58.855116 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-20b4c1e0-db0a-409c-8ecd-69e7e09dfbbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:02:58.884541 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:02:58.917050 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b12a01-e85c-4c94-8c1c-feed9ed7479e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:02:58.917447 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b12a01-e85c-4c94-8c1c-feed9ed7479e None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:58.917733 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b12a01-e85c-4c94-8c1c-feed9ed7479e None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:58.917882 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b12a01-e85c-4c94-8c1c-feed9ed7479e None admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:58.919131 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b12a01-e85c-4c94-8c1c-feed9ed7479e None admin] RBAC: Adding query filter params (name=member) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:02:58.919440 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b12a01-e85c-4c94-8c1c-feed9ed7479e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:02:58.920850 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b12a01-e85c-4c94-8c1c-feed9ed7479e None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:02:58.937024 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 88/175] 10.222.0.50 () {56 vars in 1101 bytes} [Mon Sep 5 12:02:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:02:58.937024 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b12a01-e85c-4c94-8c1c-feed9ed7479e None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:02:58.985283 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 88/176] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:02:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:02:58.986903 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b4c1e0-db0a-409c-8ecd-69e7e09dfbbf None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:02:59.060026 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:02:59.110072 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b12a01-e85c-4c94-8c1c-feed9ed7479e None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:02:59.153664 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b4c1e0-db0a-409c-8ecd-69e7e09dfbbf None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:02:59.156288 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef783468-41ef-45e9-8e78-5d4c2e5257eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:02:59.157098 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef783468-41ef-45e9-8e78-5d4c2e5257eb None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:59.157560 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef783468-41ef-45e9-8e78-5d4c2e5257eb None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:59.158000 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef783468-41ef-45e9-8e78-5d4c2e5257eb None admin] PATH_INFO: `/v3/projects/2370f3588c6e4c5798f29493d9842333` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:59.159472 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef783468-41ef-45e9-8e78-5d4c2e5257eb None admin] RBAC: Authorizing `identity:get_project(project_id=2370f3588c6e4c5798f29493d9842333)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:02:59.161056 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef783468-41ef-45e9-8e78-5d4c2e5257eb None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:02:59.169770 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 89/177] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Sep 5 12:02:58 2022] GET /identity/v3/projects/2370f3588c6e4c5798f29493d9842333 => generated 298 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:02:59.169770 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d3193a-2261-4b95-bf93-22d7fd21f777 None None] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:59.169770 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d3193a-2261-4b95-bf93-22d7fd21f777 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:59.169770 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d3193a-2261-4b95-bf93-22d7fd21f777 None None] PATH_INFO: `/` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:59.169770 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 90/178] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:02:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:02:59.170470 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5a050b-2923-4e3b-82f7-3bf7d57f2ccc None None] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:59.170470 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5a050b-2923-4e3b-82f7-3bf7d57f2ccc None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:59.170717 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5a050b-2923-4e3b-82f7-3bf7d57f2ccc None None] PATH_INFO: `/` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:59.171890 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 91/179] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:02:59 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:02:59.174440 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5a050b-2923-4e3b-82f7-3bf7d57f2ccc None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:02:59.205060 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fa6798-fb57-48d8-82e7-442be7c3ea1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:02:59.206045 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fa6798-fb57-48d8-82e7-442be7c3ea1c None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:59.206494 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fa6798-fb57-48d8-82e7-442be7c3ea1c None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:59.206936 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fa6798-fb57-48d8-82e7-442be7c3ea1c None admin] PATH_INFO: `/v3/users/5f0c885f940345c6b98a71ea1ff0ff13` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:59.208581 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fa6798-fb57-48d8-82e7-442be7c3ea1c None admin] RBAC: Authorizing `identity:get_user(user_id=5f0c885f940345c6b98a71ea1ff0ff13)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:02:59.211059 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fa6798-fb57-48d8-82e7-442be7c3ea1c None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:02:59.213700 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 89/180] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Sep 5 12:02:58 2022] GET /identity/v3/users/5f0c885f940345c6b98a71ea1ff0ff13 => generated 275 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:02:59.218621 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a98ea0-4916-43eb-b3f1-db85157d7075 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:59.219143 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a98ea0-4916-43eb-b3f1-db85157d7075 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:59.219928 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a98ea0-4916-43eb-b3f1-db85157d7075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:59.239192 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-16a98ea0-4916-43eb-b3f1-db85157d7075 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:02:59.240391 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-16a98ea0-4916-43eb-b3f1-db85157d7075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:02:59.258405 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:02:59.301401 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5a050b-2923-4e3b-82f7-3bf7d57f2ccc None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:02:59.310993 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 90/181] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:02:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:02:59.312167 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6509ea82-804b-468d-a248-4193490e3df5 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:59.312454 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6509ea82-804b-468d-a248-4193490e3df5 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:59.312723 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6509ea82-804b-468d-a248-4193490e3df5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:59.330478 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-6509ea82-804b-468d-a248-4193490e3df5 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:02:59.331669 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-6509ea82-804b-468d-a248-4193490e3df5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:02:59.338698 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d558620-ec49-41be-9209-460e3b509a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:02:59.339668 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d558620-ec49-41be-9209-460e3b509a7b None admin] REQUEST_METHOD: `PUT` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:59.340154 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d558620-ec49-41be-9209-460e3b509a7b None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:59.341106 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d558620-ec49-41be-9209-460e3b509a7b None admin] PATH_INFO: `/v3/projects/2370f3588c6e4c5798f29493d9842333/users/ac2a596dc1524e7497011a613536dd9e/roles/7759eb25e244436aa0b1be6aee7ebd1e` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:59.343422 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d558620-ec49-41be-9209-460e3b509a7b None admin] RBAC: Authorizing `identity:create_grant(project_id=2370f3588c6e4c5798f29493d9842333, user_id=ac2a596dc1524e7497011a613536dd9e, role_id=7759eb25e244436aa0b1be6aee7ebd1e)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:02:59.344886 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d558620-ec49-41be-9209-460e3b509a7b None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:02:59.353980 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:02:59.372992 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 92/182] 10.222.0.50 () {58 vars in 1439 bytes} [Mon Sep 5 12:02:59 2022] PUT /identity/v3/projects/2370f3588c6e4c5798f29493d9842333/users/ac2a596dc1524e7497011a613536dd9e/roles/7759eb25e244436aa0b1be6aee7ebd1e => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:02:59.374059 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d558620-ec49-41be-9209-460e3b509a7b None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:02:59.411710 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 91/183] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:02:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:02:59.412389 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6509ea82-804b-468d-a248-4193490e3df5 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:02:59.511176 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:02:59.529355 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d558620-ec49-41be-9209-460e3b509a7b None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:02:59.543712 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6509ea82-804b-468d-a248-4193490e3df5 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:02:59.574224 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5423d5b4-84ca-4e31-bf4c-c2ea76a0e7c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:02:59.575399 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5423d5b4-84ca-4e31-bf4c-c2ea76a0e7c4 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:59.575761 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5423d5b4-84ca-4e31-bf4c-c2ea76a0e7c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:59.576041 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5423d5b4-84ca-4e31-bf4c-c2ea76a0e7c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:59.588828 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d9085e-9084-48b4-9cc7-09e47f628c14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:02:59.590308 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d9085e-9084-48b4-9cc7-09e47f628c14 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:59.590799 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d9085e-9084-48b4-9cc7-09e47f628c14 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:59.592045 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d9085e-9084-48b4-9cc7-09e47f628c14 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:59.606040 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d9085e-9084-48b4-9cc7-09e47f628c14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:02:59.614203 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-56d9085e-9084-48b4-9cc7-09e47f628c14 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 12:02:59.614203 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:02:59.614203 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:02:59.614203 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:02:59.614203 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:02:59.614203 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:02:59.614203 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:02:59.614203 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:02:59.614203 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:02:59.614203 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:02:59.614203 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:02:59.614203 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:02:59.614203 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:02:59.614203 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:02:59.614203 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:02:59.614203 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:02:59.615127 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:02:59.615127 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:02:59.615127 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:02:59.615127 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:02:59.615127 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:02:59.615127 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:02:59.615127 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:02:59.615127 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:02:59.615127 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:02:59.615127 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:02:59.615127 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:02:59.615127 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:02:59.615127 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:02:59.615127 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:02:59.615127 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:02:59.615127 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:02:59.615984 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:02:59.615984 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:02:59.615984 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:02:59.615984 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:02:59.615984 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:02:59.615984 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:02:59.615984 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:02:59.615984 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:02:59.615984 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:02:59.615984 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:02:59.615984 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 12:02:59.615984 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:02:59.622277 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 92/184] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Sep 5 12:02:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:02:59.635263 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d9085e-9084-48b4-9cc7-09e47f628c14 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:02:59.674277 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:02:59.677979 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5423d5b4-84ca-4e31-bf4c-c2ea76a0e7c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:02:59.680761 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5423d5b4-84ca-4e31-bf4c-c2ea76a0e7c4 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:02:59.754011 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d9085e-9084-48b4-9cc7-09e47f628c14 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:02:59.799214 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a029a1b3-1b92-4e44-9453-ee10800b90f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:02:59.799835 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a029a1b3-1b92-4e44-9453-ee10800b90f7 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:59.800117 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a029a1b3-1b92-4e44-9453-ee10800b90f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:59.800388 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a029a1b3-1b92-4e44-9453-ee10800b90f7 None admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:59.801105 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a029a1b3-1b92-4e44-9453-ee10800b90f7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:02:59.801404 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a029a1b3-1b92-4e44-9453-ee10800b90f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:02:59.802807 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a029a1b3-1b92-4e44-9453-ee10800b90f7 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:02:59.812645 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 93/185] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Sep 5 12:02:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:02:59.813158 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a029a1b3-1b92-4e44-9453-ee10800b90f7 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:02:59.822738 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:02:59.823538 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 93/186] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Sep 5 12:02:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 12:02:59.825276 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5423d5b4-84ca-4e31-bf4c-c2ea76a0e7c4 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:02:59.937514 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a029a1b3-1b92-4e44-9453-ee10800b90f7 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:02:59.938841 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:02:59.942316 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5423d5b4-84ca-4e31-bf4c-c2ea76a0e7c4 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:02:59.976385 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbfca1a-7b2a-493c-9b76-81b652dbcedc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:02:59.977160 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbfca1a-7b2a-493c-9b76-81b652dbcedc None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:59.977281 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f366a2-3d8e-466e-8c60-2c46b49a14cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:02:59.977488 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbfca1a-7b2a-493c-9b76-81b652dbcedc None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:59.977705 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbfca1a-7b2a-493c-9b76-81b652dbcedc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:59.977810 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f366a2-3d8e-466e-8c60-2c46b49a14cf None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:02:59.978065 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f366a2-3d8e-466e-8c60-2c46b49a14cf None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:02:59.978339 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f366a2-3d8e-466e-8c60-2c46b49a14cf None admin] PATH_INFO: `/v3/domains/default` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:02:59.979463 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f366a2-3d8e-466e-8c60-2c46b49a14cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:02:59.981423 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f366a2-3d8e-466e-8c60-2c46b49a14cf None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:02:59.983210 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 94/187] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 5 12:02:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:02:59.983868 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f366a2-3d8e-466e-8c60-2c46b49a14cf None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:02:59.993170 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbfca1a-7b2a-493c-9b76-81b652dbcedc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:02:59.999853 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-dcbfca1a-7b2a-493c-9b76-81b652dbcedc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 05 12:02:59.999853 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:02:59.999853 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:02:59.999853 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:02:59.999853 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:02:59.999853 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:02:59.999853 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:02:59.999853 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:02:59.999853 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:02:59.999853 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:02:59.999853 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:02:59.999853 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:02:59.999853 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:02:59.999853 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:02:59.999853 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:02:59.999853 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:03:00.000770 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:03:00.000770 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:03:00.000770 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:03:00.000770 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:03:00.000770 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:03:00.000770 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:03:00.000770 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:03:00.000770 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:03:00.000770 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:03:00.000770 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:03:00.000770 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:03:00.000770 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:03:00.000770 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:03:00.000770 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:03:00.000770 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:03:00.000770 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:03:00.001605 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:03:00.001605 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:03:00.001605 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:03:00.001605 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:03:00.001605 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:03:00.001605 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:03:00.001605 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:03:00.001605 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:03:00.001605 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:03:00.001605 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:03:00.001605 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 05 12:03:00.001605 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:03:00.001605 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 94/188] 10.222.0.50 () {56 vars in 1114 bytes} [Mon Sep 5 12:02:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:03:00.002279 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbfca1a-7b2a-493c-9b76-81b652dbcedc None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:00.066835 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:00.102804 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f366a2-3d8e-466e-8c60-2c46b49a14cf None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:00.107856 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbfca1a-7b2a-493c-9b76-81b652dbcedc None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:00.141022 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878b2a12-fa58-43e6-b360-ea69c24701d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:00.141788 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878b2a12-fa58-43e6-b360-ea69c24701d2 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:00.142054 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878b2a12-fa58-43e6-b360-ea69c24701d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:00.142329 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878b2a12-fa58-43e6-b360-ea69c24701d2 None admin] PATH_INFO: `/v3/projects/a42b9aa568b143b3a7550b45df2a4858` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:00.143437 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878b2a12-fa58-43e6-b360-ea69c24701d2 None admin] RBAC: Authorizing `identity:get_project(project_id=a42b9aa568b143b3a7550b45df2a4858)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:00.144674 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf240f4-e3a2-41a8-a5f9-b395b5f70875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:00.144919 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878b2a12-fa58-43e6-b360-ea69c24701d2 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:00.145329 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf240f4-e3a2-41a8-a5f9-b395b5f70875 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:00.145662 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf240f4-e3a2-41a8-a5f9-b395b5f70875 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:00.145933 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf240f4-e3a2-41a8-a5f9-b395b5f70875 None admin] PATH_INFO: `/v3/users/fe83b9be43e14e3f87de1cb92df473cf` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:00.146555 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 95/189] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Sep 5 12:03:00 2022] GET /identity/v3/projects/a42b9aa568b143b3a7550b45df2a4858 => generated 312 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:00.147304 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878b2a12-fa58-43e6-b360-ea69c24701d2 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:00.166404 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf240f4-e3a2-41a8-a5f9-b395b5f70875 None admin] RBAC: Authorizing `identity:get_user(user_id=fe83b9be43e14e3f87de1cb92df473cf)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:00.168181 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf240f4-e3a2-41a8-a5f9-b395b5f70875 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:00.177753 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 95/190] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Sep 5 12:02:59 2022] GET /identity/v3/users/fe83b9be43e14e3f87de1cb92df473cf => generated 283 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:00.177753 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf240f4-e3a2-41a8-a5f9-b395b5f70875 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:00.202509 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:00.268409 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878b2a12-fa58-43e6-b360-ea69c24701d2 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:00.278756 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf240f4-e3a2-41a8-a5f9-b395b5f70875 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:00.300642 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:00.307309 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85c3a58-08fc-4f36-94e0-d11fb69131ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:00.307870 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85c3a58-08fc-4f36-94e0-d11fb69131ef None admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:00.308151 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85c3a58-08fc-4f36-94e0-d11fb69131ef None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:00.308451 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85c3a58-08fc-4f36-94e0-d11fb69131ef None admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:00.309184 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85c3a58-08fc-4f36-94e0-d11fb69131ef None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:00.310637 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85c3a58-08fc-4f36-94e0-d11fb69131ef None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:00.317233 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c7b7ed-8f99-4e72-beb4-24ba8ec92408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:00.318396 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c7b7ed-8f99-4e72-beb4-24ba8ec92408 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:00.318869 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c7b7ed-8f99-4e72-beb4-24ba8ec92408 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:00.319319 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c7b7ed-8f99-4e72-beb4-24ba8ec92408 None admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:00.320179 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c7b7ed-8f99-4e72-beb4-24ba8ec92408 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:03:00.320691 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c7b7ed-8f99-4e72-beb4-24ba8ec92408 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:00.322476 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c7b7ed-8f99-4e72-beb4-24ba8ec92408 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:00.331911 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 96/191] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Sep 5 12:03:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:00.336811 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 96/192] 10.222.0.50 () {60 vars in 1132 bytes} [Mon Sep 5 12:03:00 2022] POST /identity/v3/users => generated 297 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:03:00.336811 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85c3a58-08fc-4f36-94e0-d11fb69131ef None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:00.338092 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c7b7ed-8f99-4e72-beb4-24ba8ec92408 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:00.466579 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:00.480568 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c7b7ed-8f99-4e72-beb4-24ba8ec92408 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:00.485375 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85c3a58-08fc-4f36-94e0-d11fb69131ef None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:00.530621 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bb2417-dce2-494e-87e1-b41cb8ed2436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:00.531467 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bb2417-dce2-494e-87e1-b41cb8ed2436 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:00.531835 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bb2417-dce2-494e-87e1-b41cb8ed2436 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:00.532179 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bb2417-dce2-494e-87e1-b41cb8ed2436 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:00.533592 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e1d3ff-9b69-44ca-969f-af8d627f37b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:00.534277 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e1d3ff-9b69-44ca-969f-af8d627f37b3 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:00.534675 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e1d3ff-9b69-44ca-969f-af8d627f37b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:00.535020 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e1d3ff-9b69-44ca-969f-af8d627f37b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:00.537203 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e1d3ff-9b69-44ca-969f-af8d627f37b3 None admin] RBAC: Adding query filter params (role.id=ed72181e1403401facb77dcf33644757, scope.project.id=a42b9aa568b143b3a7550b45df2a4858, user.id=5f0c885f940345c6b98a71ea1ff0ff13) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:03:00.537338 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e1d3ff-9b69-44ca-969f-af8d627f37b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:00.538921 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e1d3ff-9b69-44ca-969f-af8d627f37b3 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:00.548577 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 97/193] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Sep 5 12:03:00 2022] GET /identity/v3/role_assignments?user.id=5f0c885f940345c6b98a71ea1ff0ff13&scope.project.id=a42b9aa568b143b3a7550b45df2a4858&role.id=ed72181e1403401facb77dcf33644757 => generated 608 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:00.549772 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e1d3ff-9b69-44ca-969f-af8d627f37b3 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:00.634641 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:00.640140 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bb2417-dce2-494e-87e1-b41cb8ed2436 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:00.641833 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bb2417-dce2-494e-87e1-b41cb8ed2436 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:00.715705 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e1d3ff-9b69-44ca-969f-af8d627f37b3 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:00.765519 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:00.766796 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8507d7-d218-4eb4-aed0-ab4535089a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:00.767647 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8507d7-d218-4eb4-aed0-ab4535089a25 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:00.768998 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8507d7-d218-4eb4-aed0-ab4535089a25 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:00.769492 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8507d7-d218-4eb4-aed0-ab4535089a25 None admin] PATH_INFO: `/v3/users/fe83b9be43e14e3f87de1cb92df473cf` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:00.771040 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8507d7-d218-4eb4-aed0-ab4535089a25 None admin] RBAC: Authorizing `identity:get_user(user_id=fe83b9be43e14e3f87de1cb92df473cf)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:00.773381 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8507d7-d218-4eb4-aed0-ab4535089a25 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:00.776262 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 98/194] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Sep 5 12:03:00 2022] GET /identity/v3/users/fe83b9be43e14e3f87de1cb92df473cf => generated 283 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:00.787840 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8507d7-d218-4eb4-aed0-ab4535089a25 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:00.791992 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 97/195] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Sep 5 12:03:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 12:03:00.798041 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bb2417-dce2-494e-87e1-b41cb8ed2436 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:00.936834 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8507d7-d218-4eb4-aed0-ab4535089a25 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:00.944324 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bb2417-dce2-494e-87e1-b41cb8ed2436 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:00.963266 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:00.977913 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c673b91-98f8-4ea4-aec8-0e6e8fbce364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:00.978642 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c673b91-98f8-4ea4-aec8-0e6e8fbce364 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:00.978933 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c673b91-98f8-4ea4-aec8-0e6e8fbce364 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:00.979320 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c673b91-98f8-4ea4-aec8-0e6e8fbce364 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:00.988059 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9e9a7a-60a2-4e89-9650-dd0147496589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:00.988705 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9e9a7a-60a2-4e89-9650-dd0147496589 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:00.989016 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9e9a7a-60a2-4e89-9650-dd0147496589 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:00.989287 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9e9a7a-60a2-4e89-9650-dd0147496589 None admin] PATH_INFO: `/v3/projects/b6c350f1ed014cad89f2c125d5de6e1e` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:00.990487 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9e9a7a-60a2-4e89-9650-dd0147496589 None admin] RBAC: Authorizing `identity:get_project(project_id=b6c350f1ed014cad89f2c125d5de6e1e)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:00.991945 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9e9a7a-60a2-4e89-9650-dd0147496589 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:00.993848 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 98/196] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Sep 5 12:03:00 2022] GET /identity/v3/projects/b6c350f1ed014cad89f2c125d5de6e1e => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:01.000570 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9e9a7a-60a2-4e89-9650-dd0147496589 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:01.064355 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c673b91-98f8-4ea4-aec8-0e6e8fbce364 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:01.069341 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:01.073633 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c673b91-98f8-4ea4-aec8-0e6e8fbce364 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:01.119072 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9e9a7a-60a2-4e89-9650-dd0147496589 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:01.156641 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca14ac06-2c7a-4ed5-be29-3b4e7ba951c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:01.157292 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca14ac06-2c7a-4ed5-be29-3b4e7ba951c5 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:01.157571 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca14ac06-2c7a-4ed5-be29-3b4e7ba951c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:01.157840 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca14ac06-2c7a-4ed5-be29-3b4e7ba951c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:01.158572 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca14ac06-2c7a-4ed5-be29-3b4e7ba951c5 None admin] RBAC: Adding query filter params (role.id=16e2ccc8bd1b497d8cee780c1c7df0d2, scope.project.id=b6c350f1ed014cad89f2c125d5de6e1e, user.id=fe83b9be43e14e3f87de1cb92df473cf) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:03:01.158876 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca14ac06-2c7a-4ed5-be29-3b4e7ba951c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:01.160310 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca14ac06-2c7a-4ed5-be29-3b4e7ba951c5 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:01.166466 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 99/197] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Sep 5 12:03:00 2022] GET /identity/v3/role_assignments?user.id=fe83b9be43e14e3f87de1cb92df473cf&scope.project.id=b6c350f1ed014cad89f2c125d5de6e1e&role.id=16e2ccc8bd1b497d8cee780c1c7df0d2 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:03:01.291969 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 99/198] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Sep 5 12:03:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 05 12:03:01.298214 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca14ac06-2c7a-4ed5-be29-3b4e7ba951c5 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:01.455074 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca14ac06-2c7a-4ed5-be29-3b4e7ba951c5 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:01.484919 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:01.500633 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b41257-1e16-4999-90fb-ab5f06ab586e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:01.501656 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b41257-1e16-4999-90fb-ab5f06ab586e None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:01.502148 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b41257-1e16-4999-90fb-ab5f06ab586e None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:01.502610 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b41257-1e16-4999-90fb-ab5f06ab586e None admin] PATH_INFO: `/v3/projects/b6c350f1ed014cad89f2c125d5de6e1e` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:01.503943 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b41257-1e16-4999-90fb-ab5f06ab586e None admin] RBAC: Authorizing `identity:get_project(project_id=b6c350f1ed014cad89f2c125d5de6e1e)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:01.505640 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b41257-1e16-4999-90fb-ab5f06ab586e None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:01.507489 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 100/199] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Sep 5 12:03:01 2022] GET /identity/v3/projects/b6c350f1ed014cad89f2c125d5de6e1e => generated 302 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:01.513575 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c673b91-98f8-4ea4-aec8-0e6e8fbce364 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:01.536504 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:01.636272 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c673b91-98f8-4ea4-aec8-0e6e8fbce364 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:01.653821 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b8e2ae-10e9-4c44-89ea-c1ce612814e2 None None] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:01.654466 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b8e2ae-10e9-4c44-89ea-c1ce612814e2 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:01.654932 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b8e2ae-10e9-4c44-89ea-c1ce612814e2 None None] PATH_INFO: `/` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:01.656505 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 101/200] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:03:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 12:03:01.666343 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65033a18-51c3-4129-b44a-fcfb8cfff9b6 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:01.666933 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65033a18-51c3-4129-b44a-fcfb8cfff9b6 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:01.667392 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65033a18-51c3-4129-b44a-fcfb8cfff9b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:01.697033 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-65033a18-51c3-4129-b44a-fcfb8cfff9b6 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:03:01.699803 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-65033a18-51c3-4129-b44a-fcfb8cfff9b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:03:01.707399 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19d79dc-f135-47cb-b268-cb3c5bb391ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:01.708276 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19d79dc-f135-47cb-b268-cb3c5bb391ce None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:01.708758 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19d79dc-f135-47cb-b268-cb3c5bb391ce None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:01.709249 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19d79dc-f135-47cb-b268-cb3c5bb391ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:01.710190 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19d79dc-f135-47cb-b268-cb3c5bb391ce None admin] RBAC: Adding query filter params (role.id=bf853a508574493f9bc7d85f3c3b36fd, scope.project.id=b6c350f1ed014cad89f2c125d5de6e1e, user.id=fe83b9be43e14e3f87de1cb92df473cf) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:03:01.710688 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19d79dc-f135-47cb-b268-cb3c5bb391ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:01.712324 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19d79dc-f135-47cb-b268-cb3c5bb391ce None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:01.722538 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 100/201] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Sep 5 12:03:01 2022] GET /identity/v3/role_assignments?user.id=fe83b9be43e14e3f87de1cb92df473cf&scope.project.id=b6c350f1ed014cad89f2c125d5de6e1e&role.id=bf853a508574493f9bc7d85f3c3b36fd => generated 259 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:01.800231 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 102/202] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:03:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 05 12:03:02.125789 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19d79dc-f135-47cb-b268-cb3c5bb391ce None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:02.244114 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:02.260919 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19d79dc-f135-47cb-b268-cb3c5bb391ce None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:02.296746 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394c5dc1-1e06-4c77-974e-c05ad4fa29b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:02.297424 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394c5dc1-1e06-4c77-974e-c05ad4fa29b7 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:02.297680 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394c5dc1-1e06-4c77-974e-c05ad4fa29b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:02.297951 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394c5dc1-1e06-4c77-974e-c05ad4fa29b7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:02.308424 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394c5dc1-1e06-4c77-974e-c05ad4fa29b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:03:02.313896 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-394c5dc1-1e06-4c77-974e-c05ad4fa29b7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 05 12:03:02.313896 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:03:02.313896 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:03:02.313896 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:03:02.313896 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:03:02.313896 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:03:02.313896 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:03:02.313896 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:03:02.313896 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:03:02.313896 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:03:02.313896 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:03:02.313896 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:03:02.313896 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:03:02.313896 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:03:02.313896 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:03:02.313896 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:03:02.314779 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:03:02.314779 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:03:02.314779 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:03:02.314779 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:03:02.314779 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:03:02.314779 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:03:02.314779 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:03:02.314779 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:03:02.314779 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:03:02.314779 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:03:02.314779 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:03:02.314779 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:03:02.314779 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:03:02.314779 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:03:02.314779 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:03:02.314779 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:03:02.315584 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:03:02.315584 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:03:02.315584 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:03:02.315584 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:03:02.315584 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:03:02.315584 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:03:02.315584 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:03:02.315584 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:03:02.315584 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:03:02.315584 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:03:02.315584 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 05 12:03:02.315584 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:03:02.315584 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 101/203] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Sep 5 12:03:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:03:02.326010 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65033a18-51c3-4129-b44a-fcfb8cfff9b6 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:02.469293 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65033a18-51c3-4129-b44a-fcfb8cfff9b6 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:02.489546 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:02.508362 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326d4f67-14f1-4f5f-8fc8-657990e624d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:02.509033 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326d4f67-14f1-4f5f-8fc8-657990e624d7 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:02.509318 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326d4f67-14f1-4f5f-8fc8-657990e624d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:02.509594 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326d4f67-14f1-4f5f-8fc8-657990e624d7 None admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:02.510293 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326d4f67-14f1-4f5f-8fc8-657990e624d7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:03:02.510601 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326d4f67-14f1-4f5f-8fc8-657990e624d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:02.512580 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326d4f67-14f1-4f5f-8fc8-657990e624d7 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:02.522195 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 103/204] 10.222.0.50 () {56 vars in 1101 bytes} [Mon Sep 5 12:03:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:02.528080 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394c5dc1-1e06-4c77-974e-c05ad4fa29b7 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:02.695251 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394c5dc1-1e06-4c77-974e-c05ad4fa29b7 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:02.748663 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaa3f7c-f998-4d42-a5c5-4605912897d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:02.749258 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaa3f7c-f998-4d42-a5c5-4605912897d6 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:02.749539 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaa3f7c-f998-4d42-a5c5-4605912897d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:02.749814 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaa3f7c-f998-4d42-a5c5-4605912897d6 None admin] PATH_INFO: `/v3/users/ac2a596dc1524e7497011a613536dd9e` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:02.750980 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaa3f7c-f998-4d42-a5c5-4605912897d6 None admin] RBAC: Authorizing `identity:get_user(user_id=ac2a596dc1524e7497011a613536dd9e)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:02.752447 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaa3f7c-f998-4d42-a5c5-4605912897d6 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:02.754076 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 102/205] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Sep 5 12:03:02 2022] GET /identity/v3/users/ac2a596dc1524e7497011a613536dd9e => generated 289 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:02.759997 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326d4f67-14f1-4f5f-8fc8-657990e624d7 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:02.915218 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326d4f67-14f1-4f5f-8fc8-657990e624d7 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:02.962601 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb62e50a-ad58-4c51-9a49-5b3d85373bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:02.963629 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb62e50a-ad58-4c51-9a49-5b3d85373bff None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:02.964113 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb62e50a-ad58-4c51-9a49-5b3d85373bff None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:02.964581 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb62e50a-ad58-4c51-9a49-5b3d85373bff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:03.032501 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:03.059720 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1ae166-d088-45ee-a9cc-1df691dff899 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:03.060052 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1ae166-d088-45ee-a9cc-1df691dff899 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:03.060279 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1ae166-d088-45ee-a9cc-1df691dff899 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:03.061659 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 103/206] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:03:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:03:03.062440 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb62e50a-ad58-4c51-9a49-5b3d85373bff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:03.064192 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb62e50a-ad58-4c51-9a49-5b3d85373bff None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:03.070239 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2f8db6-0f98-405e-a240-c81a312b6384 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:03.070524 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2f8db6-0f98-405e-a240-c81a312b6384 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:03.070800 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2f8db6-0f98-405e-a240-c81a312b6384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:03.106686 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-0c2f8db6-0f98-405e-a240-c81a312b6384 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:03:03.107911 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-0c2f8db6-0f98-405e-a240-c81a312b6384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:03:03.125349 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:03.200868 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 104/207] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Sep 5 12:03:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 12:03:03.209923 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb62e50a-ad58-4c51-9a49-5b3d85373bff None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:03.214816 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 104/208] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:03:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:03:03.246999 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1daee49-e7e0-4fbb-8b24-fadc07cc174f None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:03.247470 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1daee49-e7e0-4fbb-8b24-fadc07cc174f None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:03.247844 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1daee49-e7e0-4fbb-8b24-fadc07cc174f None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:03.249476 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 105/209] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:03:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 12:03:03.254681 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6165be00-e029-4784-b52e-83be06870796 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:03.254971 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6165be00-e029-4784-b52e-83be06870796 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:03.255246 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6165be00-e029-4784-b52e-83be06870796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:03.291049 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-6165be00-e029-4784-b52e-83be06870796 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:03:03.294727 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-6165be00-e029-4784-b52e-83be06870796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:03:03.337067 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:03.361244 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb62e50a-ad58-4c51-9a49-5b3d85373bff None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:03.391807 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 106/210] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:03:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:03:03.411443 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276adf7f-27d9-47c4-bb33-73c1a844b398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:03.412323 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276adf7f-27d9-47c4-bb33-73c1a844b398 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:03.412754 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276adf7f-27d9-47c4-bb33-73c1a844b398 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:03.413193 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276adf7f-27d9-47c4-bb33-73c1a844b398 None admin] PATH_INFO: `/v3/projects/2370f3588c6e4c5798f29493d9842333` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:03.416677 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276adf7f-27d9-47c4-bb33-73c1a844b398 None admin] RBAC: Authorizing `identity:get_project(project_id=2370f3588c6e4c5798f29493d9842333)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:03.418944 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276adf7f-27d9-47c4-bb33-73c1a844b398 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:03.421088 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 105/211] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Sep 5 12:03:03 2022] GET /identity/v3/projects/2370f3588c6e4c5798f29493d9842333 => generated 298 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:03.427118 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6165be00-e029-4784-b52e-83be06870796 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:03.520443 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:03.553150 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6165be00-e029-4784-b52e-83be06870796 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:03.589557 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8815806a-92af-495e-8f51-96023cb579cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:03.590721 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8815806a-92af-495e-8f51-96023cb579cc None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:03.591000 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8815806a-92af-495e-8f51-96023cb579cc None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:03.591270 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8815806a-92af-495e-8f51-96023cb579cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:03.591999 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8815806a-92af-495e-8f51-96023cb579cc None admin] RBAC: Adding query filter params (role.id=7759eb25e244436aa0b1be6aee7ebd1e, scope.project.id=2370f3588c6e4c5798f29493d9842333, user.id=ac2a596dc1524e7497011a613536dd9e) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:03:03.592304 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8815806a-92af-495e-8f51-96023cb579cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:03.593800 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8815806a-92af-495e-8f51-96023cb579cc None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:03.600254 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 107/212] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Sep 5 12:03:03 2022] GET /identity/v3/role_assignments?user.id=ac2a596dc1524e7497011a613536dd9e&scope.project.id=2370f3588c6e4c5798f29493d9842333&role.id=7759eb25e244436aa0b1be6aee7ebd1e => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:03.620231 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276adf7f-27d9-47c4-bb33-73c1a844b398 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:03.748167 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276adf7f-27d9-47c4-bb33-73c1a844b398 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:03.749442 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8815806a-92af-495e-8f51-96023cb579cc None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:03.803101 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3da4d2-a4e1-479c-9c04-29c7cd25de3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:03.803793 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3da4d2-a4e1-479c-9c04-29c7cd25de3e None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:03.804017 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3da4d2-a4e1-479c-9c04-29c7cd25de3e None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:03.804289 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3da4d2-a4e1-479c-9c04-29c7cd25de3e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:03.816490 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3da4d2-a4e1-479c-9c04-29c7cd25de3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:03:03.821693 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application [None req-4f3da4d2-a4e1-479c-9c04-29c7cd25de3e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 05 12:03:03.821693 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:03:03.821693 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:03:03.821693 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:03:03.821693 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:03:03.821693 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:03:03.821693 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:03:03.821693 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:03:03.821693 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:03:03.821693 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:03:03.821693 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:03:03.821693 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:03:03.821693 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:03:03.821693 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:03:03.821693 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:03:03.821693 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:03:03.822811 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:03:03.822811 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:03:03.822811 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:03:03.822811 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:03:03.822811 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:03:03.822811 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:03:03.822811 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:03:03.822811 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:03:03.822811 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:03:03.822811 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:03:03.822811 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:03:03.822811 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application with Lock( Sep 05 12:03:03.822811 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:03:03.822811 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:03:03.822811 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:03:03.822811 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:03:03.823819 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:03:03.823819 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:03:03.823819 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:03:03.823819 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:03:03.823819 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:03:03.823819 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:03:03.823819 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:03:03.823819 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:03:03.823819 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:03:03.823819 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:03:03.823819 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 05 12:03:03.823819 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:03:03.825959 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 106/213] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Sep 5 12:03:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:03:03.827466 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7f9c3b-651a-4c16-9d0a-12f120958775 None None] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:03.827908 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7f9c3b-651a-4c16-9d0a-12f120958775 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:03.828391 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7f9c3b-651a-4c16-9d0a-12f120958775 None None] PATH_INFO: `/` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:03.829866 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 107/214] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:03:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:03:03.830576 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7f9c3b-651a-4c16-9d0a-12f120958775 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:03.847886 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:03.886348 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8815806a-92af-495e-8f51-96023cb579cc None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:03.937503 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d51208-2ae0-4b61-999d-240db76fe5dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:03.938146 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d51208-2ae0-4b61-999d-240db76fe5dc None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:03.938428 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d51208-2ae0-4b61-999d-240db76fe5dc None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:03.938701 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d51208-2ae0-4b61-999d-240db76fe5dc None admin] PATH_INFO: `/v3/domains/default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:03.940353 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d51208-2ae0-4b61-999d-240db76fe5dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:03.942332 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d51208-2ae0-4b61-999d-240db76fe5dc None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:03.945483 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 108/215] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 5 12:03:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:03.946935 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e2e300-f11b-4673-98f3-5e78d687eec4 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:03.947291 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e2e300-f11b-4673-98f3-5e78d687eec4 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:03.947667 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e2e300-f11b-4673-98f3-5e78d687eec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:03.955486 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:03.966804 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-73e2e300-f11b-4673-98f3-5e78d687eec4 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:03:03.968008 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-73e2e300-f11b-4673-98f3-5e78d687eec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:03:03.972090 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7f9c3b-651a-4c16-9d0a-12f120958775 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:04.009785 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f16eaf-eb62-4a99-a451-15792ab9bfb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:04.010083 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f16eaf-eb62-4a99-a451-15792ab9bfb5 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:04.010325 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f16eaf-eb62-4a99-a451-15792ab9bfb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:04.010598 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f16eaf-eb62-4a99-a451-15792ab9bfb5 None admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:04.011259 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f16eaf-eb62-4a99-a451-15792ab9bfb5 None admin] RBAC: Adding query filter params (name=member) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:03:04.011563 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f16eaf-eb62-4a99-a451-15792ab9bfb5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:04.013592 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f16eaf-eb62-4a99-a451-15792ab9bfb5 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:04.026955 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 108/216] 10.222.0.50 () {56 vars in 1101 bytes} [Mon Sep 5 12:03:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:04.026955 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f16eaf-eb62-4a99-a451-15792ab9bfb5 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:04.042469 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 109/217] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:03:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:03:04.049900 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e2e300-f11b-4673-98f3-5e78d687eec4 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:04.112565 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:04.151411 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f16eaf-eb62-4a99-a451-15792ab9bfb5 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:04.177007 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e2e300-f11b-4673-98f3-5e78d687eec4 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:04.189219 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3959cf-ebd3-498b-b921-9ab087d62248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:04.189838 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3959cf-ebd3-498b-b921-9ab087d62248 None admin] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:04.190255 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3959cf-ebd3-498b-b921-9ab087d62248 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:04.190423 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3959cf-ebd3-498b-b921-9ab087d62248 None admin] PATH_INFO: `/v3/users` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:04.191083 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3959cf-ebd3-498b-b921-9ab087d62248 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:04.192733 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3959cf-ebd3-498b-b921-9ab087d62248 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:04.217691 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 109/218] 10.222.0.50 () {60 vars in 1132 bytes} [Mon Sep 5 12:03:04 2022] POST /identity/v3/users => generated 297 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:03:04.218935 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0123f88-0b89-46e3-b8ee-9983e7b81ec0 None None] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:04.219279 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0123f88-0b89-46e3-b8ee-9983e7b81ec0 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:04.219557 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0123f88-0b89-46e3-b8ee-9983e7b81ec0 None None] PATH_INFO: `/` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:04.220927 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 110/219] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:03:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:03:04.226207 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac3b40f-dd7e-4a71-b255-1afcdd741d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:04.226946 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac3b40f-dd7e-4a71-b255-1afcdd741d0e None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:04.227281 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac3b40f-dd7e-4a71-b255-1afcdd741d0e None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:04.227552 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac3b40f-dd7e-4a71-b255-1afcdd741d0e None admin] PATH_INFO: `/v3/users/c8f4bfc651b845afad41957868c40013` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:04.227995 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fb8bd8-7bc7-4513-be16-4b423640dae3 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:04.228499 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fb8bd8-7bc7-4513-be16-4b423640dae3 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:04.229053 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fb8bd8-7bc7-4513-be16-4b423640dae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:04.230388 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:04.249328 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac3b40f-dd7e-4a71-b255-1afcdd741d0e None admin] RBAC: Authorizing `identity:get_user(user_id=c8f4bfc651b845afad41957868c40013)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:04.250927 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac3b40f-dd7e-4a71-b255-1afcdd741d0e None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:04.252831 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 110/220] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Sep 5 12:03:04 2022] GET /identity/v3/users/c8f4bfc651b845afad41957868c40013 => generated 297 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:04.259097 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac3b40f-dd7e-4a71-b255-1afcdd741d0e None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:04.260260 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-44fb8bd8-7bc7-4513-be16-4b423640dae3 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:03:04.261693 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-44fb8bd8-7bc7-4513-be16-4b423640dae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:03:04.345411 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 111/221] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:03:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:03:04.346733 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fb8bd8-7bc7-4513-be16-4b423640dae3 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:04.389409 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac3b40f-dd7e-4a71-b255-1afcdd741d0e None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:04.431885 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:04.437221 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f16b9e2-95b6-4aff-8c5a-46fccff1d3fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:04.437814 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f16b9e2-95b6-4aff-8c5a-46fccff1d3fc None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:04.438406 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f16b9e2-95b6-4aff-8c5a-46fccff1d3fc None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:04.438406 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f16b9e2-95b6-4aff-8c5a-46fccff1d3fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:04.496017 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fb8bd8-7bc7-4513-be16-4b423640dae3 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:04.531138 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:04.542575 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da151d8b-3792-4c02-b584-50d55619c3f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:04.543752 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da151d8b-3792-4c02-b584-50d55619c3f2 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:04.544036 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da151d8b-3792-4c02-b584-50d55619c3f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:04.544305 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da151d8b-3792-4c02-b584-50d55619c3f2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:04.547492 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f16b9e2-95b6-4aff-8c5a-46fccff1d3fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:04.549048 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f16b9e2-95b6-4aff-8c5a-46fccff1d3fc None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:04.557300 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da151d8b-3792-4c02-b584-50d55619c3f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:03:04.566360 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application [None req-da151d8b-3792-4c02-b584-50d55619c3f2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 12:03:04.566360 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:03:04.566360 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:03:04.566360 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:03:04.566360 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:03:04.566360 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:03:04.566360 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:03:04.566360 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:03:04.566360 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:03:04.566360 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:03:04.566360 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:03:04.566360 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:03:04.566360 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:03:04.566360 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:03:04.566360 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:03:04.566360 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:03:04.567330 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:03:04.567330 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:03:04.567330 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:03:04.567330 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:03:04.567330 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:03:04.567330 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:03:04.567330 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:03:04.567330 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:03:04.567330 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:03:04.567330 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:03:04.567330 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:03:04.567330 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application with Lock( Sep 05 12:03:04.567330 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:03:04.567330 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:03:04.567330 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:03:04.567330 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:03:04.568120 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:03:04.568120 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:03:04.568120 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:03:04.568120 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:03:04.568120 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:03:04.568120 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:03:04.568120 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:03:04.568120 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:03:04.568120 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:03:04.568120 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:03:04.568120 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 12:03:04.568120 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:03:04.569930 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 112/222] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Sep 5 12:03:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:03:04.574477 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da151d8b-3792-4c02-b584-50d55619c3f2 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:04.700996 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 111/223] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Sep 5 12:03:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 12:03:04.700996 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f16b9e2-95b6-4aff-8c5a-46fccff1d3fc None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:04.714537 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da151d8b-3792-4c02-b584-50d55619c3f2 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:04.734386 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:04.754884 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b074af1f-0238-4cbd-ac53-d5061a4f7e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:04.755779 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b074af1f-0238-4cbd-ac53-d5061a4f7e89 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:04.756153 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b074af1f-0238-4cbd-ac53-d5061a4f7e89 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:04.756519 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b074af1f-0238-4cbd-ac53-d5061a4f7e89 None admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:04.759898 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b074af1f-0238-4cbd-ac53-d5061a4f7e89 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:03:04.759898 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b074af1f-0238-4cbd-ac53-d5061a4f7e89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:04.759898 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b074af1f-0238-4cbd-ac53-d5061a4f7e89 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:04.769191 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 113/224] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Sep 5 12:03:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:03:04.770323 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b074af1f-0238-4cbd-ac53-d5061a4f7e89 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:04.827129 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:04.842954 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f16b9e2-95b6-4aff-8c5a-46fccff1d3fc None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:04.882940 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d9cc53-81ba-4acc-8d62-f2d4d4b79b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:04.883653 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d9cc53-81ba-4acc-8d62-f2d4d4b79b72 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:04.884006 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d9cc53-81ba-4acc-8d62-f2d4d4b79b72 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:04.884366 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d9cc53-81ba-4acc-8d62-f2d4d4b79b72 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:04.889851 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b074af1f-0238-4cbd-ac53-d5061a4f7e89 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:04.896290 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d9cc53-81ba-4acc-8d62-f2d4d4b79b72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:03:04.902057 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-b7d9cc53-81ba-4acc-8d62-f2d4d4b79b72 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 05 12:03:04.902057 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:03:04.902057 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:03:04.902057 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:03:04.902057 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:03:04.902057 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:03:04.902057 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:03:04.902057 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:03:04.902057 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:03:04.902057 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:03:04.902057 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:03:04.902057 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:03:04.902057 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:03:04.902057 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:03:04.902057 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:03:04.902057 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:03:04.903715 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:03:04.903715 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:03:04.903715 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:03:04.903715 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:03:04.903715 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:03:04.903715 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:03:04.903715 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:03:04.903715 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:03:04.903715 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:03:04.903715 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:03:04.903715 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:03:04.903715 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:03:04.903715 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:03:04.903715 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:03:04.903715 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:03:04.903715 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:03:04.904990 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:03:04.904990 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:03:04.904990 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:03:04.904990 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:03:04.904990 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:03:04.904990 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:03:04.904990 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:03:04.904990 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:03:04.904990 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:03:04.904990 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:03:04.904990 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 05 12:03:04.904990 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:03:04.904990 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 112/225] 10.222.0.50 () {56 vars in 1114 bytes} [Mon Sep 5 12:03:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:03:04.904990 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d9cc53-81ba-4acc-8d62-f2d4d4b79b72 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:04.941810 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91dc689-46f0-4b0f-8304-b530c9f04bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:04.942488 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91dc689-46f0-4b0f-8304-b530c9f04bb9 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:04.943041 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91dc689-46f0-4b0f-8304-b530c9f04bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:04.943324 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91dc689-46f0-4b0f-8304-b530c9f04bb9 None admin] PATH_INFO: `/v3/projects/b6c350f1ed014cad89f2c125d5de6e1e` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:04.945309 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91dc689-46f0-4b0f-8304-b530c9f04bb9 None admin] RBAC: Authorizing `identity:get_project(project_id=b6c350f1ed014cad89f2c125d5de6e1e)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:04.947453 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91dc689-46f0-4b0f-8304-b530c9f04bb9 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:04.949784 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 114/226] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Sep 5 12:03:04 2022] GET /identity/v3/projects/b6c350f1ed014cad89f2c125d5de6e1e => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:04.951291 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91dc689-46f0-4b0f-8304-b530c9f04bb9 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:05.006019 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:05.043281 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d9cc53-81ba-4acc-8d62-f2d4d4b79b72 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:05.065822 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91dc689-46f0-4b0f-8304-b530c9f04bb9 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:05.093696 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30521de8-ad82-452b-acbe-e9ba9f5d398b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:05.095325 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30521de8-ad82-452b-acbe-e9ba9f5d398b None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:05.095861 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30521de8-ad82-452b-acbe-e9ba9f5d398b None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:05.096599 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30521de8-ad82-452b-acbe-e9ba9f5d398b None admin] PATH_INFO: `/v3/users/fe83b9be43e14e3f87de1cb92df473cf` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:05.098753 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30521de8-ad82-452b-acbe-e9ba9f5d398b None admin] RBAC: Authorizing `identity:get_user(user_id=fe83b9be43e14e3f87de1cb92df473cf)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:05.101490 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30521de8-ad82-452b-acbe-e9ba9f5d398b None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:05.103711 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 113/227] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Sep 5 12:03:04 2022] GET /identity/v3/users/fe83b9be43e14e3f87de1cb92df473cf => generated 283 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:05.104728 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30521de8-ad82-452b-acbe-e9ba9f5d398b None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:05.105555 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad4dd25-8b7f-4cf2-971a-1c27cf1dac2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:05.106176 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad4dd25-8b7f-4cf2-971a-1c27cf1dac2f None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:05.106455 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad4dd25-8b7f-4cf2-971a-1c27cf1dac2f None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:05.106730 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad4dd25-8b7f-4cf2-971a-1c27cf1dac2f None admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:05.107469 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad4dd25-8b7f-4cf2-971a-1c27cf1dac2f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:03:05.107773 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad4dd25-8b7f-4cf2-971a-1c27cf1dac2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:05.109375 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad4dd25-8b7f-4cf2-971a-1c27cf1dac2f None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:05.118803 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 115/228] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Sep 5 12:03:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:05.123619 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad4dd25-8b7f-4cf2-971a-1c27cf1dac2f None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:05.143888 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:05.228834 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30521de8-ad82-452b-acbe-e9ba9f5d398b None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:05.230154 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad4dd25-8b7f-4cf2-971a-1c27cf1dac2f None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:05.239268 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:05.266456 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142b0777-d0f8-4f24-95c9-ee0ccef954c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:05.266775 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb9178d-f8e9-4bfa-8a05-5dee8a8d070e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:05.267396 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb9178d-f8e9-4bfa-8a05-5dee8a8d070e None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:05.267680 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb9178d-f8e9-4bfa-8a05-5dee8a8d070e None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:05.267953 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb9178d-f8e9-4bfa-8a05-5dee8a8d070e None admin] PATH_INFO: `/v3/projects/b6c350f1ed014cad89f2c125d5de6e1e` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:05.268229 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142b0777-d0f8-4f24-95c9-ee0ccef954c6 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:05.268701 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142b0777-d0f8-4f24-95c9-ee0ccef954c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:05.269111 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb9178d-f8e9-4bfa-8a05-5dee8a8d070e None admin] RBAC: Authorizing `identity:get_project(project_id=b6c350f1ed014cad89f2c125d5de6e1e)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:05.269449 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142b0777-d0f8-4f24-95c9-ee0ccef954c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:05.270373 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142b0777-d0f8-4f24-95c9-ee0ccef954c6 None admin] RBAC: Adding query filter params (role.id=ed72181e1403401facb77dcf33644757, scope.project.id=b6c350f1ed014cad89f2c125d5de6e1e, user.id=c8f4bfc651b845afad41957868c40013) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:03:05.270568 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb9178d-f8e9-4bfa-8a05-5dee8a8d070e None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:05.271175 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142b0777-d0f8-4f24-95c9-ee0ccef954c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:05.272260 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 116/229] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Sep 5 12:03:05 2022] GET /identity/v3/projects/b6c350f1ed014cad89f2c125d5de6e1e => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:05.273082 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb9178d-f8e9-4bfa-8a05-5dee8a8d070e None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:05.273190 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142b0777-d0f8-4f24-95c9-ee0ccef954c6 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:05.280198 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 114/230] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Sep 5 12:03:05 2022] GET /identity/v3/role_assignments?user.id=c8f4bfc651b845afad41957868c40013&scope.project.id=b6c350f1ed014cad89f2c125d5de6e1e&role.id=ed72181e1403401facb77dcf33644757 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:05.281285 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142b0777-d0f8-4f24-95c9-ee0ccef954c6 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:05.376414 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:05.387792 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb9178d-f8e9-4bfa-8a05-5dee8a8d070e None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:05.396851 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142b0777-d0f8-4f24-95c9-ee0ccef954c6 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:05.427596 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e7cb2e-7834-4f6d-b96d-001188b24d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:05.428288 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e7cb2e-7834-4f6d-b96d-001188b24d8b None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:05.428567 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e7cb2e-7834-4f6d-b96d-001188b24d8b None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:05.428838 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e7cb2e-7834-4f6d-b96d-001188b24d8b None admin] PATH_INFO: `/v3/users/fe83b9be43e14e3f87de1cb92df473cf` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:05.430294 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e7cb2e-7834-4f6d-b96d-001188b24d8b None admin] RBAC: Authorizing `identity:get_user(user_id=fe83b9be43e14e3f87de1cb92df473cf)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:05.431966 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e7cb2e-7834-4f6d-b96d-001188b24d8b None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:05.438622 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 117/231] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Sep 5 12:03:05 2022] GET /identity/v3/users/fe83b9be43e14e3f87de1cb92df473cf => generated 283 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:05.439447 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c422d286-c062-4d69-9bdd-1810a72cd665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:05.440130 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c422d286-c062-4d69-9bdd-1810a72cd665 None admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:05.440403 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c422d286-c062-4d69-9bdd-1810a72cd665 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:05.440677 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c422d286-c062-4d69-9bdd-1810a72cd665 None admin] PATH_INFO: `/v3/projects/b6c350f1ed014cad89f2c125d5de6e1e/users/fe83b9be43e14e3f87de1cb92df473cf/roles/16e2ccc8bd1b497d8cee780c1c7df0d2` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:05.441910 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e7cb2e-7834-4f6d-b96d-001188b24d8b None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:05.442761 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c422d286-c062-4d69-9bdd-1810a72cd665 None admin] RBAC: Authorizing `identity:create_grant(project_id=b6c350f1ed014cad89f2c125d5de6e1e, user_id=fe83b9be43e14e3f87de1cb92df473cf, role_id=16e2ccc8bd1b497d8cee780c1c7df0d2)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:05.444352 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c422d286-c062-4d69-9bdd-1810a72cd665 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:05.465521 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 115/232] 10.222.0.50 () {58 vars in 1439 bytes} [Mon Sep 5 12:03:05 2022] PUT /identity/v3/projects/b6c350f1ed014cad89f2c125d5de6e1e/users/fe83b9be43e14e3f87de1cb92df473cf/roles/16e2ccc8bd1b497d8cee780c1c7df0d2 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:03:05.506369 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:05.577148 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e7cb2e-7834-4f6d-b96d-001188b24d8b None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:05.616286 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac69193f-d69d-4c51-9253-8454e8da24b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:05.617217 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac69193f-d69d-4c51-9253-8454e8da24b6 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:05.617648 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac69193f-d69d-4c51-9253-8454e8da24b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:05.618071 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac69193f-d69d-4c51-9253-8454e8da24b6 None admin] PATH_INFO: `/v3/projects/b6c350f1ed014cad89f2c125d5de6e1e` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:05.619415 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac69193f-d69d-4c51-9253-8454e8da24b6 None admin] RBAC: Authorizing `identity:get_project(project_id=b6c350f1ed014cad89f2c125d5de6e1e)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:05.621095 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac69193f-d69d-4c51-9253-8454e8da24b6 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:05.623937 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 118/233] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Sep 5 12:03:05 2022] GET /identity/v3/projects/b6c350f1ed014cad89f2c125d5de6e1e => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:05.630164 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c422d286-c062-4d69-9bdd-1810a72cd665 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:05.756985 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c422d286-c062-4d69-9bdd-1810a72cd665 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:05.799978 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f829d9ad-de60-423b-9f74-dd429ee9ffda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:05.800654 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f829d9ad-de60-423b-9f74-dd429ee9ffda None admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:05.800952 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f829d9ad-de60-423b-9f74-dd429ee9ffda None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:05.801232 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f829d9ad-de60-423b-9f74-dd429ee9ffda None admin] PATH_INFO: `/v3/projects/b6c350f1ed014cad89f2c125d5de6e1e/users/fe83b9be43e14e3f87de1cb92df473cf/roles/bf853a508574493f9bc7d85f3c3b36fd` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:05.803558 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f829d9ad-de60-423b-9f74-dd429ee9ffda None admin] RBAC: Authorizing `identity:create_grant(project_id=b6c350f1ed014cad89f2c125d5de6e1e, user_id=fe83b9be43e14e3f87de1cb92df473cf, role_id=bf853a508574493f9bc7d85f3c3b36fd)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:05.805057 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f829d9ad-de60-423b-9f74-dd429ee9ffda None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:05.830908 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 116/234] 10.222.0.50 () {58 vars in 1439 bytes} [Mon Sep 5 12:03:05 2022] PUT /identity/v3/projects/b6c350f1ed014cad89f2c125d5de6e1e/users/fe83b9be43e14e3f87de1cb92df473cf/roles/bf853a508574493f9bc7d85f3c3b36fd => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:03:06.645131 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c5b921-5863-4130-a37e-b2cab9d59911 None None] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:06.645647 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c5b921-5863-4130-a37e-b2cab9d59911 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:06.645754 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c5b921-5863-4130-a37e-b2cab9d59911 None None] PATH_INFO: `/` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:06.647246 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 119/235] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:03:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:03:06.653642 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c47857c-0cf0-4b82-9eeb-5297437e1d57 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:06.654106 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c47857c-0cf0-4b82-9eeb-5297437e1d57 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:06.654180 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c47857c-0cf0-4b82-9eeb-5297437e1d57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:06.662924 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:06.678021 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-3c47857c-0cf0-4b82-9eeb-5297437e1d57 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:03:06.679574 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-3c47857c-0cf0-4b82-9eeb-5297437e1d57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:03:06.704429 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82632f50-0c2c-4573-b49a-7cc4f95baace None None] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:06.704715 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82632f50-0c2c-4573-b49a-7cc4f95baace None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:06.705010 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82632f50-0c2c-4573-b49a-7cc4f95baace None None] PATH_INFO: `/` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:06.706789 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 120/236] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:03:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:03:06.712347 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c6957d-f2b5-491d-9042-1053d0f8356a None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:06.712629 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c6957d-f2b5-491d-9042-1053d0f8356a None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:06.712933 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c6957d-f2b5-491d-9042-1053d0f8356a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:06.742520 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-f1c6957d-f2b5-491d-9042-1053d0f8356a None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:03:06.743727 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-f1c6957d-f2b5-491d-9042-1053d0f8356a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:03:06.829075 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 117/237] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:03:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 05 12:03:06.883687 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 121/238] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:03:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:03:07.229598 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c47857c-0cf0-4b82-9eeb-5297437e1d57 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:07.240086 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c6957d-f2b5-491d-9042-1053d0f8356a None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:07.328676 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:07.418949 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c47857c-0cf0-4b82-9eeb-5297437e1d57 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:07.422004 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c6957d-f2b5-491d-9042-1053d0f8356a None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:07.462043 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd20db06-5a47-4b8e-99bd-80fc8c13ad74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:07.462983 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd20db06-5a47-4b8e-99bd-80fc8c13ad74 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:07.463497 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd20db06-5a47-4b8e-99bd-80fc8c13ad74 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:07.464298 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd20db06-5a47-4b8e-99bd-80fc8c13ad74 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:07.480929 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd20db06-5a47-4b8e-99bd-80fc8c13ad74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:03:07.490039 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application [None req-bd20db06-5a47-4b8e-99bd-80fc8c13ad74 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 05 12:03:07.490039 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:03:07.490039 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:03:07.490039 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:03:07.490039 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:03:07.490039 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:03:07.490039 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:03:07.490039 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:03:07.490039 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:03:07.490039 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:03:07.490039 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:03:07.490039 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:03:07.490039 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:03:07.490039 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:03:07.490039 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:03:07.490039 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:03:07.491003 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:03:07.491003 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:03:07.491003 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:03:07.491003 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:03:07.491003 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:03:07.491003 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:03:07.491003 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:03:07.491003 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:03:07.491003 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:03:07.491003 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:03:07.491003 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:03:07.491003 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application with Lock( Sep 05 12:03:07.491003 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:03:07.491003 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:03:07.491003 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:03:07.491003 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:03:07.491798 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:03:07.491798 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:03:07.491798 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:03:07.491798 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:03:07.491798 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:03:07.491798 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:03:07.491798 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:03:07.491798 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:03:07.491798 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:03:07.491798 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:03:07.491798 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 05 12:03:07.491798 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:03:07.491798 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 122/239] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Sep 5 12:03:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:03:07.497456 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd20db06-5a47-4b8e-99bd-80fc8c13ad74 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:07.498749 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852044d6-8123-4b03-b59a-bd4cc9d44e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:07.499682 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852044d6-8123-4b03-b59a-bd4cc9d44e6b None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:07.500168 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852044d6-8123-4b03-b59a-bd4cc9d44e6b None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:07.500663 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852044d6-8123-4b03-b59a-bd4cc9d44e6b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:07.502190 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852044d6-8123-4b03-b59a-bd4cc9d44e6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:07.504053 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852044d6-8123-4b03-b59a-bd4cc9d44e6b None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:07.506348 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 118/240] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 5 12:03:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:07.517953 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852044d6-8123-4b03-b59a-bd4cc9d44e6b None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:07.528111 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:07.678658 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852044d6-8123-4b03-b59a-bd4cc9d44e6b None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:07.679276 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd20db06-5a47-4b8e-99bd-80fc8c13ad74 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:07.680478 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:07.719790 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7e99db-0773-445a-b5b0-02393158eade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:07.720883 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7e99db-0773-445a-b5b0-02393158eade None admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:07.721386 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7e99db-0773-445a-b5b0-02393158eade None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:07.721902 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7e99db-0773-445a-b5b0-02393158eade None admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:07.722754 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7e99db-0773-445a-b5b0-02393158eade None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:07.724538 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7e99db-0773-445a-b5b0-02393158eade None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:07.750168 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 119/241] 10.222.0.50 () {60 vars in 1132 bytes} [Mon Sep 5 12:03:07 2022] POST /identity/v3/users => generated 293 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:03:07.750540 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b567126-a21b-4063-8500-d62133496eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:07.751163 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b567126-a21b-4063-8500-d62133496eff None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:07.751448 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b567126-a21b-4063-8500-d62133496eff None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:07.751720 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b567126-a21b-4063-8500-d62133496eff None admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:07.752404 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b567126-a21b-4063-8500-d62133496eff None admin] RBAC: Adding query filter params (name=reader) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:03:07.752717 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b567126-a21b-4063-8500-d62133496eff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:07.754162 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b567126-a21b-4063-8500-d62133496eff None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:07.775860 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 123/242] 10.222.0.50 () {56 vars in 1101 bytes} [Mon Sep 5 12:03:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:03:07.781624 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7e99db-0773-445a-b5b0-02393158eade None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:07.811647 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b787e6-ab80-48a1-840c-7a826bbd9fd4 None None] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:07.811961 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b787e6-ab80-48a1-840c-7a826bbd9fd4 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:07.812205 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b787e6-ab80-48a1-840c-7a826bbd9fd4 None None] PATH_INFO: `/` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:07.813896 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 124/243] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:03:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:03:07.819053 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96136dd0-99fe-426d-be41-bd17ba1e0e52 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:07.819362 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96136dd0-99fe-426d-be41-bd17ba1e0e52 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:07.819599 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96136dd0-99fe-426d-be41-bd17ba1e0e52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:07.859563 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-96136dd0-99fe-426d-be41-bd17ba1e0e52 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:03:07.860784 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-96136dd0-99fe-426d-be41-bd17ba1e0e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:03:07.861401 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:07.943865 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7e99db-0773-445a-b5b0-02393158eade None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:07.975412 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 125/244] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:03:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 05 12:03:07.976695 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cccb82-85b3-48f8-b974-fbcfa486ad49 None None] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:07.977008 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cccb82-85b3-48f8-b974-fbcfa486ad49 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:07.977286 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cccb82-85b3-48f8-b974-fbcfa486ad49 None None] PATH_INFO: `/` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:07.978789 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 126/245] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:03:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:03:07.989430 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b22688-f374-4cad-a26d-606b256989af None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:07.989712 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b22688-f374-4cad-a26d-606b256989af None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:07.989988 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b22688-f374-4cad-a26d-606b256989af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:08.012383 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-f4b22688-f374-4cad-a26d-606b256989af None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:03:08.013633 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-f4b22688-f374-4cad-a26d-606b256989af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:03:08.018643 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3139b6f8-ff99-448b-9e04-35c542d1884b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:08.019300 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3139b6f8-ff99-448b-9e04-35c542d1884b None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:08.019584 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3139b6f8-ff99-448b-9e04-35c542d1884b None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:08.019860 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3139b6f8-ff99-448b-9e04-35c542d1884b None admin] PATH_INFO: `/v3/users/55f866ae68a64272930e6c2fc087f066` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:08.037515 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3139b6f8-ff99-448b-9e04-35c542d1884b None admin] RBAC: Authorizing `identity:get_user(user_id=55f866ae68a64272930e6c2fc087f066)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:08.039051 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3139b6f8-ff99-448b-9e04-35c542d1884b None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:08.041175 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 120/246] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Sep 5 12:03:07 2022] GET /identity/v3/users/55f866ae68a64272930e6c2fc087f066 => generated 297 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:08.047389 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3139b6f8-ff99-448b-9e04-35c542d1884b None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:08.112923 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 127/247] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:03:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 05 12:03:08.186897 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3139b6f8-ff99-448b-9e04-35c542d1884b None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:08.206093 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:08.233636 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d43aec8-0621-4438-b7c1-d91e9c552d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:08.234263 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d43aec8-0621-4438-b7c1-d91e9c552d82 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:08.234518 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d43aec8-0621-4438-b7c1-d91e9c552d82 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:08.234852 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d43aec8-0621-4438-b7c1-d91e9c552d82 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:08.289804 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b22688-f374-4cad-a26d-606b256989af None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:08.308879 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d43aec8-0621-4438-b7c1-d91e9c552d82 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:08.310458 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d43aec8-0621-4438-b7c1-d91e9c552d82 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:08.329812 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:08.437979 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b22688-f374-4cad-a26d-606b256989af None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:08.438535 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 121/248] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Sep 5 12:03:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 12:03:08.440120 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063df53d-9506-4908-b2d0-bbaca91e04c9 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:08.440469 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063df53d-9506-4908-b2d0-bbaca91e04c9 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:08.440816 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063df53d-9506-4908-b2d0-bbaca91e04c9 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:08.442308 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 122/249] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:03:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:03:08.446927 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063df53d-9506-4908-b2d0-bbaca91e04c9 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:08.469191 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:08.485872 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992b3cbe-b547-4ef3-b711-f36dd7e233e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:08.486506 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992b3cbe-b547-4ef3-b711-f36dd7e233e1 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:08.486793 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992b3cbe-b547-4ef3-b711-f36dd7e233e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:08.487062 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992b3cbe-b547-4ef3-b711-f36dd7e233e1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:08.505066 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992b3cbe-b547-4ef3-b711-f36dd7e233e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:03:08.512984 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application [None req-992b3cbe-b547-4ef3-b711-f36dd7e233e1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 12:03:08.512984 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:03:08.512984 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:03:08.512984 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:03:08.512984 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:03:08.512984 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:03:08.512984 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:03:08.512984 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:03:08.512984 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:03:08.512984 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:03:08.512984 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:03:08.512984 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:03:08.512984 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:03:08.512984 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:03:08.512984 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:03:08.512984 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:03:08.513888 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:03:08.513888 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:03:08.513888 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:03:08.513888 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:03:08.513888 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:03:08.513888 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:03:08.513888 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:03:08.513888 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:03:08.513888 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:03:08.513888 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:03:08.513888 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:03:08.513888 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application with Lock( Sep 05 12:03:08.513888 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:03:08.513888 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:03:08.513888 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:03:08.513888 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:03:08.514729 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:03:08.514729 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:03:08.514729 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:03:08.514729 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:03:08.514729 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:03:08.514729 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:03:08.514729 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:03:08.514729 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:03:08.514729 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:03:08.514729 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:03:08.514729 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 12:03:08.514729 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:03:08.518000 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 128/250] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Sep 5 12:03:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 12:03:08.519223 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992b3cbe-b547-4ef3-b711-f36dd7e233e1 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:08.590607 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063df53d-9506-4908-b2d0-bbaca91e04c9 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:08.617764 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:08.637350 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992b3cbe-b547-4ef3-b711-f36dd7e233e1 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:08.641533 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee3cb4c-4ffb-47fd-bae2-ad34ee689b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:08.642176 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee3cb4c-4ffb-47fd-bae2-ad34ee689b0a None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:08.642457 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee3cb4c-4ffb-47fd-bae2-ad34ee689b0a None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:08.642732 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee3cb4c-4ffb-47fd-bae2-ad34ee689b0a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:08.658957 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee3cb4c-4ffb-47fd-bae2-ad34ee689b0a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:03:08.666243 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-3ee3cb4c-4ffb-47fd-bae2-ad34ee689b0a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 05 12:03:08.666243 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:03:08.666243 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:03:08.666243 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:03:08.666243 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:03:08.666243 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:03:08.666243 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:03:08.666243 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:03:08.666243 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:03:08.666243 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:03:08.666243 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:03:08.666243 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:03:08.666243 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:03:08.666243 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:03:08.666243 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:03:08.666243 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:03:08.667147 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:03:08.667147 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:03:08.667147 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:03:08.667147 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:03:08.667147 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:03:08.667147 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:03:08.667147 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:03:08.667147 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:03:08.667147 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:03:08.667147 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:03:08.667147 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:03:08.667147 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:03:08.667147 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:03:08.667147 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:03:08.667147 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:03:08.667147 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:03:08.667978 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:03:08.667978 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:03:08.667978 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:03:08.667978 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:03:08.667978 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:03:08.667978 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:03:08.667978 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:03:08.667978 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:03:08.667978 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:03:08.667978 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:03:08.667978 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 05 12:03:08.667978 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:03:08.670607 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 123/251] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Sep 5 12:03:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:03:08.672251 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046e3e73-3cff-4315-b01b-be81f5d005cc None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:08.672932 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046e3e73-3cff-4315-b01b-be81f5d005cc None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:08.673347 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046e3e73-3cff-4315-b01b-be81f5d005cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:08.682310 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93a57f1-f196-4194-a394-8911a701f1a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:08.683087 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93a57f1-f196-4194-a394-8911a701f1a1 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:08.683464 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93a57f1-f196-4194-a394-8911a701f1a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:08.684935 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93a57f1-f196-4194-a394-8911a701f1a1 None admin] PATH_INFO: `/v3/projects/b6c350f1ed014cad89f2c125d5de6e1e` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:08.685640 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93a57f1-f196-4194-a394-8911a701f1a1 None admin] RBAC: Authorizing `identity:get_project(project_id=b6c350f1ed014cad89f2c125d5de6e1e)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:08.687190 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93a57f1-f196-4194-a394-8911a701f1a1 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:08.694472 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 129/252] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Sep 5 12:03:08 2022] GET /identity/v3/projects/b6c350f1ed014cad89f2c125d5de6e1e => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:08.694472 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93a57f1-f196-4194-a394-8911a701f1a1 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:08.701926 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-046e3e73-3cff-4315-b01b-be81f5d005cc None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:03:08.703695 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-046e3e73-3cff-4315-b01b-be81f5d005cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:03:08.795456 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 124/253] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:03:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:03:08.802044 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046e3e73-3cff-4315-b01b-be81f5d005cc None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:08.816404 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:08.817900 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93a57f1-f196-4194-a394-8911a701f1a1 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:08.864534 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5052dc19-057e-4eed-88ae-e8462b166b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:08.865856 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5052dc19-057e-4eed-88ae-e8462b166b85 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:08.866134 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5052dc19-057e-4eed-88ae-e8462b166b85 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:08.866404 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5052dc19-057e-4eed-88ae-e8462b166b85 None admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:08.867081 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5052dc19-057e-4eed-88ae-e8462b166b85 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:03:08.867385 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5052dc19-057e-4eed-88ae-e8462b166b85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:08.868760 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5052dc19-057e-4eed-88ae-e8462b166b85 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:08.892077 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 130/254] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Sep 5 12:03:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:08.892686 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5052dc19-057e-4eed-88ae-e8462b166b85 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:08.922827 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:08.983149 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046e3e73-3cff-4315-b01b-be81f5d005cc None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:09.050773 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7823840b-cc03-4882-a359-c585d9725c0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:09.052490 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7823840b-cc03-4882-a359-c585d9725c0c None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:09.052775 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7823840b-cc03-4882-a359-c585d9725c0c None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:09.053077 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7823840b-cc03-4882-a359-c585d9725c0c None admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:09.053760 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7823840b-cc03-4882-a359-c585d9725c0c None admin] RBAC: Adding query filter params (name=member) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:03:09.054065 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7823840b-cc03-4882-a359-c585d9725c0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:09.055466 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7823840b-cc03-4882-a359-c585d9725c0c None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:09.074176 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 125/255] 10.222.0.50 () {56 vars in 1101 bytes} [Mon Sep 5 12:03:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:09.076788 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7823840b-cc03-4882-a359-c585d9725c0c None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:09.087541 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5052dc19-057e-4eed-88ae-e8462b166b85 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:09.152130 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af2a87b-d200-4858-8eb8-d53136535bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:09.153314 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af2a87b-d200-4858-8eb8-d53136535bbd None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:09.156940 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af2a87b-d200-4858-8eb8-d53136535bbd None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:09.156940 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af2a87b-d200-4858-8eb8-d53136535bbd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:09.159168 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af2a87b-d200-4858-8eb8-d53136535bbd None admin] RBAC: Adding query filter params (role.id=7759eb25e244436aa0b1be6aee7ebd1e, scope.project.id=b6c350f1ed014cad89f2c125d5de6e1e, user.id=55f866ae68a64272930e6c2fc087f066) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:03:09.159496 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af2a87b-d200-4858-8eb8-d53136535bbd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:09.160998 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af2a87b-d200-4858-8eb8-d53136535bbd None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:09.178895 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 131/256] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Sep 5 12:03:08 2022] GET /identity/v3/role_assignments?user.id=55f866ae68a64272930e6c2fc087f066&scope.project.id=b6c350f1ed014cad89f2c125d5de6e1e&role.id=7759eb25e244436aa0b1be6aee7ebd1e => generated 259 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:09.179612 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af2a87b-d200-4858-8eb8-d53136535bbd None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:09.199514 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:09.272514 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7823840b-cc03-4882-a359-c585d9725c0c None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:09.357092 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4862f391-ddc9-4a78-8c59-723e51f96caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:09.357758 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4862f391-ddc9-4a78-8c59-723e51f96caf None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:09.358040 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4862f391-ddc9-4a78-8c59-723e51f96caf None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:09.358316 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4862f391-ddc9-4a78-8c59-723e51f96caf None admin] PATH_INFO: `/v3/users/fe83b9be43e14e3f87de1cb92df473cf` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:09.358836 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:09.360679 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4862f391-ddc9-4a78-8c59-723e51f96caf None admin] RBAC: Authorizing `identity:get_user(user_id=fe83b9be43e14e3f87de1cb92df473cf)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:09.362223 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4862f391-ddc9-4a78-8c59-723e51f96caf None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:09.363996 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 126/257] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Sep 5 12:03:09 2022] GET /identity/v3/users/fe83b9be43e14e3f87de1cb92df473cf => generated 283 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:09.368014 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4862f391-ddc9-4a78-8c59-723e51f96caf None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:09.404057 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af2a87b-d200-4858-8eb8-d53136535bbd None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:09.446736 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1391375-965c-443a-b846-8479f4ab93d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:09.447772 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1391375-965c-443a-b846-8479f4ab93d2 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:09.448711 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1391375-965c-443a-b846-8479f4ab93d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:09.449218 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1391375-965c-443a-b846-8479f4ab93d2 None admin] PATH_INFO: `/v3/users/c8f4bfc651b845afad41957868c40013` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:09.450829 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1391375-965c-443a-b846-8479f4ab93d2 None admin] RBAC: Authorizing `identity:get_user(user_id=c8f4bfc651b845afad41957868c40013)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:09.453229 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1391375-965c-443a-b846-8479f4ab93d2 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:09.457112 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 132/258] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Sep 5 12:03:09 2022] GET /identity/v3/users/c8f4bfc651b845afad41957868c40013 => generated 297 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:09.458353 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1391375-965c-443a-b846-8479f4ab93d2 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:09.525011 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4862f391-ddc9-4a78-8c59-723e51f96caf None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:09.578657 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1391375-965c-443a-b846-8479f4ab93d2 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:09.617309 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1a616b-afe9-41c5-b7bb-473d4a933c95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:09.618325 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1a616b-afe9-41c5-b7bb-473d4a933c95 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:09.618778 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1a616b-afe9-41c5-b7bb-473d4a933c95 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:09.619219 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1a616b-afe9-41c5-b7bb-473d4a933c95 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:09.630286 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26905c0f-72fd-4be4-b5ea-be09ff7eb461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:09.630948 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26905c0f-72fd-4be4-b5ea-be09ff7eb461 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:09.631229 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26905c0f-72fd-4be4-b5ea-be09ff7eb461 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:09.631504 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26905c0f-72fd-4be4-b5ea-be09ff7eb461 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:09.639080 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:09.645304 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:09.689687 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26905c0f-72fd-4be4-b5ea-be09ff7eb461 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:03:09.694734 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-26905c0f-72fd-4be4-b5ea-be09ff7eb461 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 05 12:03:09.694734 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:03:09.694734 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:03:09.694734 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:03:09.694734 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:03:09.694734 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:03:09.694734 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:03:09.694734 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:03:09.694734 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:03:09.694734 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:03:09.694734 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:03:09.694734 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:03:09.694734 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:03:09.694734 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:03:09.694734 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:03:09.694734 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:03:09.695637 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:03:09.695637 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:03:09.695637 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:03:09.695637 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:03:09.695637 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:03:09.695637 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:03:09.695637 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:03:09.695637 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:03:09.695637 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:03:09.695637 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:03:09.695637 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:03:09.695637 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:03:09.695637 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:03:09.695637 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:03:09.695637 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:03:09.695637 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:03:09.696442 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:03:09.696442 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:03:09.696442 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:03:09.696442 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:03:09.696442 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:03:09.696442 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:03:09.696442 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:03:09.696442 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:03:09.696442 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:03:09.696442 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:03:09.696442 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 05 12:03:09.696442 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:03:09.696442 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 127/259] 10.222.0.50 () {56 vars in 1114 bytes} [Mon Sep 5 12:03:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:03:09.701781 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26905c0f-72fd-4be4-b5ea-be09ff7eb461 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:09.710738 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1a616b-afe9-41c5-b7bb-473d4a933c95 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:09.713217 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1a616b-afe9-41c5-b7bb-473d4a933c95 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:09.826781 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 133/260] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Sep 5 12:03:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 12:03:09.828064 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1a616b-afe9-41c5-b7bb-473d4a933c95 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:09.880415 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:09.941726 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1a616b-afe9-41c5-b7bb-473d4a933c95 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:09.982497 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9a725d-eca4-46f3-900b-408b1fd3cd2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:09.983557 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9a725d-eca4-46f3-900b-408b1fd3cd2c None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:09.984030 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9a725d-eca4-46f3-900b-408b1fd3cd2c None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:09.984494 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9a725d-eca4-46f3-900b-408b1fd3cd2c None admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:09.985388 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9a725d-eca4-46f3-900b-408b1fd3cd2c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:03:09.985889 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9a725d-eca4-46f3-900b-408b1fd3cd2c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:09.987561 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9a725d-eca4-46f3-900b-408b1fd3cd2c None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:09.998143 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 134/261] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Sep 5 12:03:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:09.999581 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9a725d-eca4-46f3-900b-408b1fd3cd2c None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:10.036913 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26905c0f-72fd-4be4-b5ea-be09ff7eb461 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:10.092876 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c897866-b358-484e-ad1a-e6d560064622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:10.093546 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c897866-b358-484e-ad1a-e6d560064622 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:10.093824 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c897866-b358-484e-ad1a-e6d560064622 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:10.094094 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c897866-b358-484e-ad1a-e6d560064622 None admin] PATH_INFO: `/v3/projects/b6c350f1ed014cad89f2c125d5de6e1e` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:10.095271 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c897866-b358-484e-ad1a-e6d560064622 None admin] RBAC: Authorizing `identity:get_project(project_id=b6c350f1ed014cad89f2c125d5de6e1e)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:10.101038 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c897866-b358-484e-ad1a-e6d560064622 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:10.101038 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 128/262] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Sep 5 12:03:09 2022] GET /identity/v3/projects/b6c350f1ed014cad89f2c125d5de6e1e => generated 302 bytes in 402 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:10.101038 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c897866-b358-484e-ad1a-e6d560064622 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:10.154164 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9a725d-eca4-46f3-900b-408b1fd3cd2c None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:10.171488 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:10.226916 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8073be-8afd-45f9-b916-6d522ee1d286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:10.227464 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:10.228071 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8073be-8afd-45f9-b916-6d522ee1d286 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:10.228542 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8073be-8afd-45f9-b916-6d522ee1d286 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:10.229003 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8073be-8afd-45f9-b916-6d522ee1d286 None admin] PATH_INFO: `/v3/projects/b6c350f1ed014cad89f2c125d5de6e1e` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:10.231658 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8073be-8afd-45f9-b916-6d522ee1d286 None admin] RBAC: Authorizing `identity:get_project(project_id=b6c350f1ed014cad89f2c125d5de6e1e)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:10.236218 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8073be-8afd-45f9-b916-6d522ee1d286 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:10.238182 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 135/263] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Sep 5 12:03:09 2022] GET /identity/v3/projects/b6c350f1ed014cad89f2c125d5de6e1e => generated 302 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:10.246126 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8073be-8afd-45f9-b916-6d522ee1d286 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:10.281654 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c897866-b358-484e-ad1a-e6d560064622 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:10.317887 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a07de1-d349-4dd7-b3aa-f40b71765305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:10.318808 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a07de1-d349-4dd7-b3aa-f40b71765305 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:10.319231 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a07de1-d349-4dd7-b3aa-f40b71765305 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:10.319649 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a07de1-d349-4dd7-b3aa-f40b71765305 None admin] PATH_INFO: `/v3/users/fe83b9be43e14e3f87de1cb92df473cf` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:10.320977 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a07de1-d349-4dd7-b3aa-f40b71765305 None admin] RBAC: Authorizing `identity:get_user(user_id=fe83b9be43e14e3f87de1cb92df473cf)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:10.322657 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a07de1-d349-4dd7-b3aa-f40b71765305 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:10.325073 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 129/264] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Sep 5 12:03:10 2022] GET /identity/v3/users/fe83b9be43e14e3f87de1cb92df473cf => generated 283 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:10.326456 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3d3eb2-33e6-4c7a-b3eb-dfd370156045 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:10.326920 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3d3eb2-33e6-4c7a-b3eb-dfd370156045 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:10.327367 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3d3eb2-33e6-4c7a-b3eb-dfd370156045 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:10.329066 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 130/265] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:03:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:03:10.329986 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3d3eb2-33e6-4c7a-b3eb-dfd370156045 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:10.375202 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8073be-8afd-45f9-b916-6d522ee1d286 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:10.417986 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7444b95-c6fb-4d4d-97f9-16e31d3c7ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:10.418917 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7444b95-c6fb-4d4d-97f9-16e31d3c7ed6 None admin] REQUEST_METHOD: `PUT` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:10.419534 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7444b95-c6fb-4d4d-97f9-16e31d3c7ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:10.419972 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7444b95-c6fb-4d4d-97f9-16e31d3c7ed6 None admin] PATH_INFO: `/v3/projects/b6c350f1ed014cad89f2c125d5de6e1e/users/c8f4bfc651b845afad41957868c40013/roles/ed72181e1403401facb77dcf33644757` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:10.422959 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7444b95-c6fb-4d4d-97f9-16e31d3c7ed6 None admin] RBAC: Authorizing `identity:create_grant(project_id=b6c350f1ed014cad89f2c125d5de6e1e, user_id=c8f4bfc651b845afad41957868c40013, role_id=ed72181e1403401facb77dcf33644757)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:10.424873 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7444b95-c6fb-4d4d-97f9-16e31d3c7ed6 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:10.443563 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 136/266] 10.222.0.50 () {58 vars in 1439 bytes} [Mon Sep 5 12:03:10 2022] PUT /identity/v3/projects/b6c350f1ed014cad89f2c125d5de6e1e/users/c8f4bfc651b845afad41957868c40013/roles/ed72181e1403401facb77dcf33644757 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:03:10.444237 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7444b95-c6fb-4d4d-97f9-16e31d3c7ed6 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:10.447747 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3d3eb2-33e6-4c7a-b3eb-dfd370156045 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:10.492957 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:10.497007 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:10.503136 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa359c3e-383c-42cb-969c-a7a1de4c6259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:10.504054 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa359c3e-383c-42cb-969c-a7a1de4c6259 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:10.504356 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa359c3e-383c-42cb-969c-a7a1de4c6259 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:10.504761 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa359c3e-383c-42cb-969c-a7a1de4c6259 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:10.505629 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa359c3e-383c-42cb-969c-a7a1de4c6259 None admin] RBAC: Adding query filter params (role.id=16e2ccc8bd1b497d8cee780c1c7df0d2, scope.project.id=b6c350f1ed014cad89f2c125d5de6e1e, user.id=fe83b9be43e14e3f87de1cb92df473cf) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:03:10.506040 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa359c3e-383c-42cb-969c-a7a1de4c6259 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:10.507737 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa359c3e-383c-42cb-969c-a7a1de4c6259 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:10.525726 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 131/267] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Sep 5 12:03:10 2022] GET /identity/v3/role_assignments?user.id=fe83b9be43e14e3f87de1cb92df473cf&scope.project.id=b6c350f1ed014cad89f2c125d5de6e1e&role.id=16e2ccc8bd1b497d8cee780c1c7df0d2 => generated 608 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:10.527147 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd114a7-9a09-423c-8d2f-901ac6e4104c None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:10.528235 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd114a7-9a09-423c-8d2f-901ac6e4104c None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:10.528340 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd114a7-9a09-423c-8d2f-901ac6e4104c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:10.554913 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-5bd114a7-9a09-423c-8d2f-901ac6e4104c None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:03:10.556184 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-5bd114a7-9a09-423c-8d2f-901ac6e4104c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:03:10.619795 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7444b95-c6fb-4d4d-97f9-16e31d3c7ed6 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:10.702244 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 132/268] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:03:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:03:10.702537 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd76d39-1f1d-4a26-91db-1a0445d80071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:10.703087 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd76d39-1f1d-4a26-91db-1a0445d80071 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:10.703402 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd76d39-1f1d-4a26-91db-1a0445d80071 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:10.703708 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd76d39-1f1d-4a26-91db-1a0445d80071 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:10.704678 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e117d732-8684-4d70-b0e4-629969b2a50e None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:10.705176 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e117d732-8684-4d70-b0e4-629969b2a50e None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:10.705591 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e117d732-8684-4d70-b0e4-629969b2a50e None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:10.711438 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 133/269] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:03:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:03:10.714308 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0caf21-f930-4148-b91c-bbe9e2778e3d None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:10.714758 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0caf21-f930-4148-b91c-bbe9e2778e3d None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:10.715210 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0caf21-f930-4148-b91c-bbe9e2778e3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:10.738773 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-aa0caf21-f930-4148-b91c-bbe9e2778e3d None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:03:10.740358 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-aa0caf21-f930-4148-b91c-bbe9e2778e3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:03:10.845782 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd76d39-1f1d-4a26-91db-1a0445d80071 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:10.847305 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd76d39-1f1d-4a26-91db-1a0445d80071 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:10.858064 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 134/270] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:03:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 05 12:03:10.908489 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:10.990348 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 137/271] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Sep 5 12:03:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 546 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 12:03:10.995921 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0caf21-f930-4148-b91c-bbe9e2778e3d None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:11.062065 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd76d39-1f1d-4a26-91db-1a0445d80071 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:11.091779 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:11.161614 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0caf21-f930-4148-b91c-bbe9e2778e3d None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:11.219099 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f6c3b8-6398-4d1f-aa88-7196b1fe5c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:11.219831 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f6c3b8-6398-4d1f-aa88-7196b1fe5c46 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:11.220110 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f6c3b8-6398-4d1f-aa88-7196b1fe5c46 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:11.220477 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f6c3b8-6398-4d1f-aa88-7196b1fe5c46 None admin] PATH_INFO: `/v3/projects/b6c350f1ed014cad89f2c125d5de6e1e` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:11.221624 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f6c3b8-6398-4d1f-aa88-7196b1fe5c46 None admin] RBAC: Authorizing `identity:get_project(project_id=b6c350f1ed014cad89f2c125d5de6e1e)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:11.223179 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f6c3b8-6398-4d1f-aa88-7196b1fe5c46 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:11.229345 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 135/272] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Sep 5 12:03:10 2022] GET /identity/v3/projects/b6c350f1ed014cad89f2c125d5de6e1e => generated 302 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:11.230322 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f6c3b8-6398-4d1f-aa88-7196b1fe5c46 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:11.239691 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd76d39-1f1d-4a26-91db-1a0445d80071 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:11.284259 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d767a29-63e0-49f6-8b74-d3c1dcd4b229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:11.284919 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d767a29-63e0-49f6-8b74-d3c1dcd4b229 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:11.285199 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d767a29-63e0-49f6-8b74-d3c1dcd4b229 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:11.285468 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d767a29-63e0-49f6-8b74-d3c1dcd4b229 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:11.288208 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:11.300924 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d767a29-63e0-49f6-8b74-d3c1dcd4b229 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:03:11.308134 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application [None req-5d767a29-63e0-49f6-8b74-d3c1dcd4b229 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 05 12:03:11.308134 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:03:11.308134 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:03:11.308134 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:03:11.308134 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:03:11.308134 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:03:11.308134 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:03:11.308134 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:03:11.308134 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:03:11.308134 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:03:11.308134 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:03:11.308134 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:03:11.308134 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:03:11.308134 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:03:11.308134 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:03:11.308134 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:03:11.309786 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:03:11.309786 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:03:11.309786 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:03:11.309786 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:03:11.309786 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:03:11.309786 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:03:11.309786 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:03:11.309786 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:03:11.309786 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:03:11.309786 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:03:11.309786 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:03:11.309786 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application with Lock( Sep 05 12:03:11.309786 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:03:11.309786 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:03:11.309786 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:03:11.309786 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:03:11.310594 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:03:11.310594 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:03:11.310594 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:03:11.310594 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:03:11.310594 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:03:11.310594 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:03:11.310594 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:03:11.310594 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:03:11.310594 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:03:11.310594 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:03:11.310594 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 05 12:03:11.310594 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:03:11.310594 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 138/273] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Sep 5 12:03:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:03:11.312523 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d767a29-63e0-49f6-8b74-d3c1dcd4b229 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:11.356408 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f6c3b8-6398-4d1f-aa88-7196b1fe5c46 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:11.384909 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:11.399043 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c014c2e-16a0-48d9-a8bb-85f8c2dff3d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:11.399689 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c014c2e-16a0-48d9-a8bb-85f8c2dff3d0 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:11.399963 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c014c2e-16a0-48d9-a8bb-85f8c2dff3d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:11.400233 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c014c2e-16a0-48d9-a8bb-85f8c2dff3d0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:11.401531 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c014c2e-16a0-48d9-a8bb-85f8c2dff3d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:11.403660 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c014c2e-16a0-48d9-a8bb-85f8c2dff3d0 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:11.405545 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 136/274] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 5 12:03:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:11.406440 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c014c2e-16a0-48d9-a8bb-85f8c2dff3d0 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:11.426745 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d767a29-63e0-49f6-8b74-d3c1dcd4b229 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:11.462462 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214f0868-7402-4067-a8f0-1026a1c5f2fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:11.463076 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214f0868-7402-4067-a8f0-1026a1c5f2fa None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:11.463357 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214f0868-7402-4067-a8f0-1026a1c5f2fa None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:11.463633 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214f0868-7402-4067-a8f0-1026a1c5f2fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:11.464374 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214f0868-7402-4067-a8f0-1026a1c5f2fa None admin] RBAC: Adding query filter params (role.id=bf853a508574493f9bc7d85f3c3b36fd, scope.project.id=b6c350f1ed014cad89f2c125d5de6e1e, user.id=fe83b9be43e14e3f87de1cb92df473cf) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:03:11.464684 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214f0868-7402-4067-a8f0-1026a1c5f2fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:11.466726 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214f0868-7402-4067-a8f0-1026a1c5f2fa None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:11.481160 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 139/275] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Sep 5 12:03:11 2022] GET /identity/v3/role_assignments?user.id=fe83b9be43e14e3f87de1cb92df473cf&scope.project.id=b6c350f1ed014cad89f2c125d5de6e1e&role.id=bf853a508574493f9bc7d85f3c3b36fd => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:11.482178 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214f0868-7402-4067-a8f0-1026a1c5f2fa None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:11.522364 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c014c2e-16a0-48d9-a8bb-85f8c2dff3d0 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:11.564516 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667cdefa-2aa1-4c30-b6ea-ed3385a79dea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:11.565087 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667cdefa-2aa1-4c30-b6ea-ed3385a79dea None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:11.565366 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667cdefa-2aa1-4c30-b6ea-ed3385a79dea None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:11.565638 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667cdefa-2aa1-4c30-b6ea-ed3385a79dea None admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:11.566637 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667cdefa-2aa1-4c30-b6ea-ed3385a79dea None admin] RBAC: Adding query filter params (name=member) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:03:11.566947 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667cdefa-2aa1-4c30-b6ea-ed3385a79dea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:11.568400 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667cdefa-2aa1-4c30-b6ea-ed3385a79dea None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:11.578068 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 137/276] 10.222.0.50 () {56 vars in 1101 bytes} [Mon Sep 5 12:03:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:11.579421 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6672ee32-a71a-498a-a709-d0d2e5a27a46 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:11.579703 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6672ee32-a71a-498a-a709-d0d2e5a27a46 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:11.581217 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6672ee32-a71a-498a-a709-d0d2e5a27a46 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:11.584049 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 138/277] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:03:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:03:11.587142 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6672ee32-a71a-498a-a709-d0d2e5a27a46 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:11.598607 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:11.655531 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214f0868-7402-4067-a8f0-1026a1c5f2fa None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:11.681433 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:11.709520 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0aa39d-cc96-41ef-b89c-343c51f327a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:11.710413 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0aa39d-cc96-41ef-b89c-343c51f327a7 None admin] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:11.710826 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0aa39d-cc96-41ef-b89c-343c51f327a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:11.711224 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0aa39d-cc96-41ef-b89c-343c51f327a7 None admin] PATH_INFO: `/v3/users` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:11.712030 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0aa39d-cc96-41ef-b89c-343c51f327a7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:11.714162 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0aa39d-cc96-41ef-b89c-343c51f327a7 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:11.741436 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 140/278] 10.222.0.50 () {60 vars in 1132 bytes} [Mon Sep 5 12:03:11 2022] POST /identity/v3/users => generated 293 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:03:11.742771 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debfa27b-cf95-46b6-8180-aa6bc6c6543a None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:11.743064 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debfa27b-cf95-46b6-8180-aa6bc6c6543a None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:11.743341 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debfa27b-cf95-46b6-8180-aa6bc6c6543a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:11.754811 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6672ee32-a71a-498a-a709-d0d2e5a27a46 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:11.766725 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-debfa27b-cf95-46b6-8180-aa6bc6c6543a None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:03:11.768012 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-debfa27b-cf95-46b6-8180-aa6bc6c6543a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:03:11.811831 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0999026-f6e2-4b09-b97f-570c68942690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:11.813136 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0999026-f6e2-4b09-b97f-570c68942690 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:11.813833 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0999026-f6e2-4b09-b97f-570c68942690 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:11.814327 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0999026-f6e2-4b09-b97f-570c68942690 None admin] PATH_INFO: `/v3/users/d6ef6aef0d8a49208d7b3884568ef4cc` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:11.836586 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0999026-f6e2-4b09-b97f-570c68942690 None admin] RBAC: Authorizing `identity:get_user(user_id=d6ef6aef0d8a49208d7b3884568ef4cc)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:11.839315 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0999026-f6e2-4b09-b97f-570c68942690 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:11.842160 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 139/279] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Sep 5 12:03:11 2022] GET /identity/v3/users/d6ef6aef0d8a49208d7b3884568ef4cc => generated 293 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:11.849676 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0999026-f6e2-4b09-b97f-570c68942690 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:11.864281 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 141/280] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:03:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:03:11.988965 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0999026-f6e2-4b09-b97f-570c68942690 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:12.007192 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:12.040084 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd114ce-4ee8-4125-ba8d-6071b93e8de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:12.041000 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd114ce-4ee8-4125-ba8d-6071b93e8de0 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:12.041445 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd114ce-4ee8-4125-ba8d-6071b93e8de0 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:12.041796 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd114ce-4ee8-4125-ba8d-6071b93e8de0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:12.042692 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd114ce-4ee8-4125-ba8d-6071b93e8de0 None admin] RBAC: Adding query filter params (role.id=ed72181e1403401facb77dcf33644757, user.id=d6ef6aef0d8a49208d7b3884568ef4cc, scope.system=all) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:03:12.043238 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd114ce-4ee8-4125-ba8d-6071b93e8de0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:12.045076 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd114ce-4ee8-4125-ba8d-6071b93e8de0 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:12.051258 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 140/281] 10.222.0.50 () {56 vars in 1308 bytes} [Mon Sep 5 12:03:11 2022] GET /identity/v3/role_assignments?user.id=d6ef6aef0d8a49208d7b3884568ef4cc&scope.system=all&role.id=ed72181e1403401facb77dcf33644757 => generated 226 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:12.135068 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debfa27b-cf95-46b6-8180-aa6bc6c6543a None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:12.197849 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:12.265808 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debfa27b-cf95-46b6-8180-aa6bc6c6543a None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:12.305958 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1616d41c-8ae1-455a-ad1c-e34bae27f0b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:12.306612 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1616d41c-8ae1-455a-ad1c-e34bae27f0b2 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:12.306891 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1616d41c-8ae1-455a-ad1c-e34bae27f0b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:12.307163 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1616d41c-8ae1-455a-ad1c-e34bae27f0b2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:12.327163 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1616d41c-8ae1-455a-ad1c-e34bae27f0b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:03:12.332141 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application [None req-1616d41c-8ae1-455a-ad1c-e34bae27f0b2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 05 12:03:12.332141 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:03:12.332141 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:03:12.332141 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:03:12.332141 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:03:12.332141 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:03:12.332141 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:03:12.332141 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:03:12.332141 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:03:12.332141 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:03:12.332141 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:03:12.332141 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:03:12.332141 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:03:12.332141 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:03:12.332141 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:03:12.332141 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:03:12.333083 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:03:12.333083 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:03:12.333083 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:03:12.333083 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:03:12.333083 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:03:12.333083 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:03:12.333083 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:03:12.333083 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:03:12.333083 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:03:12.333083 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:03:12.333083 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:03:12.333083 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application with Lock( Sep 05 12:03:12.333083 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:03:12.333083 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:03:12.333083 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:03:12.333083 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:03:12.333887 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:03:12.333887 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:03:12.333887 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:03:12.333887 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:03:12.333887 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:03:12.333887 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:03:12.333887 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:03:12.333887 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:03:12.333887 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:03:12.333887 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:03:12.333887 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 05 12:03:12.333887 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:03:12.333887 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 142/282] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Sep 5 12:03:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:03:12.342598 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd114ce-4ee8-4125-ba8d-6071b93e8de0 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:12.609506 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd114ce-4ee8-4125-ba8d-6071b93e8de0 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:12.658542 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7018721-086b-4c26-b4ac-2d260cb24cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:12.659170 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7018721-086b-4c26-b4ac-2d260cb24cb6 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:12.659448 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7018721-086b-4c26-b4ac-2d260cb24cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:12.659717 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7018721-086b-4c26-b4ac-2d260cb24cb6 None admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:12.660391 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7018721-086b-4c26-b4ac-2d260cb24cb6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:03:12.660690 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7018721-086b-4c26-b4ac-2d260cb24cb6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:12.662125 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7018721-086b-4c26-b4ac-2d260cb24cb6 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:12.675833 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 141/283] 10.222.0.50 () {56 vars in 1101 bytes} [Mon Sep 5 12:03:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:12.681946 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1616d41c-8ae1-455a-ad1c-e34bae27f0b2 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:12.791540 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1616d41c-8ae1-455a-ad1c-e34bae27f0b2 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:12.805336 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:12.830699 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b6433c-4f95-4a14-91b8-8e07a5791fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:12.831338 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b6433c-4f95-4a14-91b8-8e07a5791fed None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:12.831618 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b6433c-4f95-4a14-91b8-8e07a5791fed None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:12.831891 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b6433c-4f95-4a14-91b8-8e07a5791fed None admin] PATH_INFO: `/v3/users/55f866ae68a64272930e6c2fc087f066` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:12.833116 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b6433c-4f95-4a14-91b8-8e07a5791fed None admin] RBAC: Authorizing `identity:get_user(user_id=55f866ae68a64272930e6c2fc087f066)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:12.834571 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b6433c-4f95-4a14-91b8-8e07a5791fed None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:12.836487 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 143/284] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Sep 5 12:03:12 2022] GET /identity/v3/users/55f866ae68a64272930e6c2fc087f066 => generated 297 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:12.842333 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7018721-086b-4c26-b4ac-2d260cb24cb6 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:12.889919 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:12.972269 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403bf370-b8ef-46fa-860f-1ce4dd3d2e00 None None] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:12.972823 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403bf370-b8ef-46fa-860f-1ce4dd3d2e00 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:12.972823 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403bf370-b8ef-46fa-860f-1ce4dd3d2e00 None None] PATH_INFO: `/` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:12.974247 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 144/285] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:03:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:03:12.981560 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f40184-b10d-4d04-8c70-768566e19005 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:12.981848 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f40184-b10d-4d04-8c70-768566e19005 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:12.982108 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f40184-b10d-4d04-8c70-768566e19005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:12.998595 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7018721-086b-4c26-b4ac-2d260cb24cb6 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:13.003800 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-75f40184-b10d-4d04-8c70-768566e19005 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:03:13.005358 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-75f40184-b10d-4d04-8c70-768566e19005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:03:13.074401 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5555ca-8cb6-4887-a51c-d33d89240207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:13.075994 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5555ca-8cb6-4887-a51c-d33d89240207 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:13.077826 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5555ca-8cb6-4887-a51c-d33d89240207 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:13.078272 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5555ca-8cb6-4887-a51c-d33d89240207 None admin] PATH_INFO: `/v3/projects/b6c350f1ed014cad89f2c125d5de6e1e` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:13.080449 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5555ca-8cb6-4887-a51c-d33d89240207 None admin] RBAC: Authorizing `identity:get_project(project_id=b6c350f1ed014cad89f2c125d5de6e1e)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:13.082768 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5555ca-8cb6-4887-a51c-d33d89240207 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:13.089637 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 142/286] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Sep 5 12:03:12 2022] GET /identity/v3/projects/b6c350f1ed014cad89f2c125d5de6e1e => generated 302 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:13.097394 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5555ca-8cb6-4887-a51c-d33d89240207 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:13.147351 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 145/287] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:03:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 05 12:03:13.247544 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5555ca-8cb6-4887-a51c-d33d89240207 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:13.255795 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:13.292595 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff9ec86-509e-4261-b42e-55fe79ae0ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:13.293620 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff9ec86-509e-4261-b42e-55fe79ae0ce0 None admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:13.294039 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff9ec86-509e-4261-b42e-55fe79ae0ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:13.294450 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff9ec86-509e-4261-b42e-55fe79ae0ce0 None admin] PATH_INFO: `/v3/projects/b6c350f1ed014cad89f2c125d5de6e1e/users/55f866ae68a64272930e6c2fc087f066/roles/7759eb25e244436aa0b1be6aee7ebd1e` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:13.298980 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff9ec86-509e-4261-b42e-55fe79ae0ce0 None admin] RBAC: Authorizing `identity:create_grant(project_id=b6c350f1ed014cad89f2c125d5de6e1e, user_id=55f866ae68a64272930e6c2fc087f066, role_id=7759eb25e244436aa0b1be6aee7ebd1e)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:13.300935 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff9ec86-509e-4261-b42e-55fe79ae0ce0 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:13.325263 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 143/288] 10.222.0.50 () {58 vars in 1439 bytes} [Mon Sep 5 12:03:13 2022] PUT /identity/v3/projects/b6c350f1ed014cad89f2c125d5de6e1e/users/55f866ae68a64272930e6c2fc087f066/roles/7759eb25e244436aa0b1be6aee7ebd1e => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:03:13.697116 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f40184-b10d-4d04-8c70-768566e19005 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:13.832644 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f40184-b10d-4d04-8c70-768566e19005 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:13.836845 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:13.884474 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a763ff-eeec-45ab-ad85-8a62011c3f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:13.885146 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a763ff-eeec-45ab-ad85-8a62011c3f35 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:13.885424 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a763ff-eeec-45ab-ad85-8a62011c3f35 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:13.885695 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a763ff-eeec-45ab-ad85-8a62011c3f35 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:13.903781 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a763ff-eeec-45ab-ad85-8a62011c3f35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:03:13.908812 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application [None req-18a763ff-eeec-45ab-ad85-8a62011c3f35 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 05 12:03:13.908812 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:03:13.908812 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:03:13.908812 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:03:13.908812 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:03:13.908812 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:03:13.908812 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:03:13.908812 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:03:13.908812 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:03:13.908812 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:03:13.908812 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:03:13.908812 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:03:13.908812 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:03:13.908812 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:03:13.908812 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:03:13.908812 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:03:13.909702 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:03:13.909702 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:03:13.909702 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:03:13.909702 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:03:13.909702 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:03:13.909702 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:03:13.909702 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:03:13.909702 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:03:13.909702 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:03:13.909702 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:03:13.909702 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:03:13.909702 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application with Lock( Sep 05 12:03:13.909702 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:03:13.909702 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:03:13.909702 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:03:13.909702 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:03:13.910527 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:03:13.910527 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:03:13.910527 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:03:13.910527 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:03:13.910527 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:03:13.910527 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:03:13.910527 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:03:13.910527 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:03:13.910527 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:03:13.910527 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:03:13.910527 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 05 12:03:13.910527 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:03:13.910527 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 146/289] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Sep 5 12:03:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:03:13.917733 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff9ec86-509e-4261-b42e-55fe79ae0ce0 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:14.078132 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff9ec86-509e-4261-b42e-55fe79ae0ce0 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:14.116437 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b8029b-2ee0-4ddd-82ed-77bd110e751b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:14.117087 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b8029b-2ee0-4ddd-82ed-77bd110e751b None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:14.117368 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b8029b-2ee0-4ddd-82ed-77bd110e751b None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:14.117638 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b8029b-2ee0-4ddd-82ed-77bd110e751b None admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:14.118312 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b8029b-2ee0-4ddd-82ed-77bd110e751b None admin] RBAC: Adding query filter params (name=member) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:03:14.118613 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b8029b-2ee0-4ddd-82ed-77bd110e751b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:14.120061 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b8029b-2ee0-4ddd-82ed-77bd110e751b None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:14.130054 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 144/290] 10.222.0.50 () {56 vars in 1101 bytes} [Mon Sep 5 12:03:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:14.135626 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a763ff-eeec-45ab-ad85-8a62011c3f35 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:14.283205 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a763ff-eeec-45ab-ad85-8a62011c3f35 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:14.330700 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4036757-42e7-4485-8ea7-2eaf105c8962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:14.331254 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4036757-42e7-4485-8ea7-2eaf105c8962 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:14.331535 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4036757-42e7-4485-8ea7-2eaf105c8962 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:14.331812 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4036757-42e7-4485-8ea7-2eaf105c8962 None admin] PATH_INFO: `/v3/users/c8f4bfc651b845afad41957868c40013` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:14.333033 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4036757-42e7-4485-8ea7-2eaf105c8962 None admin] RBAC: Authorizing `identity:get_user(user_id=c8f4bfc651b845afad41957868c40013)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:14.334503 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4036757-42e7-4485-8ea7-2eaf105c8962 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:14.336465 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 147/291] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Sep 5 12:03:14 2022] GET /identity/v3/users/c8f4bfc651b845afad41957868c40013 => generated 297 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:14.342911 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b8029b-2ee0-4ddd-82ed-77bd110e751b None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:14.391219 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:14.469254 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b8029b-2ee0-4ddd-82ed-77bd110e751b None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:14.506825 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29763b93-e5cd-4b4e-928d-a0be894e3bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:14.507445 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29763b93-e5cd-4b4e-928d-a0be894e3bc7 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:14.507724 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29763b93-e5cd-4b4e-928d-a0be894e3bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:14.507994 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29763b93-e5cd-4b4e-928d-a0be894e3bc7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:14.526155 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6609fe-3147-43c8-a027-55fc508e25ac None None] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:14.526634 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6609fe-3147-43c8-a027-55fc508e25ac None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:14.527074 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6609fe-3147-43c8-a027-55fc508e25ac None None] PATH_INFO: `/` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:14.530151 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 148/292] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:03:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:03:14.542372 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198aa8ca-a91a-45bb-a0e8-4a02d33a6af1 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:14.542650 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198aa8ca-a91a-45bb-a0e8-4a02d33a6af1 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:14.543500 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198aa8ca-a91a-45bb-a0e8-4a02d33a6af1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:14.582584 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29763b93-e5cd-4b4e-928d-a0be894e3bc7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:14.583985 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29763b93-e5cd-4b4e-928d-a0be894e3bc7 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:14.593964 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-198aa8ca-a91a-45bb-a0e8-4a02d33a6af1 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:03:14.595210 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-198aa8ca-a91a-45bb-a0e8-4a02d33a6af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:03:14.621391 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:14.645632 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:14.695029 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 149/293] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:03:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:03:14.696403 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c537d930-df9e-4e9d-baa8-6930cc955098 None None] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:14.696638 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c537d930-df9e-4e9d-baa8-6930cc955098 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:14.697015 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c537d930-df9e-4e9d-baa8-6930cc955098 None None] PATH_INFO: `/` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:14.698799 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 150/294] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:03:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:03:14.699285 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 145/295] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Sep 5 12:03:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 12:03:14.706511 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa31f81-3d84-4468-84b4-a8336d311542 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:14.706828 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa31f81-3d84-4468-84b4-a8336d311542 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:14.707092 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa31f81-3d84-4468-84b4-a8336d311542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:14.708148 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29763b93-e5cd-4b4e-928d-a0be894e3bc7 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:14.750777 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-0fa31f81-3d84-4468-84b4-a8336d311542 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:03:14.752012 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-0fa31f81-3d84-4468-84b4-a8336d311542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:03:14.870383 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 151/296] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:03:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 05 12:03:14.872766 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19b6eb9-a7b1-4f2c-836f-d2532ebd5fd3 None None] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:14.873317 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19b6eb9-a7b1-4f2c-836f-d2532ebd5fd3 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:14.873769 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19b6eb9-a7b1-4f2c-836f-d2532ebd5fd3 None None] PATH_INFO: `/` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:14.880331 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 152/297] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:03:14 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:03:14.887305 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2110038-674d-4fe5-9842-3b84a937daaf None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:14.889138 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2110038-674d-4fe5-9842-3b84a937daaf None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:14.890369 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2110038-674d-4fe5-9842-3b84a937daaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:14.922648 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29763b93-e5cd-4b4e-928d-a0be894e3bc7 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:14.947432 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-b2110038-674d-4fe5-9842-3b84a937daaf None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:03:14.950353 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-b2110038-674d-4fe5-9842-3b84a937daaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:03:15.000283 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:15.004873 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d83778-2e4b-4cd4-a53a-4517e99ccd48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:15.005549 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d83778-2e4b-4cd4-a53a-4517e99ccd48 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:15.005854 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d83778-2e4b-4cd4-a53a-4517e99ccd48 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:15.006124 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d83778-2e4b-4cd4-a53a-4517e99ccd48 None admin] PATH_INFO: `/v3/projects/b6c350f1ed014cad89f2c125d5de6e1e` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:15.007801 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d83778-2e4b-4cd4-a53a-4517e99ccd48 None admin] RBAC: Authorizing `identity:get_project(project_id=b6c350f1ed014cad89f2c125d5de6e1e)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:15.009631 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d83778-2e4b-4cd4-a53a-4517e99ccd48 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:15.017313 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 146/298] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Sep 5 12:03:14 2022] GET /identity/v3/projects/b6c350f1ed014cad89f2c125d5de6e1e => generated 302 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:15.018248 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d83778-2e4b-4cd4-a53a-4517e99ccd48 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:15.081075 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 153/299] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:03:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:03:15.082257 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2110038-674d-4fe5-9842-3b84a937daaf None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:15.111851 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:15.187432 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d83778-2e4b-4cd4-a53a-4517e99ccd48 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:15.228879 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2110038-674d-4fe5-9842-3b84a937daaf None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:15.240575 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5937bcaa-59c9-45d2-9c6d-627ff556c019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:15.241634 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5937bcaa-59c9-45d2-9c6d-627ff556c019 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:15.241916 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5937bcaa-59c9-45d2-9c6d-627ff556c019 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:15.242188 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5937bcaa-59c9-45d2-9c6d-627ff556c019 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:15.257052 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5937bcaa-59c9-45d2-9c6d-627ff556c019 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:03:15.264397 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-5937bcaa-59c9-45d2-9c6d-627ff556c019 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 05 12:03:15.264397 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:03:15.264397 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:03:15.264397 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:03:15.264397 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:03:15.264397 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:03:15.264397 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:03:15.264397 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:03:15.264397 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:03:15.264397 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:03:15.264397 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:03:15.264397 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:03:15.264397 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:03:15.264397 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:03:15.264397 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:03:15.264397 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:03:15.265341 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:03:15.265341 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:03:15.265341 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:03:15.265341 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:03:15.265341 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:03:15.265341 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:03:15.265341 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:03:15.265341 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:03:15.265341 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:03:15.265341 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:03:15.265341 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:03:15.265341 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:03:15.265341 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:03:15.265341 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:03:15.265341 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:03:15.265341 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:03:15.266136 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:03:15.266136 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:03:15.266136 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:03:15.266136 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:03:15.266136 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:03:15.266136 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:03:15.266136 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:03:15.266136 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:03:15.266136 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:03:15.266136 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:03:15.266136 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 05 12:03:15.266136 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:03:15.266764 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b609e405-403d-47da-b44a-b3f373a921b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:15.267355 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b609e405-403d-47da-b44a-b3f373a921b9 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:15.267590 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b609e405-403d-47da-b44a-b3f373a921b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:15.267863 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b609e405-403d-47da-b44a-b3f373a921b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:15.268654 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b609e405-403d-47da-b44a-b3f373a921b9 None admin] RBAC: Adding query filter params (role.id=ed72181e1403401facb77dcf33644757, scope.project.id=b6c350f1ed014cad89f2c125d5de6e1e, user.id=c8f4bfc651b845afad41957868c40013) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:03:15.268995 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b609e405-403d-47da-b44a-b3f373a921b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:15.269843 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 147/300] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Sep 5 12:03:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:03:15.270496 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b609e405-403d-47da-b44a-b3f373a921b9 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:15.271262 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5937bcaa-59c9-45d2-9c6d-627ff556c019 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:15.282564 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 154/301] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Sep 5 12:03:15 2022] GET /identity/v3/role_assignments?user.id=c8f4bfc651b845afad41957868c40013&scope.project.id=b6c350f1ed014cad89f2c125d5de6e1e&role.id=ed72181e1403401facb77dcf33644757 => generated 608 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:15.289736 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b609e405-403d-47da-b44a-b3f373a921b9 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:15.347808 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:15.410021 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5937bcaa-59c9-45d2-9c6d-627ff556c019 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:15.443071 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:15.466870 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b609ea-fc06-47d8-b7dc-9b2d8f602100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:15.467585 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b609ea-fc06-47d8-b7dc-9b2d8f602100 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:15.467870 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b609ea-fc06-47d8-b7dc-9b2d8f602100 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:15.468146 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b609ea-fc06-47d8-b7dc-9b2d8f602100 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:15.468440 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b609e405-403d-47da-b44a-b3f373a921b9 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:15.469385 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b609ea-fc06-47d8-b7dc-9b2d8f602100 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:15.471090 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b609ea-fc06-47d8-b7dc-9b2d8f602100 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:15.473178 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 148/302] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 5 12:03:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:15.478220 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b609ea-fc06-47d8-b7dc-9b2d8f602100 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:15.517248 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197b905d-2951-4e6e-97f9-35045e9f7a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:15.517863 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197b905d-2951-4e6e-97f9-35045e9f7a9d None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:15.518144 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197b905d-2951-4e6e-97f9-35045e9f7a9d None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:15.518417 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197b905d-2951-4e6e-97f9-35045e9f7a9d None admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:15.519092 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197b905d-2951-4e6e-97f9-35045e9f7a9d None admin] RBAC: Adding query filter params (name=member) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:03:15.519398 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197b905d-2951-4e6e-97f9-35045e9f7a9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:15.520830 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197b905d-2951-4e6e-97f9-35045e9f7a9d None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:15.531301 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 155/303] 10.222.0.50 () {56 vars in 1101 bytes} [Mon Sep 5 12:03:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:15.532413 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197b905d-2951-4e6e-97f9-35045e9f7a9d None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:15.606490 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b609ea-fc06-47d8-b7dc-9b2d8f602100 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:15.631932 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:15.646164 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c77f6a-5eb4-4a06-8b69-57e8433d7d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:15.646801 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c77f6a-5eb4-4a06-8b69-57e8433d7d82 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:15.647389 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c77f6a-5eb4-4a06-8b69-57e8433d7d82 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:15.647664 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c77f6a-5eb4-4a06-8b69-57e8433d7d82 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:15.660764 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c77f6a-5eb4-4a06-8b69-57e8433d7d82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:03:15.665664 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-86c77f6a-5eb4-4a06-8b69-57e8433d7d82 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 05 12:03:15.665664 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:03:15.665664 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:03:15.665664 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:03:15.665664 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:03:15.665664 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:03:15.665664 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:03:15.665664 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:03:15.665664 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:03:15.665664 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:03:15.665664 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:03:15.665664 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:03:15.665664 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:03:15.665664 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:03:15.665664 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:03:15.665664 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:03:15.666572 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:03:15.666572 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:03:15.666572 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:03:15.666572 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:03:15.666572 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:03:15.666572 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:03:15.666572 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:03:15.666572 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:03:15.666572 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:03:15.666572 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:03:15.666572 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:03:15.666572 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:03:15.666572 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:03:15.666572 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:03:15.666572 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:03:15.666572 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:03:15.667455 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:03:15.667455 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:03:15.667455 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:03:15.667455 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:03:15.667455 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:03:15.667455 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:03:15.667455 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:03:15.667455 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:03:15.667455 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:03:15.667455 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:03:15.667455 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 05 12:03:15.667455 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:03:15.667455 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 149/304] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Sep 5 12:03:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:03:15.668214 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c77f6a-5eb4-4a06-8b69-57e8433d7d82 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:15.677851 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197b905d-2951-4e6e-97f9-35045e9f7a9d None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:15.717833 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbfce99-482e-4b18-83e5-fbd3b0ea5666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:15.718348 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbfce99-482e-4b18-83e5-fbd3b0ea5666 None admin] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:15.718631 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbfce99-482e-4b18-83e5-fbd3b0ea5666 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:15.718905 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbfce99-482e-4b18-83e5-fbd3b0ea5666 None admin] PATH_INFO: `/v3/groups` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:15.719548 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbfce99-482e-4b18-83e5-fbd3b0ea5666 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:15.721029 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbfce99-482e-4b18-83e5-fbd3b0ea5666 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:15.738307 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 156/305] 10.222.0.50 () {60 vars in 1134 bytes} [Mon Sep 5 12:03:15 2022] POST /identity/v3/groups => generated 229 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:03:15.739222 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbfce99-482e-4b18-83e5-fbd3b0ea5666 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:15.751881 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:15.797362 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c77f6a-5eb4-4a06-8b69-57e8433d7d82 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:15.836317 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8070846-71d2-4a99-b4e0-7b392de3caa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:15.837138 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8070846-71d2-4a99-b4e0-7b392de3caa4 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:15.837426 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8070846-71d2-4a99-b4e0-7b392de3caa4 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:15.837799 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8070846-71d2-4a99-b4e0-7b392de3caa4 None admin] PATH_INFO: `/v3/users/d6ef6aef0d8a49208d7b3884568ef4cc` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:15.839065 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8070846-71d2-4a99-b4e0-7b392de3caa4 None admin] RBAC: Authorizing `identity:get_user(user_id=d6ef6aef0d8a49208d7b3884568ef4cc)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:15.841169 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8070846-71d2-4a99-b4e0-7b392de3caa4 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:15.843055 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 150/306] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Sep 5 12:03:15 2022] GET /identity/v3/users/d6ef6aef0d8a49208d7b3884568ef4cc => generated 293 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:15.844115 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4c8d85-c38a-4e2d-b7bd-a90f29ac3ede None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:15.844396 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4c8d85-c38a-4e2d-b7bd-a90f29ac3ede None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:15.844675 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4c8d85-c38a-4e2d-b7bd-a90f29ac3ede None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:15.846138 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 151/307] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:03:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:03:15.851916 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb608e-b4c8-425f-b5cc-12a95efff176 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:15.852201 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb608e-b4c8-425f-b5cc-12a95efff176 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:15.852477 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb608e-b4c8-425f-b5cc-12a95efff176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:15.873150 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-dfdb608e-b4c8-425f-b5cc-12a95efff176 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:03:15.874677 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-dfdb608e-b4c8-425f-b5cc-12a95efff176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:03:15.877409 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbfce99-482e-4b18-83e5-fbd3b0ea5666 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:15.922045 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c83f601-1ec1-40b0-892c-d7192c6741b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:15.922677 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c83f601-1ec1-40b0-892c-d7192c6741b7 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:15.922970 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c83f601-1ec1-40b0-892c-d7192c6741b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:15.923243 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c83f601-1ec1-40b0-892c-d7192c6741b7 None admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:15.923922 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c83f601-1ec1-40b0-892c-d7192c6741b7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:03:15.924225 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c83f601-1ec1-40b0-892c-d7192c6741b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:15.925741 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c83f601-1ec1-40b0-892c-d7192c6741b7 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:15.934570 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:15.937459 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 157/308] 10.222.0.50 () {56 vars in 1101 bytes} [Mon Sep 5 12:03:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:15.938373 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c83f601-1ec1-40b0-892c-d7192c6741b7 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:15.962957 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 152/309] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:03:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:03:15.964085 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdb608e-b4c8-425f-b5cc-12a95efff176 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:16.039865 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:16.079208 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c83f601-1ec1-40b0-892c-d7192c6741b7 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:16.082120 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdb608e-b4c8-425f-b5cc-12a95efff176 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:16.117693 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b930da-b4dd-4b40-a52c-368c6c86186d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:16.118337 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b930da-b4dd-4b40-a52c-368c6c86186d None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:16.118567 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b930da-b4dd-4b40-a52c-368c6c86186d None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:16.118836 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b930da-b4dd-4b40-a52c-368c6c86186d None admin] PATH_INFO: `/v3/users/ab2585f84bb04db887b999f1ec10328d` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:16.120320 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea14474-d777-411d-a2a5-baa7a097a458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:16.121734 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea14474-d777-411d-a2a5-baa7a097a458 None admin] REQUEST_METHOD: `PUT` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:16.122040 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea14474-d777-411d-a2a5-baa7a097a458 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:16.122397 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea14474-d777-411d-a2a5-baa7a097a458 None admin] PATH_INFO: `/v3/system/users/d6ef6aef0d8a49208d7b3884568ef4cc/roles/ed72181e1403401facb77dcf33644757` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:16.123879 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea14474-d777-411d-a2a5-baa7a097a458 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=d6ef6aef0d8a49208d7b3884568ef4cc, role_id=ed72181e1403401facb77dcf33644757)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:16.125371 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea14474-d777-411d-a2a5-baa7a097a458 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:16.135017 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b930da-b4dd-4b40-a52c-368c6c86186d None admin] RBAC: Authorizing `identity:get_user(user_id=ab2585f84bb04db887b999f1ec10328d)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:16.135747 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 158/310] 10.222.0.50 () {58 vars in 1334 bytes} [Mon Sep 5 12:03:15 2022] PUT /identity/v3/system/users/d6ef6aef0d8a49208d7b3884568ef4cc/roles/ed72181e1403401facb77dcf33644757 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:03:16.136716 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b930da-b4dd-4b40-a52c-368c6c86186d None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:16.147273 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 153/311] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Sep 5 12:03:15 2022] GET /identity/v3/users/ab2585f84bb04db887b999f1ec10328d => generated 293 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:16.156658 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea14474-d777-411d-a2a5-baa7a097a458 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:16.240481 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b930da-b4dd-4b40-a52c-368c6c86186d None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:16.282017 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea14474-d777-411d-a2a5-baa7a097a458 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:16.301095 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:16.326307 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea4cf13-cff5-4f18-80db-2c1c45325a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:16.326978 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea4cf13-cff5-4f18-80db-2c1c45325a43 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:16.326978 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea4cf13-cff5-4f18-80db-2c1c45325a43 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:16.327279 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea4cf13-cff5-4f18-80db-2c1c45325a43 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:16.328051 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea4cf13-cff5-4f18-80db-2c1c45325a43 None admin] RBAC: Adding query filter params (role.id=7759eb25e244436aa0b1be6aee7ebd1e, user.id=ab2585f84bb04db887b999f1ec10328d, scope.system=all) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:03:16.328363 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea4cf13-cff5-4f18-80db-2c1c45325a43 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:16.330302 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea4cf13-cff5-4f18-80db-2c1c45325a43 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:16.331598 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:16.336950 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 159/312] 10.222.0.50 () {56 vars in 1308 bytes} [Mon Sep 5 12:03:16 2022] GET /identity/v3/role_assignments?user.id=ab2585f84bb04db887b999f1ec10328d&scope.system=all&role.id=7759eb25e244436aa0b1be6aee7ebd1e => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:03:16.377086 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b930da-b4dd-4b40-a52c-368c6c86186d None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:16.415778 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57591d4-6390-4533-a332-5f18859e0f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:16.416435 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57591d4-6390-4533-a332-5f18859e0f38 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:16.416718 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57591d4-6390-4533-a332-5f18859e0f38 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:16.417022 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57591d4-6390-4533-a332-5f18859e0f38 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:16.436295 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57591d4-6390-4533-a332-5f18859e0f38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:03:16.439681 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-a57591d4-6390-4533-a332-5f18859e0f38 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 05 12:03:16.439681 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:03:16.439681 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:03:16.439681 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:03:16.439681 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:03:16.439681 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:03:16.439681 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:03:16.439681 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:03:16.439681 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:03:16.439681 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:03:16.439681 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:03:16.439681 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:03:16.439681 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:03:16.439681 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:03:16.439681 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:03:16.439681 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:03:16.440639 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:03:16.440639 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:03:16.440639 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:03:16.440639 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:03:16.440639 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:03:16.440639 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:03:16.440639 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:03:16.440639 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:03:16.440639 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:03:16.440639 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:03:16.440639 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:03:16.440639 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:03:16.440639 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:03:16.440639 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:03:16.440639 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:03:16.440639 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:03:16.441507 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:03:16.441507 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:03:16.441507 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:03:16.441507 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:03:16.441507 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:03:16.441507 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:03:16.441507 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:03:16.441507 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:03:16.441507 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:03:16.441507 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:03:16.441507 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 05 12:03:16.441507 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:03:16.444385 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 154/313] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Sep 5 12:03:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:03:16.450157 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea4cf13-cff5-4f18-80db-2c1c45325a43 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:16.567212 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea4cf13-cff5-4f18-80db-2c1c45325a43 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:16.604172 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b202bca-f1c2-4538-82d0-4ac23567945a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:16.604794 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b202bca-f1c2-4538-82d0-4ac23567945a None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:16.605112 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b202bca-f1c2-4538-82d0-4ac23567945a None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:16.605947 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b202bca-f1c2-4538-82d0-4ac23567945a None admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:16.606700 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b202bca-f1c2-4538-82d0-4ac23567945a None admin] RBAC: Adding query filter params (name=reader) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:03:16.607011 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b202bca-f1c2-4538-82d0-4ac23567945a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:16.608497 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b202bca-f1c2-4538-82d0-4ac23567945a None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:16.617992 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 160/314] 10.222.0.50 () {56 vars in 1101 bytes} [Mon Sep 5 12:03:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:16.623350 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57591d4-6390-4533-a332-5f18859e0f38 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:16.729405 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:16.732422 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57591d4-6390-4533-a332-5f18859e0f38 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:16.768402 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb07d3b-4685-4a67-9069-a84a57362520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:16.769130 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb07d3b-4685-4a67-9069-a84a57362520 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:16.769453 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb07d3b-4685-4a67-9069-a84a57362520 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:16.769677 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb07d3b-4685-4a67-9069-a84a57362520 None admin] PATH_INFO: `/v3/users/55f866ae68a64272930e6c2fc087f066` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:16.770933 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb07d3b-4685-4a67-9069-a84a57362520 None admin] RBAC: Authorizing `identity:get_user(user_id=55f866ae68a64272930e6c2fc087f066)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:16.772402 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb07d3b-4685-4a67-9069-a84a57362520 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:16.774629 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 155/315] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Sep 5 12:03:16 2022] GET /identity/v3/users/55f866ae68a64272930e6c2fc087f066 => generated 297 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:16.784223 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b202bca-f1c2-4538-82d0-4ac23567945a None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:16.854719 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:16.899020 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b202bca-f1c2-4538-82d0-4ac23567945a None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:16.934444 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f565dc1d-058f-4684-bf54-b32852b41181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:16.935056 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f565dc1d-058f-4684-bf54-b32852b41181 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:16.935334 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f565dc1d-058f-4684-bf54-b32852b41181 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:16.935605 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f565dc1d-058f-4684-bf54-b32852b41181 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:17.008407 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f565dc1d-058f-4684-bf54-b32852b41181 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:17.009896 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f565dc1d-058f-4684-bf54-b32852b41181 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:17.069952 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:17.113675 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 161/316] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Sep 5 12:03:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 12:03:17.119794 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb07d3b-4685-4a67-9069-a84a57362520 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:17.223969 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb07d3b-4685-4a67-9069-a84a57362520 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:17.262753 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6331fe-2390-431e-8e65-c48b0d6219b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:17.263390 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6331fe-2390-431e-8e65-c48b0d6219b4 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:17.263666 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6331fe-2390-431e-8e65-c48b0d6219b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:17.263933 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6331fe-2390-431e-8e65-c48b0d6219b4 None admin] PATH_INFO: `/v3/projects/b6c350f1ed014cad89f2c125d5de6e1e` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:17.265092 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6331fe-2390-431e-8e65-c48b0d6219b4 None admin] RBAC: Authorizing `identity:get_project(project_id=b6c350f1ed014cad89f2c125d5de6e1e)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:17.266541 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6331fe-2390-431e-8e65-c48b0d6219b4 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:17.268494 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 156/317] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Sep 5 12:03:17 2022] GET /identity/v3/projects/b6c350f1ed014cad89f2c125d5de6e1e => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:17.274785 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f565dc1d-058f-4684-bf54-b32852b41181 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:17.379222 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f565dc1d-058f-4684-bf54-b32852b41181 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:17.420918 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80aa98e-cb5f-478f-b4b2-1889fb96034b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:17.421555 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80aa98e-cb5f-478f-b4b2-1889fb96034b None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:17.421833 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80aa98e-cb5f-478f-b4b2-1889fb96034b None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:17.422100 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80aa98e-cb5f-478f-b4b2-1889fb96034b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:17.422829 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80aa98e-cb5f-478f-b4b2-1889fb96034b None admin] RBAC: Adding query filter params (role.id=7759eb25e244436aa0b1be6aee7ebd1e, scope.project.id=b6c350f1ed014cad89f2c125d5de6e1e, user.id=55f866ae68a64272930e6c2fc087f066) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:03:17.423154 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80aa98e-cb5f-478f-b4b2-1889fb96034b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:17.424602 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80aa98e-cb5f-478f-b4b2-1889fb96034b None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:17.431369 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 162/318] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Sep 5 12:03:17 2022] GET /identity/v3/role_assignments?user.id=55f866ae68a64272930e6c2fc087f066&scope.project.id=b6c350f1ed014cad89f2c125d5de6e1e&role.id=7759eb25e244436aa0b1be6aee7ebd1e => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:17.837221 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e40791-7094-4d8d-a538-6f82c1def5f3 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:17.837582 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e40791-7094-4d8d-a538-6f82c1def5f3 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:17.837777 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e40791-7094-4d8d-a538-6f82c1def5f3 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:17.839272 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 157/319] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:03:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:03:17.844631 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea888693-f0e0-4f70-8137-44330550e201 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:17.844927 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea888693-f0e0-4f70-8137-44330550e201 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:17.845203 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea888693-f0e0-4f70-8137-44330550e201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:17.864735 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-ea888693-f0e0-4f70-8137-44330550e201 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:03:17.865963 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-ea888693-f0e0-4f70-8137-44330550e201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:03:17.884842 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:17.936401 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 163/320] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:03:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:03:18.209778 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e40791-7094-4d8d-a538-6f82c1def5f3 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:18.247489 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:18.296628 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eaa237-c1bc-426b-863d-3503a8684b11 None None] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:18.296937 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eaa237-c1bc-426b-863d-3503a8684b11 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:18.297215 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eaa237-c1bc-426b-863d-3503a8684b11 None None] PATH_INFO: `/` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:18.298704 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 164/321] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:03:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 12:03:18.303414 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f086943-e47f-4b07-99ac-0c810977ad94 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:18.303693 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f086943-e47f-4b07-99ac-0c810977ad94 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:18.303961 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f086943-e47f-4b07-99ac-0c810977ad94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:18.319088 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e40791-7094-4d8d-a538-6f82c1def5f3 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:18.321932 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-9f086943-e47f-4b07-99ac-0c810977ad94 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:03:18.323144 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-9f086943-e47f-4b07-99ac-0c810977ad94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:03:18.354758 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db362912-feff-4b5e-829d-37088ad02912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:18.355965 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db362912-feff-4b5e-829d-37088ad02912 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:18.356248 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db362912-feff-4b5e-829d-37088ad02912 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:18.356518 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db362912-feff-4b5e-829d-37088ad02912 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:18.357646 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db362912-feff-4b5e-829d-37088ad02912 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:18.359084 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db362912-feff-4b5e-829d-37088ad02912 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:18.360657 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 158/322] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 5 12:03:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:18.361820 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421b4cd2-df0a-4fd7-b910-77e4a123ca18 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:18.362101 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421b4cd2-df0a-4fd7-b910-77e4a123ca18 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:18.362373 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421b4cd2-df0a-4fd7-b910-77e4a123ca18 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:18.365028 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 159/323] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:03:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:03:18.366185 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421b4cd2-df0a-4fd7-b910-77e4a123ca18 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:18.392086 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 165/324] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:03:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 05 12:03:18.393362 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4e735f-4911-46e1-aaf3-4081c928dd82 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:18.393646 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4e735f-4911-46e1-aaf3-4081c928dd82 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:18.393917 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4e735f-4911-46e1-aaf3-4081c928dd82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:18.412407 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-7a4e735f-4911-46e1-aaf3-4081c928dd82 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:03:18.413670 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-7a4e735f-4911-46e1-aaf3-4081c928dd82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:03:18.474566 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421b4cd2-df0a-4fd7-b910-77e4a123ca18 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:18.478104 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:18.500921 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 166/325] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:03:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:03:18.510957 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e2c092-96b7-4f6e-b1e3-59b9b8fe1214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:18.512098 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e2c092-96b7-4f6e-b1e3-59b9b8fe1214 None admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:18.512380 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e2c092-96b7-4f6e-b1e3-59b9b8fe1214 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:18.512686 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e2c092-96b7-4f6e-b1e3-59b9b8fe1214 None admin] PATH_INFO: `/v3/groups` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:18.513346 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e2c092-96b7-4f6e-b1e3-59b9b8fe1214 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:18.514777 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e2c092-96b7-4f6e-b1e3-59b9b8fe1214 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:18.532392 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 160/326] 10.222.0.50 () {60 vars in 1134 bytes} [Mon Sep 5 12:03:18 2022] POST /identity/v3/groups => generated 226 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 12:03:18.661995 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4e735f-4911-46e1-aaf3-4081c928dd82 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:18.678362 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:18.765069 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e2c092-96b7-4f6e-b1e3-59b9b8fe1214 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:18.780636 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4e735f-4911-46e1-aaf3-4081c928dd82 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:18.826668 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5bbe0e-756c-464a-8620-081b2768c758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:18.827317 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5bbe0e-756c-464a-8620-081b2768c758 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:18.827598 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5bbe0e-756c-464a-8620-081b2768c758 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:18.827872 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5bbe0e-756c-464a-8620-081b2768c758 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:18.840759 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5bbe0e-756c-464a-8620-081b2768c758 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:03:18.845861 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application [None req-8c5bbe0e-756c-464a-8620-081b2768c758 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 05 12:03:18.845861 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:03:18.845861 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:03:18.845861 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:03:18.845861 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:03:18.845861 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:03:18.845861 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:03:18.845861 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:03:18.845861 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:03:18.845861 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:03:18.845861 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:03:18.845861 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:03:18.845861 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:03:18.845861 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:03:18.845861 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:03:18.845861 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:03:18.846784 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:03:18.846784 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:03:18.846784 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:03:18.846784 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:03:18.846784 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:03:18.846784 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:03:18.846784 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:03:18.846784 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:03:18.846784 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:03:18.846784 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:03:18.846784 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:03:18.846784 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application with Lock( Sep 05 12:03:18.846784 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:03:18.846784 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:03:18.846784 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:03:18.846784 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:03:18.847840 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:03:18.847840 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:03:18.847840 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:03:18.847840 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:03:18.847840 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:03:18.847840 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:03:18.847840 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:03:18.847840 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:03:18.847840 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:03:18.847840 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:03:18.847840 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 05 12:03:18.847840 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:03:18.847840 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 167/327] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Sep 5 12:03:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:03:18.852654 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5bbe0e-756c-464a-8620-081b2768c758 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:18.916576 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e2c092-96b7-4f6e-b1e3-59b9b8fe1214 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:18.955967 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:18.969893 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a938688c-c56a-4366-b92b-f745113d48c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:18.970965 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a938688c-c56a-4366-b92b-f745113d48c8 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:18.971619 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a938688c-c56a-4366-b92b-f745113d48c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:18.972415 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a938688c-c56a-4366-b92b-f745113d48c8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:18.987486 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a938688c-c56a-4366-b92b-f745113d48c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:03:18.990246 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5bbe0e-756c-464a-8620-081b2768c758 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:18.993361 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-a938688c-c56a-4366-b92b-f745113d48c8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 05 12:03:18.993361 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:03:18.993361 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:03:18.993361 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:03:18.993361 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:03:18.993361 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:03:18.993361 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:03:18.993361 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:03:18.993361 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:03:18.993361 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:03:18.993361 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:03:18.993361 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:03:18.993361 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:03:18.993361 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:03:18.993361 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:03:18.993361 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:03:18.994291 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:03:18.994291 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:03:18.994291 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:03:18.994291 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:03:18.994291 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:03:18.994291 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:03:18.994291 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:03:18.994291 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:03:18.994291 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:03:18.994291 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:03:18.994291 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:03:18.994291 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:03:18.994291 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:03:18.994291 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:03:18.994291 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:03:18.994291 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:03:18.995289 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:03:18.995289 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:03:18.995289 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:03:18.995289 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:03:18.995289 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:03:18.995289 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:03:18.995289 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:03:18.995289 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:03:18.995289 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:03:18.995289 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:03:18.995289 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 05 12:03:18.995289 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:03:19.001080 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 161/328] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Sep 5 12:03:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 12:03:19.003080 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a938688c-c56a-4366-b92b-f745113d48c8 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:19.038966 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:19.044333 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd43a6c-c0b0-4f74-977d-f2733f571b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:19.045565 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd43a6c-c0b0-4f74-977d-f2733f571b11 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:19.045996 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd43a6c-c0b0-4f74-977d-f2733f571b11 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:19.046270 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd43a6c-c0b0-4f74-977d-f2733f571b11 None admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:19.047295 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd43a6c-c0b0-4f74-977d-f2733f571b11 None admin] RBAC: Adding query filter params (name=member) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:03:19.047605 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd43a6c-c0b0-4f74-977d-f2733f571b11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:19.049440 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd43a6c-c0b0-4f74-977d-f2733f571b11 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:19.063196 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 168/329] 10.222.0.50 () {56 vars in 1101 bytes} [Mon Sep 5 12:03:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:03:19.069259 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd43a6c-c0b0-4f74-977d-f2733f571b11 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:19.135504 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a938688c-c56a-4366-b92b-f745113d48c8 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:19.179429 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0d84f5-a569-472b-b1d5-d58ce4648e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:19.180055 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0d84f5-a569-472b-b1d5-d58ce4648e55 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:19.180331 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0d84f5-a569-472b-b1d5-d58ce4648e55 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:19.180602 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0d84f5-a569-472b-b1d5-d58ce4648e55 None admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:19.181418 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0d84f5-a569-472b-b1d5-d58ce4648e55 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:03:19.181720 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0d84f5-a569-472b-b1d5-d58ce4648e55 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:19.183144 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0d84f5-a569-472b-b1d5-d58ce4648e55 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:19.193247 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 162/330] 10.222.0.50 () {56 vars in 1101 bytes} [Mon Sep 5 12:03:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:03:19.200155 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0d84f5-a569-472b-b1d5-d58ce4648e55 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:19.216915 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd43a6c-c0b0-4f74-977d-f2733f571b11 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:19.257401 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1544ae-405b-4029-91c3-2b6c14fc8d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:19.258047 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1544ae-405b-4029-91c3-2b6c14fc8d68 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:19.258394 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1544ae-405b-4029-91c3-2b6c14fc8d68 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:19.258720 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1544ae-405b-4029-91c3-2b6c14fc8d68 None admin] PATH_INFO: `/v3/users/d6ef6aef0d8a49208d7b3884568ef4cc` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:19.262195 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1544ae-405b-4029-91c3-2b6c14fc8d68 None admin] RBAC: Authorizing `identity:get_user(user_id=d6ef6aef0d8a49208d7b3884568ef4cc)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:19.263660 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1544ae-405b-4029-91c3-2b6c14fc8d68 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:19.265955 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 169/331] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Sep 5 12:03:19 2022] GET /identity/v3/users/d6ef6aef0d8a49208d7b3884568ef4cc => generated 293 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:19.272068 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1544ae-405b-4029-91c3-2b6c14fc8d68 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:19.279406 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:19.318262 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:19.338633 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0d84f5-a569-472b-b1d5-d58ce4648e55 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:19.385277 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbc2b09-145f-447e-87d2-c83381780865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:19.385939 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbc2b09-145f-447e-87d2-c83381780865 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:19.386520 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbc2b09-145f-447e-87d2-c83381780865 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:19.386804 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbc2b09-145f-447e-87d2-c83381780865 None admin] PATH_INFO: `/v3/users/ab2585f84bb04db887b999f1ec10328d` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:19.388279 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbc2b09-145f-447e-87d2-c83381780865 None admin] RBAC: Authorizing `identity:get_user(user_id=ab2585f84bb04db887b999f1ec10328d)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:19.390204 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbc2b09-145f-447e-87d2-c83381780865 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:19.392770 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 163/332] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Sep 5 12:03:19 2022] GET /identity/v3/users/ab2585f84bb04db887b999f1ec10328d => generated 293 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:19.398685 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbc2b09-145f-447e-87d2-c83381780865 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:19.410887 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1544ae-405b-4029-91c3-2b6c14fc8d68 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:19.465134 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c716a214-a39d-479f-a084-d3a233814dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:19.465849 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c716a214-a39d-479f-a084-d3a233814dae None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:19.466129 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c716a214-a39d-479f-a084-d3a233814dae None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:19.466400 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c716a214-a39d-479f-a084-d3a233814dae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:19.467172 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c716a214-a39d-479f-a084-d3a233814dae None admin] RBAC: Adding query filter params (role.id=ed72181e1403401facb77dcf33644757, user.id=d6ef6aef0d8a49208d7b3884568ef4cc, scope.system=all) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:03:19.467483 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c716a214-a39d-479f-a084-d3a233814dae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:19.469218 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c716a214-a39d-479f-a084-d3a233814dae None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:19.486992 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 170/333] 10.222.0.50 () {56 vars in 1308 bytes} [Mon Sep 5 12:03:19 2022] GET /identity/v3/role_assignments?user.id=d6ef6aef0d8a49208d7b3884568ef4cc&scope.system=all&role.id=ed72181e1403401facb77dcf33644757 => generated 510 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:03:19.525736 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbc2b09-145f-447e-87d2-c83381780865 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:19.565841 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d1a350-30e2-47df-8b97-3715697d6076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:19.566514 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d1a350-30e2-47df-8b97-3715697d6076 None admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:19.566793 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d1a350-30e2-47df-8b97-3715697d6076 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:19.567069 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d1a350-30e2-47df-8b97-3715697d6076 None admin] PATH_INFO: `/v3/system/users/ab2585f84bb04db887b999f1ec10328d/roles/7759eb25e244436aa0b1be6aee7ebd1e` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:19.568701 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d1a350-30e2-47df-8b97-3715697d6076 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=ab2585f84bb04db887b999f1ec10328d, role_id=7759eb25e244436aa0b1be6aee7ebd1e)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:19.570113 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d1a350-30e2-47df-8b97-3715697d6076 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:19.586324 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 164/334] 10.222.0.50 () {58 vars in 1334 bytes} [Mon Sep 5 12:03:19 2022] PUT /identity/v3/system/users/ab2585f84bb04db887b999f1ec10328d/roles/7759eb25e244436aa0b1be6aee7ebd1e => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:03:20.867081 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc15bcf-9aff-4823-a50f-d116ad3ba640 None None] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:20.867744 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc15bcf-9aff-4823-a50f-d116ad3ba640 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:20.867744 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc15bcf-9aff-4823-a50f-d116ad3ba640 None None] PATH_INFO: `/` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:20.869387 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 171/335] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:03:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:03:20.889635 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfebefe-7c6c-4107-a73b-5e1ade3c9b75 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:20.890289 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfebefe-7c6c-4107-a73b-5e1ade3c9b75 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:20.890289 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfebefe-7c6c-4107-a73b-5e1ade3c9b75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:20.918057 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-0bfebefe-7c6c-4107-a73b-5e1ade3c9b75 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:03:20.919290 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-0bfebefe-7c6c-4107-a73b-5e1ade3c9b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:03:20.934895 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:20.958956 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a9d563-c2d2-4e98-bd83-7f50940ab0d9 None None] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:20.959573 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a9d563-c2d2-4e98-bd83-7f50940ab0d9 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:20.960050 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a9d563-c2d2-4e98-bd83-7f50940ab0d9 None None] PATH_INFO: `/` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:20.962620 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 172/336] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:03:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:03:20.969546 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec2346c-4e36-457b-9def-d0675acde5aa None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:20.970146 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec2346c-4e36-457b-9def-d0675acde5aa None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:20.970638 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec2346c-4e36-457b-9def-d0675acde5aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:20.994978 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-6ec2346c-4e36-457b-9def-d0675acde5aa None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:03:20.996847 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-6ec2346c-4e36-457b-9def-d0675acde5aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:03:21.018786 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 165/337] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:03:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:03:21.073846 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:21.087960 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 173/338] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:03:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 05 12:03:21.421555 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfebefe-7c6c-4107-a73b-5e1ade3c9b75 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:21.530437 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfebefe-7c6c-4107-a73b-5e1ade3c9b75 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:21.567080 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9900efcd-a2d1-49ec-a758-b6dd559544c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:21.567724 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9900efcd-a2d1-49ec-a758-b6dd559544c1 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:21.568006 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9900efcd-a2d1-49ec-a758-b6dd559544c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:21.568274 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9900efcd-a2d1-49ec-a758-b6dd559544c1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:21.579966 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9900efcd-a2d1-49ec-a758-b6dd559544c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:03:21.584929 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-9900efcd-a2d1-49ec-a758-b6dd559544c1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 05 12:03:21.584929 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:03:21.584929 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:03:21.584929 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:03:21.584929 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:03:21.584929 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:03:21.584929 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:03:21.584929 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:03:21.584929 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:03:21.584929 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:03:21.584929 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:03:21.584929 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:03:21.584929 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:03:21.584929 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:03:21.584929 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:03:21.584929 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:03:21.585918 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:03:21.585918 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:03:21.585918 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:03:21.585918 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:03:21.585918 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:03:21.585918 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:03:21.585918 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:03:21.585918 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:03:21.585918 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:03:21.585918 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:03:21.585918 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:03:21.585918 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:03:21.585918 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:03:21.585918 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:03:21.585918 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:03:21.585918 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:03:21.586725 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:03:21.586725 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:03:21.586725 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:03:21.586725 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:03:21.586725 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:03:21.586725 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:03:21.586725 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:03:21.586725 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:03:21.586725 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:03:21.586725 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:03:21.586725 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 05 12:03:21.586725 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:03:21.586725 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 166/339] 10.222.0.50 () {56 vars in 1114 bytes} [Mon Sep 5 12:03:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:03:21.592863 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec2346c-4e36-457b-9def-d0675acde5aa None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:21.614136 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9900efcd-a2d1-49ec-a758-b6dd559544c1 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:21.628884 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:21.760853 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9900efcd-a2d1-49ec-a758-b6dd559544c1 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:21.794375 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec2346c-4e36-457b-9def-d0675acde5aa None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:21.803880 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fcad57-cc5a-420a-bb75-ad00518dbaa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:21.804762 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fcad57-cc5a-420a-bb75-ad00518dbaa5 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:21.805221 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fcad57-cc5a-420a-bb75-ad00518dbaa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:21.805630 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fcad57-cc5a-420a-bb75-ad00518dbaa5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:21.816697 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fcad57-cc5a-420a-bb75-ad00518dbaa5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:03:21.821862 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-94fcad57-cc5a-420a-bb75-ad00518dbaa5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 05 12:03:21.821862 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:03:21.821862 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:03:21.821862 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:03:21.821862 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:03:21.821862 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:03:21.821862 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:03:21.821862 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:03:21.821862 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:03:21.821862 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:03:21.821862 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:03:21.821862 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:03:21.821862 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:03:21.821862 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:03:21.821862 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:03:21.821862 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:03:21.822762 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:03:21.822762 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:03:21.822762 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:03:21.822762 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:03:21.822762 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:03:21.822762 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:03:21.822762 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:03:21.822762 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:03:21.822762 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:03:21.822762 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:03:21.822762 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:03:21.822762 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:03:21.822762 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:03:21.822762 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:03:21.822762 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:03:21.822762 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:03:21.823550 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:03:21.823550 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:03:21.823550 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:03:21.823550 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:03:21.823550 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:03:21.823550 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:03:21.823550 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:03:21.823550 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:03:21.823550 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:03:21.823550 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:03:21.823550 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 05 12:03:21.823550 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:03:21.826785 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 167/340] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Sep 5 12:03:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 12:03:21.834182 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fcad57-cc5a-420a-bb75-ad00518dbaa5 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:21.875051 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1f588c-b23f-4811-83e2-df6088648537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:21.875685 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1f588c-b23f-4811-83e2-df6088648537 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:21.876022 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1f588c-b23f-4811-83e2-df6088648537 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:21.876556 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1f588c-b23f-4811-83e2-df6088648537 None admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:21.877054 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1f588c-b23f-4811-83e2-df6088648537 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:03:21.877360 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1f588c-b23f-4811-83e2-df6088648537 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:21.878756 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1f588c-b23f-4811-83e2-df6088648537 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:21.896979 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 174/341] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Sep 5 12:03:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:21.923224 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1f588c-b23f-4811-83e2-df6088648537 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:21.947724 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:22.031639 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fcad57-cc5a-420a-bb75-ad00518dbaa5 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:22.079926 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:22.119692 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa69e62-9631-49c1-82a3-8c7700a29279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:22.120316 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa69e62-9631-49c1-82a3-8c7700a29279 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:22.120594 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa69e62-9631-49c1-82a3-8c7700a29279 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:22.121435 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa69e62-9631-49c1-82a3-8c7700a29279 None admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:22.122123 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa69e62-9631-49c1-82a3-8c7700a29279 None admin] RBAC: Adding query filter params (name=member) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:03:22.122427 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa69e62-9631-49c1-82a3-8c7700a29279 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:22.123860 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa69e62-9631-49c1-82a3-8c7700a29279 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:22.137755 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 168/342] 10.222.0.50 () {56 vars in 1101 bytes} [Mon Sep 5 12:03:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:03:22.153033 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa69e62-9631-49c1-82a3-8c7700a29279 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:22.236813 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1f588c-b23f-4811-83e2-df6088648537 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:22.290079 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa69e62-9631-49c1-82a3-8c7700a29279 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:22.323641 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:22.335699 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296f60e6-cbb6-400e-b183-4a3a1d806278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:22.336331 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296f60e6-cbb6-400e-b183-4a3a1d806278 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:22.336612 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296f60e6-cbb6-400e-b183-4a3a1d806278 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:22.336888 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296f60e6-cbb6-400e-b183-4a3a1d806278 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:22.351341 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a26c2a-549f-4b76-b565-a8adae2c448d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:22.351968 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a26c2a-549f-4b76-b565-a8adae2c448d None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:22.352245 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a26c2a-549f-4b76-b565-a8adae2c448d None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:22.352519 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a26c2a-549f-4b76-b565-a8adae2c448d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:22.453608 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296f60e6-cbb6-400e-b183-4a3a1d806278 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:22.455142 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296f60e6-cbb6-400e-b183-4a3a1d806278 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:22.534104 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a26c2a-549f-4b76-b565-a8adae2c448d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:22.535608 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a26c2a-549f-4b76-b565-a8adae2c448d None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:22.572724 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 169/343] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Sep 5 12:03:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 05 12:03:22.574779 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b146a0a3-c307-44c7-add0-41b77d76748e None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:22.575103 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b146a0a3-c307-44c7-add0-41b77d76748e None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:22.575379 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b146a0a3-c307-44c7-add0-41b77d76748e None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:22.576925 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 170/344] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:03:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:03:22.581974 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b146a0a3-c307-44c7-add0-41b77d76748e None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:22.617495 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:22.661250 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:22.698986 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b146a0a3-c307-44c7-add0-41b77d76748e None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:22.721059 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 175/345] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Sep 5 12:03:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 798 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 12:03:22.722428 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b942bb9e-6a24-468f-8e7e-7bf19efb8e6d None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:22.722778 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b942bb9e-6a24-468f-8e7e-7bf19efb8e6d None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:22.723165 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b942bb9e-6a24-468f-8e7e-7bf19efb8e6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:22.741373 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70abbe0b-b99f-4abb-99a8-d51e364424eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:22.742039 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70abbe0b-b99f-4abb-99a8-d51e364424eb None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:22.742319 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70abbe0b-b99f-4abb-99a8-d51e364424eb None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:22.742591 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70abbe0b-b99f-4abb-99a8-d51e364424eb None admin] PATH_INFO: `/v3/projects/2370f3588c6e4c5798f29493d9842333` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:22.744837 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70abbe0b-b99f-4abb-99a8-d51e364424eb None admin] RBAC: Authorizing `identity:get_project(project_id=2370f3588c6e4c5798f29493d9842333)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:22.746852 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-b942bb9e-6a24-468f-8e7e-7bf19efb8e6d None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:03:22.747036 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70abbe0b-b99f-4abb-99a8-d51e364424eb None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:22.748352 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-b942bb9e-6a24-468f-8e7e-7bf19efb8e6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:03:22.749019 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 171/346] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Sep 5 12:03:22 2022] GET /identity/v3/projects/2370f3588c6e4c5798f29493d9842333 => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:22.750327 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511471b4-f541-4467-8492-6476421dbcad None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:22.750624 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511471b4-f541-4467-8492-6476421dbcad None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:22.750898 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511471b4-f541-4467-8492-6476421dbcad None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:22.752319 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 172/347] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:03:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:03:22.753943 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511471b4-f541-4467-8492-6476421dbcad None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:22.859651 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 176/348] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:03:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:03:22.859651 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b942bb9e-6a24-468f-8e7e-7bf19efb8e6d None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:22.971969 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:22.985374 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511471b4-f541-4467-8492-6476421dbcad None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:23.065529 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:23.074427 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa593f16-3543-4631-8a94-bd8615c48247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:23.075510 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa593f16-3543-4631-8a94-bd8615c48247 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:23.075973 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa593f16-3543-4631-8a94-bd8615c48247 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:23.076460 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa593f16-3543-4631-8a94-bd8615c48247 None admin] PATH_INFO: `/v3/projects/2370f3588c6e4c5798f29493d9842333` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:23.080929 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa593f16-3543-4631-8a94-bd8615c48247 None admin] RBAC: Authorizing `identity:get_project(project_id=2370f3588c6e4c5798f29493d9842333)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:23.083748 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa593f16-3543-4631-8a94-bd8615c48247 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:23.086972 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 173/349] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Sep 5 12:03:22 2022] GET /identity/v3/projects/2370f3588c6e4c5798f29493d9842333 => generated 298 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:23.089210 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466d23e4-195a-45f2-bf96-00053ba62d05 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:23.089738 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466d23e4-195a-45f2-bf96-00053ba62d05 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:23.090210 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466d23e4-195a-45f2-bf96-00053ba62d05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:23.127141 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b942bb9e-6a24-468f-8e7e-7bf19efb8e6d None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:23.128733 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-466d23e4-195a-45f2-bf96-00053ba62d05 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:03:23.130959 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-466d23e4-195a-45f2-bf96-00053ba62d05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:03:23.231917 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eb7165-3298-4179-9a03-402064d877dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:23.232989 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eb7165-3298-4179-9a03-402064d877dc None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:23.233892 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eb7165-3298-4179-9a03-402064d877dc None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:23.234357 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eb7165-3298-4179-9a03-402064d877dc None admin] PATH_INFO: `/v3/groups/50bd65b79c2d438d8b531639b276c16a` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:23.245695 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45eb7165-3298-4179-9a03-402064d877dc None admin] RBAC: Authorizing `identity:get_group(group_id=50bd65b79c2d438d8b531639b276c16a)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:23.250557 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45eb7165-3298-4179-9a03-402064d877dc None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:23.252709 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 177/350] 10.222.0.50 () {56 vars in 1180 bytes} [Mon Sep 5 12:03:22 2022] GET /identity/v3/groups/50bd65b79c2d438d8b531639b276c16a => generated 226 bytes in 395 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:23.254150 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eb7165-3298-4179-9a03-402064d877dc None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:23.278488 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 174/351] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:03:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:03:23.279832 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466d23e4-195a-45f2-bf96-00053ba62d05 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:23.449468 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:23.456055 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466d23e4-195a-45f2-bf96-00053ba62d05 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:23.475254 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eb7165-3298-4179-9a03-402064d877dc None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:23.516518 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f7f734-b515-43e5-8065-8677902f6eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:23.517726 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f7f734-b515-43e5-8065-8677902f6eae None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:23.518066 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f7f734-b515-43e5-8065-8677902f6eae None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:23.518342 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f7f734-b515-43e5-8065-8677902f6eae None admin] PATH_INFO: `/v3/roles/member` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:23.535700 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f7f734-b515-43e5-8065-8677902f6eae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:03:23.544476 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-02f7f734-b515-43e5-8065-8677902f6eae None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 05 12:03:23.544476 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:03:23.544476 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:03:23.544476 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:03:23.544476 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:03:23.544476 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:03:23.544476 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:03:23.544476 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:03:23.544476 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:03:23.544476 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:03:23.544476 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:03:23.544476 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:03:23.544476 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:03:23.544476 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:03:23.544476 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:03:23.544476 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:03:23.545571 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:03:23.545571 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:03:23.545571 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:03:23.545571 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:03:23.545571 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:03:23.545571 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:03:23.545571 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:03:23.545571 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:03:23.545571 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:03:23.545571 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:03:23.545571 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:03:23.545571 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:03:23.545571 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:03:23.545571 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:03:23.545571 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:03:23.545571 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:03:23.546416 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:03:23.546416 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:03:23.546416 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:03:23.546416 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:03:23.546416 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:03:23.546416 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:03:23.546416 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:03:23.546416 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:03:23.546416 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:03:23.546416 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:03:23.546416 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 05 12:03:23.546416 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:03:23.546416 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 175/352] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Sep 5 12:03:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:03:23.551107 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959f3586-0097-46fa-bad8-bfad67c1b0c0 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:23.551656 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959f3586-0097-46fa-bad8-bfad67c1b0c0 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:23.552141 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959f3586-0097-46fa-bad8-bfad67c1b0c0 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:23.555690 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 176/353] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:03:23 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:03:23.557583 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959f3586-0097-46fa-bad8-bfad67c1b0c0 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:23.558854 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77c7641-9117-48e9-9cf9-fc863aeaed36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:23.560116 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77c7641-9117-48e9-9cf9-fc863aeaed36 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:23.560646 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77c7641-9117-48e9-9cf9-fc863aeaed36 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:23.561216 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77c7641-9117-48e9-9cf9-fc863aeaed36 None admin] PATH_INFO: `/v3/groups/50bd65b79c2d438d8b531639b276c16a` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:23.562913 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77c7641-9117-48e9-9cf9-fc863aeaed36 None admin] RBAC: Authorizing `identity:get_group(group_id=50bd65b79c2d438d8b531639b276c16a)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:23.565930 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77c7641-9117-48e9-9cf9-fc863aeaed36 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:23.569102 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 178/354] 10.222.0.50 () {56 vars in 1180 bytes} [Mon Sep 5 12:03:23 2022] GET /identity/v3/groups/50bd65b79c2d438d8b531639b276c16a => generated 226 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:23.570353 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77c7641-9117-48e9-9cf9-fc863aeaed36 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:23.601064 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:23.727300 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959f3586-0097-46fa-bad8-bfad67c1b0c0 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:23.751144 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77c7641-9117-48e9-9cf9-fc863aeaed36 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:23.794635 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11786d59-a667-4b21-bafb-f74379f495d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:23.796246 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11786d59-a667-4b21-bafb-f74379f495d5 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:23.796246 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11786d59-a667-4b21-bafb-f74379f495d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:23.796246 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11786d59-a667-4b21-bafb-f74379f495d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:23.796769 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11786d59-a667-4b21-bafb-f74379f495d5 None admin] RBAC: Adding query filter params (group.id=50bd65b79c2d438d8b531639b276c16a, role.id=ed72181e1403401facb77dcf33644757, scope.project.id=2370f3588c6e4c5798f29493d9842333) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:03:23.797146 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11786d59-a667-4b21-bafb-f74379f495d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:23.799536 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11786d59-a667-4b21-bafb-f74379f495d5 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:23.810483 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 177/355] 10.222.0.50 () {56 vars in 1376 bytes} [Mon Sep 5 12:03:23 2022] GET /identity/v3/role_assignments?group.id=50bd65b79c2d438d8b531639b276c16a&scope.project.id=2370f3588c6e4c5798f29493d9842333&role.id=ed72181e1403401facb77dcf33644757 => generated 260 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:23.811761 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f2f123-4dfa-49bc-90f8-43c93c2adf7d None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:23.812050 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f2f123-4dfa-49bc-90f8-43c93c2adf7d None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:23.812328 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f2f123-4dfa-49bc-90f8-43c93c2adf7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:23.814823 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba6b213-e3b1-4917-941f-97dee1508fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:23.815865 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba6b213-e3b1-4917-941f-97dee1508fb7 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:23.816330 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba6b213-e3b1-4917-941f-97dee1508fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:23.816793 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba6b213-e3b1-4917-941f-97dee1508fb7 None admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:23.817811 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba6b213-e3b1-4917-941f-97dee1508fb7 None admin] RBAC: Adding query filter params (name=member) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:03:23.818332 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba6b213-e3b1-4917-941f-97dee1508fb7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:23.820319 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba6b213-e3b1-4917-941f-97dee1508fb7 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:23.835344 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 179/356] 10.222.0.50 () {56 vars in 1101 bytes} [Mon Sep 5 12:03:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:23.836082 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba6b213-e3b1-4917-941f-97dee1508fb7 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:23.841391 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-25f2f123-4dfa-49bc-90f8-43c93c2adf7d None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:03:23.842720 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-25f2f123-4dfa-49bc-90f8-43c93c2adf7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:03:23.868514 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:23.964346 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 178/357] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:03:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:03:23.965511 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f2f123-4dfa-49bc-90f8-43c93c2adf7d None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:23.971792 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:24.013577 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba6b213-e3b1-4917-941f-97dee1508fb7 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:24.065061 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c24bbc-f47c-484e-9587-5e7485c74770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:24.065773 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c24bbc-f47c-484e-9587-5e7485c74770 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:24.066589 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c24bbc-f47c-484e-9587-5e7485c74770 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:24.066589 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c24bbc-f47c-484e-9587-5e7485c74770 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:24.067056 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c24bbc-f47c-484e-9587-5e7485c74770 None admin] RBAC: Adding query filter params (group.id=50bd65b79c2d438d8b531639b276c16a, role.id=bf853a508574493f9bc7d85f3c3b36fd, scope.project.id=2370f3588c6e4c5798f29493d9842333) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:03:24.067369 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c24bbc-f47c-484e-9587-5e7485c74770 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:24.068854 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c24bbc-f47c-484e-9587-5e7485c74770 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:24.078097 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 180/358] 10.222.0.50 () {56 vars in 1376 bytes} [Mon Sep 5 12:03:23 2022] GET /identity/v3/role_assignments?group.id=50bd65b79c2d438d8b531639b276c16a&scope.project.id=2370f3588c6e4c5798f29493d9842333&role.id=bf853a508574493f9bc7d85f3c3b36fd => generated 260 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:24.079692 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a84330-884d-4c65-8cbf-dc00e179aa17 None None] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:24.080185 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a84330-884d-4c65-8cbf-dc00e179aa17 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:24.080661 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a84330-884d-4c65-8cbf-dc00e179aa17 None None] PATH_INFO: `/` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:24.087586 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 181/359] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:03:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:03:24.087586 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a84330-884d-4c65-8cbf-dc00e179aa17 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:24.225486 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f2f123-4dfa-49bc-90f8-43c93c2adf7d None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:24.308570 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c12c543-4999-4930-aea2-063daabf4985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:24.310471 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c12c543-4999-4930-aea2-063daabf4985 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:24.311218 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c12c543-4999-4930-aea2-063daabf4985 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:24.311952 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c12c543-4999-4930-aea2-063daabf4985 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:24.322761 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a84330-884d-4c65-8cbf-dc00e179aa17 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:24.337689 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c12c543-4999-4930-aea2-063daabf4985 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:03:24.343579 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-3c12c543-4999-4930-aea2-063daabf4985 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 05 12:03:24.343579 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:03:24.343579 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:03:24.343579 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:03:24.343579 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:03:24.343579 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:03:24.343579 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:03:24.343579 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:03:24.343579 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:03:24.343579 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:03:24.343579 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:03:24.343579 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:03:24.343579 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:03:24.343579 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:03:24.343579 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:03:24.343579 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:03:24.345371 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:03:24.345371 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:03:24.345371 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:03:24.345371 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:03:24.345371 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:03:24.345371 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:03:24.345371 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:03:24.345371 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:03:24.345371 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:03:24.345371 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:03:24.345371 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:03:24.345371 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:03:24.345371 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:03:24.345371 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:03:24.345371 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:03:24.345371 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:03:24.346921 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:03:24.346921 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:03:24.346921 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:03:24.346921 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:03:24.346921 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:03:24.346921 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:03:24.346921 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:03:24.346921 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:03:24.346921 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:03:24.346921 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:03:24.346921 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 05 12:03:24.346921 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:03:24.346921 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 179/360] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Sep 5 12:03:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 380 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:03:24.346921 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31fce7d-a70b-439b-8619-6e10467a76b2 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:24.348326 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31fce7d-a70b-439b-8619-6e10467a76b2 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:24.348326 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31fce7d-a70b-439b-8619-6e10467a76b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:24.368384 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-a31fce7d-a70b-439b-8619-6e10467a76b2 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:03:24.369752 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-a31fce7d-a70b-439b-8619-6e10467a76b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:03:24.376323 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:24.410631 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7856f8aa-9dcb-411c-870d-4529707c1bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:24.412160 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7856f8aa-9dcb-411c-870d-4529707c1bcd None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:24.412854 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7856f8aa-9dcb-411c-870d-4529707c1bcd None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:24.413593 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7856f8aa-9dcb-411c-870d-4529707c1bcd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:24.441638 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:24.515001 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 180/361] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:03:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:03:24.516790 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31fce7d-a70b-439b-8619-6e10467a76b2 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:24.565871 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7856f8aa-9dcb-411c-870d-4529707c1bcd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:24.568788 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7856f8aa-9dcb-411c-870d-4529707c1bcd None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:24.792690 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31fce7d-a70b-439b-8619-6e10467a76b2 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:24.862296 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30d4347-d9b9-49ff-812d-ebc8eb73bb10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:24.862606 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 182/362] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Sep 5 12:03:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 778 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 12:03:24.863273 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30d4347-d9b9-49ff-812d-ebc8eb73bb10 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:24.863556 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30d4347-d9b9-49ff-812d-ebc8eb73bb10 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:24.863827 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30d4347-d9b9-49ff-812d-ebc8eb73bb10 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:24.865993 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7856f8aa-9dcb-411c-870d-4529707c1bcd None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:24.878031 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:24.884209 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30d4347-d9b9-49ff-812d-ebc8eb73bb10 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:03:24.891249 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-c30d4347-d9b9-49ff-812d-ebc8eb73bb10 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 05 12:03:24.891249 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:03:24.891249 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:03:24.891249 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:03:24.891249 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:03:24.891249 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:03:24.891249 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:03:24.891249 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:03:24.891249 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:03:24.891249 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:03:24.891249 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:03:24.891249 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:03:24.891249 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:03:24.891249 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:03:24.891249 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:03:24.891249 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:03:24.892933 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:03:24.892933 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:03:24.892933 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:03:24.892933 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:03:24.892933 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:03:24.892933 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:03:24.892933 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:03:24.892933 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:03:24.892933 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:03:24.892933 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:03:24.892933 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:03:24.892933 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:03:24.892933 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:03:24.892933 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:03:24.892933 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:03:24.892933 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:03:24.894538 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:03:24.894538 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:03:24.894538 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:03:24.894538 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:03:24.894538 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:03:24.894538 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:03:24.894538 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:03:24.894538 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:03:24.894538 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:03:24.894538 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:03:24.894538 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 05 12:03:24.894538 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:03:24.900927 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 181/363] 10.222.0.50 () {56 vars in 1114 bytes} [Mon Sep 5 12:03:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 377 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:03:24.900927 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30d4347-d9b9-49ff-812d-ebc8eb73bb10 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:24.924539 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:25.008593 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7856f8aa-9dcb-411c-870d-4529707c1bcd None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:25.040553 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30d4347-d9b9-49ff-812d-ebc8eb73bb10 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:25.053610 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df94c007-d5cd-47a4-924b-39b6ac8841d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:25.054242 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df94c007-d5cd-47a4-924b-39b6ac8841d1 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:25.054557 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df94c007-d5cd-47a4-924b-39b6ac8841d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:25.055287 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df94c007-d5cd-47a4-924b-39b6ac8841d1 None admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:25.056136 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df94c007-d5cd-47a4-924b-39b6ac8841d1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:03:25.056586 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df94c007-d5cd-47a4-924b-39b6ac8841d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:25.058100 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df94c007-d5cd-47a4-924b-39b6ac8841d1 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:25.071463 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 183/364] 10.222.0.50 () {56 vars in 1101 bytes} [Mon Sep 5 12:03:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:25.072272 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df94c007-d5cd-47a4-924b-39b6ac8841d1 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:25.092501 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c04cd9-ee01-4862-84a9-c087e8aba081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:25.093687 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c04cd9-ee01-4862-84a9-c087e8aba081 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:25.094157 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c04cd9-ee01-4862-84a9-c087e8aba081 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:25.094732 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c04cd9-ee01-4862-84a9-c087e8aba081 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:25.109717 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c04cd9-ee01-4862-84a9-c087e8aba081 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:03:25.117706 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-40c04cd9-ee01-4862-84a9-c087e8aba081 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 12:03:25.117706 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:03:25.117706 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:03:25.117706 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:03:25.117706 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:03:25.117706 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:03:25.117706 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:03:25.117706 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:03:25.117706 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:03:25.117706 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:03:25.117706 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:03:25.117706 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:03:25.117706 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:03:25.117706 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:03:25.117706 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:03:25.117706 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:03:25.118636 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:03:25.118636 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:03:25.118636 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:03:25.118636 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:03:25.118636 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:03:25.118636 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:03:25.118636 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:03:25.118636 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:03:25.118636 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:03:25.118636 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:03:25.118636 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:03:25.118636 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:03:25.118636 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:03:25.118636 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:03:25.118636 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:03:25.118636 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:03:25.119465 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:03:25.119465 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:03:25.119465 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:03:25.119465 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:03:25.119465 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:03:25.119465 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:03:25.119465 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:03:25.119465 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:03:25.119465 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:03:25.119465 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:03:25.119465 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 12:03:25.119465 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:03:25.122863 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 182/365] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Sep 5 12:03:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:03:25.124107 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c04cd9-ee01-4862-84a9-c087e8aba081 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:25.207326 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:25.210082 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df94c007-d5cd-47a4-924b-39b6ac8841d1 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:25.220179 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:25.258845 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf12107c-7fa8-4e3c-bec5-1e8aa349d504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:25.259501 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf12107c-7fa8-4e3c-bec5-1e8aa349d504 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:25.259781 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf12107c-7fa8-4e3c-bec5-1e8aa349d504 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:25.260059 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf12107c-7fa8-4e3c-bec5-1e8aa349d504 None admin] PATH_INFO: `/v3/projects/b6c350f1ed014cad89f2c125d5de6e1e` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:25.262158 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf12107c-7fa8-4e3c-bec5-1e8aa349d504 None admin] RBAC: Authorizing `identity:get_project(project_id=b6c350f1ed014cad89f2c125d5de6e1e)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:25.263931 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf12107c-7fa8-4e3c-bec5-1e8aa349d504 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:25.268994 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 184/366] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Sep 5 12:03:25 2022] GET /identity/v3/projects/b6c350f1ed014cad89f2c125d5de6e1e => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:25.270314 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf12107c-7fa8-4e3c-bec5-1e8aa349d504 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:25.277413 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c04cd9-ee01-4862-84a9-c087e8aba081 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:25.327913 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffc25b1-a116-4aca-94d2-42f9a0d57f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:25.328556 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffc25b1-a116-4aca-94d2-42f9a0d57f8b None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:25.328839 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffc25b1-a116-4aca-94d2-42f9a0d57f8b None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:25.329151 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffc25b1-a116-4aca-94d2-42f9a0d57f8b None admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:25.329850 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffc25b1-a116-4aca-94d2-42f9a0d57f8b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:03:25.330157 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffc25b1-a116-4aca-94d2-42f9a0d57f8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:25.332204 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffc25b1-a116-4aca-94d2-42f9a0d57f8b None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:25.349046 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 183/367] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Sep 5 12:03:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:25.350812 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffc25b1-a116-4aca-94d2-42f9a0d57f8b None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:25.399398 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf12107c-7fa8-4e3c-bec5-1e8aa349d504 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:25.437774 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9977481d-7876-48e7-9212-11b8b75e507c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:25.438424 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9977481d-7876-48e7-9212-11b8b75e507c None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:25.438703 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9977481d-7876-48e7-9212-11b8b75e507c None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:25.439074 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9977481d-7876-48e7-9212-11b8b75e507c None admin] PATH_INFO: `/v3/users/ab2585f84bb04db887b999f1ec10328d` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:25.440183 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9977481d-7876-48e7-9212-11b8b75e507c None admin] RBAC: Authorizing `identity:get_user(user_id=ab2585f84bb04db887b999f1ec10328d)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:25.441869 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9977481d-7876-48e7-9212-11b8b75e507c None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:25.443888 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 185/368] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Sep 5 12:03:25 2022] GET /identity/v3/users/ab2585f84bb04db887b999f1ec10328d => generated 293 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:25.444707 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9977481d-7876-48e7-9212-11b8b75e507c None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:25.478249 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffc25b1-a116-4aca-94d2-42f9a0d57f8b None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:25.495058 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:25.506800 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:25.521120 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303acadf-137c-4449-9777-12f2221685a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:25.522127 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303acadf-137c-4449-9777-12f2221685a2 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:25.522630 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303acadf-137c-4449-9777-12f2221685a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:25.523101 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303acadf-137c-4449-9777-12f2221685a2 None admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:25.524234 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303acadf-137c-4449-9777-12f2221685a2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:03:25.524743 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303acadf-137c-4449-9777-12f2221685a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:25.526421 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303acadf-137c-4449-9777-12f2221685a2 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:25.537971 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 184/369] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Sep 5 12:03:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:25.539231 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303acadf-137c-4449-9777-12f2221685a2 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:25.570410 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9977481d-7876-48e7-9212-11b8b75e507c None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:25.609720 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade784a6-1d63-4a2d-a13b-665e82508afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:25.610377 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade784a6-1d63-4a2d-a13b-665e82508afb None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:25.610658 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade784a6-1d63-4a2d-a13b-665e82508afb None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:25.610931 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade784a6-1d63-4a2d-a13b-665e82508afb None admin] PATH_INFO: `/v3/groups/50bd65b79c2d438d8b531639b276c16a` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:25.612111 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade784a6-1d63-4a2d-a13b-665e82508afb None admin] RBAC: Authorizing `identity:get_group(group_id=50bd65b79c2d438d8b531639b276c16a)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:25.613648 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade784a6-1d63-4a2d-a13b-665e82508afb None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:25.620164 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 186/370] 10.222.0.50 () {56 vars in 1180 bytes} [Mon Sep 5 12:03:25 2022] GET /identity/v3/groups/50bd65b79c2d438d8b531639b276c16a => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:25.620164 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade784a6-1d63-4a2d-a13b-665e82508afb None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:25.700941 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303acadf-137c-4449-9777-12f2221685a2 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:25.753283 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26f0970-3a4a-47db-a286-65e28b219a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:25.753915 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26f0970-3a4a-47db-a286-65e28b219a1b None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:25.754190 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26f0970-3a4a-47db-a286-65e28b219a1b None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:25.754457 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26f0970-3a4a-47db-a286-65e28b219a1b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:25.811464 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade784a6-1d63-4a2d-a13b-665e82508afb None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:25.841906 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:25.856926 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002b222d-d317-472e-a461-6279199df922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:25.857728 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002b222d-d317-472e-a461-6279199df922 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:25.858016 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002b222d-d317-472e-a461-6279199df922 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:25.858292 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002b222d-d317-472e-a461-6279199df922 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:25.859052 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002b222d-d317-472e-a461-6279199df922 None admin] RBAC: Adding query filter params (role.id=7759eb25e244436aa0b1be6aee7ebd1e, user.id=ab2585f84bb04db887b999f1ec10328d, scope.system=all) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:03:25.859373 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002b222d-d317-472e-a461-6279199df922 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:25.862357 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002b222d-d317-472e-a461-6279199df922 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:25.877391 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:25.879080 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 187/371] 10.222.0.50 () {56 vars in 1308 bytes} [Mon Sep 5 12:03:25 2022] GET /identity/v3/role_assignments?user.id=ab2585f84bb04db887b999f1ec10328d&scope.system=all&role.id=7759eb25e244436aa0b1be6aee7ebd1e => generated 510 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:25.879849 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002b222d-d317-472e-a461-6279199df922 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:25.924210 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26f0970-3a4a-47db-a286-65e28b219a1b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:25.926911 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26f0970-3a4a-47db-a286-65e28b219a1b None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:26.077030 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 185/372] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Sep 5 12:03:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 538 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 12:03:26.077970 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26f0970-3a4a-47db-a286-65e28b219a1b None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:26.147154 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002b222d-d317-472e-a461-6279199df922 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:26.202904 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:26.224956 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26f0970-3a4a-47db-a286-65e28b219a1b None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:26.240496 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43da4fe4-def1-425d-9836-c91e34c85ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:26.243222 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43da4fe4-def1-425d-9836-c91e34c85ddb None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:26.243505 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43da4fe4-def1-425d-9836-c91e34c85ddb None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:26.243783 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43da4fe4-def1-425d-9836-c91e34c85ddb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:26.295409 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc40edc-dada-4768-803e-8b800cf04285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:26.296518 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc40edc-dada-4768-803e-8b800cf04285 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:26.297140 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc40edc-dada-4768-803e-8b800cf04285 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:26.297604 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc40edc-dada-4768-803e-8b800cf04285 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:26.299012 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc40edc-dada-4768-803e-8b800cf04285 None admin] RBAC: Adding query filter params (group.id=50bd65b79c2d438d8b531639b276c16a, role.id=ed72181e1403401facb77dcf33644757, scope.project.id=b6c350f1ed014cad89f2c125d5de6e1e) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:03:26.299660 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc40edc-dada-4768-803e-8b800cf04285 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:26.303026 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:26.305396 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc40edc-dada-4768-803e-8b800cf04285 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:26.316506 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 186/373] 10.222.0.50 () {56 vars in 1376 bytes} [Mon Sep 5 12:03:26 2022] GET /identity/v3/role_assignments?group.id=50bd65b79c2d438d8b531639b276c16a&scope.project.id=b6c350f1ed014cad89f2c125d5de6e1e&role.id=ed72181e1403401facb77dcf33644757 => generated 260 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:26.318243 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc40edc-dada-4768-803e-8b800cf04285 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:26.358614 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43da4fe4-def1-425d-9836-c91e34c85ddb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:26.366660 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43da4fe4-def1-425d-9836-c91e34c85ddb None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:26.590925 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 188/374] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Sep 5 12:03:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 711 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 12:03:26.595247 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc40edc-dada-4768-803e-8b800cf04285 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:26.601196 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43da4fe4-def1-425d-9836-c91e34c85ddb None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:26.651821 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2efdfae-ab4b-44a6-9bbf-8b8f9598de90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:26.652739 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2efdfae-ab4b-44a6-9bbf-8b8f9598de90 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:26.653077 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2efdfae-ab4b-44a6-9bbf-8b8f9598de90 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:26.653357 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2efdfae-ab4b-44a6-9bbf-8b8f9598de90 None admin] PATH_INFO: `/v3/projects/b6c350f1ed014cad89f2c125d5de6e1e` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:26.656082 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2efdfae-ab4b-44a6-9bbf-8b8f9598de90 None admin] RBAC: Authorizing `identity:get_project(project_id=b6c350f1ed014cad89f2c125d5de6e1e)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:26.657850 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2efdfae-ab4b-44a6-9bbf-8b8f9598de90 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:26.665024 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 187/375] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Sep 5 12:03:26 2022] GET /identity/v3/projects/b6c350f1ed014cad89f2c125d5de6e1e => generated 302 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:26.667193 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2efdfae-ab4b-44a6-9bbf-8b8f9598de90 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:26.711206 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:26.762749 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:26.826200 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43da4fe4-def1-425d-9836-c91e34c85ddb None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:26.875266 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0124de6b-b2ca-4aaf-bfa1-dd0a5b752b13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:26.875928 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0124de6b-b2ca-4aaf-bfa1-dd0a5b752b13 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:26.876207 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0124de6b-b2ca-4aaf-bfa1-dd0a5b752b13 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:26.876482 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0124de6b-b2ca-4aaf-bfa1-dd0a5b752b13 None admin] PATH_INFO: `/v3/projects/f7dbd9a59249418592cb2f883c3937fa` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:26.877818 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0124de6b-b2ca-4aaf-bfa1-dd0a5b752b13 None admin] RBAC: Authorizing `identity:get_project(project_id=f7dbd9a59249418592cb2f883c3937fa)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:26.879321 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0124de6b-b2ca-4aaf-bfa1-dd0a5b752b13 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:26.881508 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 189/376] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Sep 5 12:03:26 2022] GET /identity/v3/projects/f7dbd9a59249418592cb2f883c3937fa => generated 344 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:26.887329 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0124de6b-b2ca-4aaf-bfa1-dd0a5b752b13 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:26.913109 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2efdfae-ab4b-44a6-9bbf-8b8f9598de90 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:26.986540 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf6c2d1-3737-4f7e-ae38-9fe43e780586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:26.987574 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf6c2d1-3737-4f7e-ae38-9fe43e780586 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:26.988048 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf6c2d1-3737-4f7e-ae38-9fe43e780586 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:26.988525 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf6c2d1-3737-4f7e-ae38-9fe43e780586 None admin] PATH_INFO: `/v3/groups/50bd65b79c2d438d8b531639b276c16a` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:26.991967 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf6c2d1-3737-4f7e-ae38-9fe43e780586 None admin] RBAC: Authorizing `identity:get_group(group_id=50bd65b79c2d438d8b531639b276c16a)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:26.994756 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf6c2d1-3737-4f7e-ae38-9fe43e780586 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:26.998737 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 188/377] 10.222.0.50 () {56 vars in 1180 bytes} [Mon Sep 5 12:03:26 2022] GET /identity/v3/groups/50bd65b79c2d438d8b531639b276c16a => generated 226 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:27.004615 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf6c2d1-3737-4f7e-ae38-9fe43e780586 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:27.023447 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0124de6b-b2ca-4aaf-bfa1-dd0a5b752b13 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:27.076149 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b56ece2-a815-42fc-8723-b1881ab96cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:27.076888 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b56ece2-a815-42fc-8723-b1881ab96cdd None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:27.077203 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b56ece2-a815-42fc-8723-b1881ab96cdd None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:27.077472 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b56ece2-a815-42fc-8723-b1881ab96cdd None admin] PATH_INFO: `/v3/groups/29b45639c59a420ea67e9165b0430bac` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:27.079848 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:27.087571 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b56ece2-a815-42fc-8723-b1881ab96cdd None admin] RBAC: Authorizing `identity:get_group(group_id=29b45639c59a420ea67e9165b0430bac)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:27.087571 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b56ece2-a815-42fc-8723-b1881ab96cdd None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:27.087571 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 190/378] 10.222.0.50 () {56 vars in 1180 bytes} [Mon Sep 5 12:03:26 2022] GET /identity/v3/groups/29b45639c59a420ea67e9165b0430bac => generated 229 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:03:27.094073 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b56ece2-a815-42fc-8723-b1881ab96cdd None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:27.219066 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:27.243322 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b56ece2-a815-42fc-8723-b1881ab96cdd None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:27.275460 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf6c2d1-3737-4f7e-ae38-9fe43e780586 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:27.291082 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e19ea52-99ec-4346-8f46-c863cb908e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:27.291856 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e19ea52-99ec-4346-8f46-c863cb908e66 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:27.292256 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e19ea52-99ec-4346-8f46-c863cb908e66 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:27.292693 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e19ea52-99ec-4346-8f46-c863cb908e66 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:27.293695 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e19ea52-99ec-4346-8f46-c863cb908e66 None admin] RBAC: Adding query filter params (group.id=29b45639c59a420ea67e9165b0430bac, role.id=16e2ccc8bd1b497d8cee780c1c7df0d2, scope.project.id=f7dbd9a59249418592cb2f883c3937fa) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:03:27.294787 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e19ea52-99ec-4346-8f46-c863cb908e66 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:27.296986 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e19ea52-99ec-4346-8f46-c863cb908e66 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:27.307471 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 191/379] 10.222.0.50 () {56 vars in 1376 bytes} [Mon Sep 5 12:03:27 2022] GET /identity/v3/role_assignments?group.id=29b45639c59a420ea67e9165b0430bac&scope.project.id=f7dbd9a59249418592cb2f883c3937fa&role.id=16e2ccc8bd1b497d8cee780c1c7df0d2 => generated 260 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:03:27.311737 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722ff89c-c4b0-498e-b104-8204b5f116a0 None None] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:27.312330 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722ff89c-c4b0-498e-b104-8204b5f116a0 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:27.312869 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722ff89c-c4b0-498e-b104-8204b5f116a0 None None] PATH_INFO: `/` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:27.317050 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 192/380] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:03:27 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 12:03:27.324877 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3324c54d-5f12-4e0f-a1d9-821e9c58914c None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:27.325338 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3324c54d-5f12-4e0f-a1d9-821e9c58914c None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:27.325763 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3324c54d-5f12-4e0f-a1d9-821e9c58914c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:27.345656 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e673f3be-f2e9-4b19-9275-32a71abb79ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:27.347096 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e673f3be-f2e9-4b19-9275-32a71abb79ee None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:27.347653 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e673f3be-f2e9-4b19-9275-32a71abb79ee None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:27.348130 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e673f3be-f2e9-4b19-9275-32a71abb79ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:27.349148 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e673f3be-f2e9-4b19-9275-32a71abb79ee None admin] RBAC: Adding query filter params (group.id=50bd65b79c2d438d8b531639b276c16a, role.id=bf853a508574493f9bc7d85f3c3b36fd, scope.project.id=b6c350f1ed014cad89f2c125d5de6e1e) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:03:27.349735 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e673f3be-f2e9-4b19-9275-32a71abb79ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:27.351626 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e673f3be-f2e9-4b19-9275-32a71abb79ee None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:27.356293 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-3324c54d-5f12-4e0f-a1d9-821e9c58914c None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:03:27.358033 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-3324c54d-5f12-4e0f-a1d9-821e9c58914c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:03:27.365089 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 189/381] 10.222.0.50 () {56 vars in 1376 bytes} [Mon Sep 5 12:03:27 2022] GET /identity/v3/role_assignments?group.id=50bd65b79c2d438d8b531639b276c16a&scope.project.id=b6c350f1ed014cad89f2c125d5de6e1e&role.id=bf853a508574493f9bc7d85f3c3b36fd => generated 260 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:03:27.432744 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:27.446087 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 193/382] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:03:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 05 12:03:27.780109 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b885509d-157f-4c86-a45d-439cf3eeed53 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:27.781689 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b885509d-157f-4c86-a45d-439cf3eeed53 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:27.781992 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b885509d-157f-4c86-a45d-439cf3eeed53 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:27.783561 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 190/383] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:03:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:03:27.790740 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5d0d3b-5690-49fa-8592-430d21f6639a None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:27.791238 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5d0d3b-5690-49fa-8592-430d21f6639a None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:27.791720 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5d0d3b-5690-49fa-8592-430d21f6639a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:27.834015 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-9a5d0d3b-5690-49fa-8592-430d21f6639a None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:03:27.836169 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-9a5d0d3b-5690-49fa-8592-430d21f6639a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:03:27.963716 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 194/384] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:03:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:03:28.066126 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b885509d-157f-4c86-a45d-439cf3eeed53 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:28.201930 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b885509d-157f-4c86-a45d-439cf3eeed53 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:28.244864 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d75d88-7a68-4919-9bb8-46acba0147fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:28.245904 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d75d88-7a68-4919-9bb8-46acba0147fa None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:28.246323 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d75d88-7a68-4919-9bb8-46acba0147fa None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:28.246733 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d75d88-7a68-4919-9bb8-46acba0147fa None admin] PATH_INFO: `/v3/roles/member` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:28.263318 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d75d88-7a68-4919-9bb8-46acba0147fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:03:28.268953 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-f4d75d88-7a68-4919-9bb8-46acba0147fa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 05 12:03:28.268953 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:03:28.268953 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:03:28.268953 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:03:28.268953 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:03:28.268953 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:03:28.268953 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:03:28.268953 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:03:28.268953 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:03:28.268953 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:03:28.268953 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:03:28.268953 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:03:28.268953 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:03:28.268953 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:03:28.268953 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:03:28.268953 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:03:28.270050 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:03:28.270050 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:03:28.270050 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:03:28.270050 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:03:28.270050 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:03:28.270050 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:03:28.270050 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:03:28.270050 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:03:28.270050 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:03:28.270050 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:03:28.270050 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:03:28.270050 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:03:28.270050 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:03:28.270050 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:03:28.270050 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:03:28.270050 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:03:28.271084 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:03:28.271084 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:03:28.271084 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:03:28.271084 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:03:28.271084 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:03:28.271084 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:03:28.271084 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:03:28.271084 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:03:28.271084 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:03:28.271084 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:03:28.271084 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 05 12:03:28.271084 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:03:28.273762 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 191/385] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Sep 5 12:03:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:03:28.279860 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5d0d3b-5690-49fa-8592-430d21f6639a None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:28.431478 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d75d88-7a68-4919-9bb8-46acba0147fa None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:28.438678 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5d0d3b-5690-49fa-8592-430d21f6639a None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:28.456691 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:28.469271 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:28.500726 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5c7687-f369-45a5-bf34-8d0d9157598e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:28.501375 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5c7687-f369-45a5-bf34-8d0d9157598e None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:28.501652 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5c7687-f369-45a5-bf34-8d0d9157598e None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:28.501920 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5c7687-f369-45a5-bf34-8d0d9157598e None admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:28.502605 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5c7687-f369-45a5-bf34-8d0d9157598e None admin] RBAC: Adding query filter params (name=member) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:03:28.502906 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5c7687-f369-45a5-bf34-8d0d9157598e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:28.504310 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5c7687-f369-45a5-bf34-8d0d9157598e None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:28.533090 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 195/386] 10.222.0.50 () {56 vars in 1101 bytes} [Mon Sep 5 12:03:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:28.540166 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5c7687-f369-45a5-bf34-8d0d9157598e None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:28.658961 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d75d88-7a68-4919-9bb8-46acba0147fa None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:28.714626 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5c7687-f369-45a5-bf34-8d0d9157598e None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:28.739068 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8198f858-a5a5-425d-916c-ed853a9a8e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:28.740064 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8198f858-a5a5-425d-916c-ed853a9a8e76 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:28.740536 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8198f858-a5a5-425d-916c-ed853a9a8e76 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:28.741078 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8198f858-a5a5-425d-916c-ed853a9a8e76 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:28.766358 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8198f858-a5a5-425d-916c-ed853a9a8e76 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:03:28.772006 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-8198f858-a5a5-425d-916c-ed853a9a8e76 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 05 12:03:28.772006 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:03:28.772006 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:03:28.772006 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:03:28.772006 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:03:28.772006 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:03:28.772006 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:03:28.772006 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:03:28.772006 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:03:28.772006 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:03:28.772006 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:03:28.772006 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:03:28.772006 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:03:28.772006 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:03:28.772006 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:03:28.772006 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:03:28.772959 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:03:28.772959 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:03:28.772959 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:03:28.772959 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:03:28.772959 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:03:28.772959 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:03:28.772959 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:03:28.772959 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:03:28.772959 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:03:28.772959 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:03:28.772959 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:03:28.772959 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:03:28.772959 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:03:28.772959 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:03:28.772959 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:03:28.772959 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:03:28.774034 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:03:28.774034 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:03:28.774034 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:03:28.774034 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:03:28.774034 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:03:28.774034 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:03:28.774034 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:03:28.774034 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:03:28.774034 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:03:28.774034 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:03:28.774034 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 05 12:03:28.774034 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:03:28.784932 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 192/387] 10.222.0.50 () {56 vars in 1114 bytes} [Mon Sep 5 12:03:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:03:28.789839 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8198f858-a5a5-425d-916c-ed853a9a8e76 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:28.807194 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb2651d-5b9d-4e64-8453-9931487291e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:28.809189 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb2651d-5b9d-4e64-8453-9931487291e7 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:28.809880 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb2651d-5b9d-4e64-8453-9931487291e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:28.810563 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb2651d-5b9d-4e64-8453-9931487291e7 None admin] PATH_INFO: `/v3/groups/50bd65b79c2d438d8b531639b276c16a` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:28.812882 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb2651d-5b9d-4e64-8453-9931487291e7 None admin] RBAC: Authorizing `identity:get_group(group_id=50bd65b79c2d438d8b531639b276c16a)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:28.815839 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb2651d-5b9d-4e64-8453-9931487291e7 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:28.823551 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 196/388] 10.222.0.50 () {56 vars in 1180 bytes} [Mon Sep 5 12:03:28 2022] GET /identity/v3/groups/50bd65b79c2d438d8b531639b276c16a => generated 226 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:03:28.828998 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb2651d-5b9d-4e64-8453-9931487291e7 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:28.933921 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:28.981505 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:29.000123 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb2651d-5b9d-4e64-8453-9931487291e7 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:29.040240 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76915a9-b01c-4212-a817-458db3203d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:29.040506 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8198f858-a5a5-425d-916c-ed853a9a8e76 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:29.040926 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76915a9-b01c-4212-a817-458db3203d23 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:29.041209 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76915a9-b01c-4212-a817-458db3203d23 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:29.041485 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76915a9-b01c-4212-a817-458db3203d23 None admin] PATH_INFO: `/v3/projects/2370f3588c6e4c5798f29493d9842333` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:29.043559 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76915a9-b01c-4212-a817-458db3203d23 None admin] RBAC: Authorizing `identity:get_project(project_id=2370f3588c6e4c5798f29493d9842333)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:29.045127 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76915a9-b01c-4212-a817-458db3203d23 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:29.047125 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 197/389] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Sep 5 12:03:28 2022] GET /identity/v3/projects/2370f3588c6e4c5798f29493d9842333 => generated 298 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:29.053210 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76915a9-b01c-4212-a817-458db3203d23 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:29.123134 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5c610e-e557-432d-872f-a2496c00cfbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:29.123749 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5c610e-e557-432d-872f-a2496c00cfbb None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:29.124025 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5c610e-e557-432d-872f-a2496c00cfbb None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:29.124293 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5c610e-e557-432d-872f-a2496c00cfbb None admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:29.124987 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5c610e-e557-432d-872f-a2496c00cfbb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:03:29.125291 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5c610e-e557-432d-872f-a2496c00cfbb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:29.128796 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5c610e-e557-432d-872f-a2496c00cfbb None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:29.149228 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 193/390] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Sep 5 12:03:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:29.156736 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5c610e-e557-432d-872f-a2496c00cfbb None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:29.241741 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76915a9-b01c-4212-a817-458db3203d23 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:29.263889 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:29.283028 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ace1d9-9339-4502-8a99-1f51594b9745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:29.283794 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ace1d9-9339-4502-8a99-1f51594b9745 None admin] REQUEST_METHOD: `PUT` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:29.283983 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ace1d9-9339-4502-8a99-1f51594b9745 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:29.284257 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ace1d9-9339-4502-8a99-1f51594b9745 None admin] PATH_INFO: `/v3/projects/2370f3588c6e4c5798f29493d9842333/groups/50bd65b79c2d438d8b531639b276c16a/roles/ed72181e1403401facb77dcf33644757` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:29.286292 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ace1d9-9339-4502-8a99-1f51594b9745 None admin] RBAC: Authorizing `identity:create_grant(project_id=2370f3588c6e4c5798f29493d9842333, group_id=50bd65b79c2d438d8b531639b276c16a, role_id=ed72181e1403401facb77dcf33644757)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:29.287777 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ace1d9-9339-4502-8a99-1f51594b9745 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:29.304007 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 198/391] 10.222.0.50 () {58 vars in 1442 bytes} [Mon Sep 5 12:03:29 2022] PUT /identity/v3/projects/2370f3588c6e4c5798f29493d9842333/groups/50bd65b79c2d438d8b531639b276c16a/roles/ed72181e1403401facb77dcf33644757 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:03:29.305761 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cfdca2-fc84-44be-9506-831d2ae104c5 None None] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:29.306053 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cfdca2-fc84-44be-9506-831d2ae104c5 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:29.306370 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cfdca2-fc84-44be-9506-831d2ae104c5 None None] PATH_INFO: `/` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:29.308813 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 199/392] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:03:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:03:29.321200 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76360c6f-a853-49b2-8479-de5a30309ff2 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:29.321599 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76360c6f-a853-49b2-8479-de5a30309ff2 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:29.321879 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76360c6f-a853-49b2-8479-de5a30309ff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:29.358583 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-76360c6f-a853-49b2-8479-de5a30309ff2 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:03:29.359924 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-76360c6f-a853-49b2-8479-de5a30309ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:03:29.361902 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5c610e-e557-432d-872f-a2496c00cfbb None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:29.420658 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:29.434760 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06396d75-e1b9-4c43-bc62-2fe7cbf55019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:29.436450 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06396d75-e1b9-4c43-bc62-2fe7cbf55019 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:29.436984 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06396d75-e1b9-4c43-bc62-2fe7cbf55019 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:29.437468 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06396d75-e1b9-4c43-bc62-2fe7cbf55019 None admin] PATH_INFO: `/v3/groups/50bd65b79c2d438d8b531639b276c16a` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:29.439008 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06396d75-e1b9-4c43-bc62-2fe7cbf55019 None admin] RBAC: Authorizing `identity:get_group(group_id=50bd65b79c2d438d8b531639b276c16a)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:29.440806 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06396d75-e1b9-4c43-bc62-2fe7cbf55019 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:29.444940 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 194/393] 10.222.0.50 () {56 vars in 1180 bytes} [Mon Sep 5 12:03:29 2022] GET /identity/v3/groups/50bd65b79c2d438d8b531639b276c16a => generated 226 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:03:29.451399 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06396d75-e1b9-4c43-bc62-2fe7cbf55019 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:29.473737 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 200/394] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:03:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:03:29.606869 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06396d75-e1b9-4c43-bc62-2fe7cbf55019 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:29.649529 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e66dae3-2d5d-4d7c-a3ef-4ba30ee03d15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:29.650573 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e66dae3-2d5d-4d7c-a3ef-4ba30ee03d15 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:29.651049 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e66dae3-2d5d-4d7c-a3ef-4ba30ee03d15 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:29.651524 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e66dae3-2d5d-4d7c-a3ef-4ba30ee03d15 None admin] PATH_INFO: `/v3/projects/2370f3588c6e4c5798f29493d9842333` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:29.653411 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e66dae3-2d5d-4d7c-a3ef-4ba30ee03d15 None admin] RBAC: Authorizing `identity:get_project(project_id=2370f3588c6e4c5798f29493d9842333)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:29.655076 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e66dae3-2d5d-4d7c-a3ef-4ba30ee03d15 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:29.656886 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 195/395] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Sep 5 12:03:29 2022] GET /identity/v3/projects/2370f3588c6e4c5798f29493d9842333 => generated 298 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:29.665307 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76360c6f-a853-49b2-8479-de5a30309ff2 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:29.773932 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76360c6f-a853-49b2-8479-de5a30309ff2 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:29.809322 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:29.815647 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadbfbf1-e301-4a40-bab0-e5dd2ace9532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:29.816439 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadbfbf1-e301-4a40-bab0-e5dd2ace9532 None admin] REQUEST_METHOD: `PUT` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:29.816721 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadbfbf1-e301-4a40-bab0-e5dd2ace9532 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:29.817022 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadbfbf1-e301-4a40-bab0-e5dd2ace9532 None admin] PATH_INFO: `/v3/projects/2370f3588c6e4c5798f29493d9842333/groups/50bd65b79c2d438d8b531639b276c16a/roles/bf853a508574493f9bc7d85f3c3b36fd` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:29.822773 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadbfbf1-e301-4a40-bab0-e5dd2ace9532 None admin] RBAC: Authorizing `identity:create_grant(project_id=2370f3588c6e4c5798f29493d9842333, group_id=50bd65b79c2d438d8b531639b276c16a, role_id=bf853a508574493f9bc7d85f3c3b36fd)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:29.824877 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadbfbf1-e301-4a40-bab0-e5dd2ace9532 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:29.851579 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 201/396] 10.222.0.50 () {58 vars in 1442 bytes} [Mon Sep 5 12:03:29 2022] PUT /identity/v3/projects/2370f3588c6e4c5798f29493d9842333/groups/50bd65b79c2d438d8b531639b276c16a/roles/bf853a508574493f9bc7d85f3c3b36fd => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:03:29.950602 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc56c79-e7a8-4f35-8c11-ef71dfa33169 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:29.951109 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc56c79-e7a8-4f35-8c11-ef71dfa33169 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:29.951594 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc56c79-e7a8-4f35-8c11-ef71dfa33169 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:29.954228 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 196/397] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:03:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:03:29.961300 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79d7b30-6a11-4a0c-92c5-634157b6e5c8 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:29.961854 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79d7b30-6a11-4a0c-92c5-634157b6e5c8 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:29.962333 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79d7b30-6a11-4a0c-92c5-634157b6e5c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:29.997611 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-e79d7b30-6a11-4a0c-92c5-634157b6e5c8 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:03:29.999836 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-e79d7b30-6a11-4a0c-92c5-634157b6e5c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:03:30.017675 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5965bc01-b928-49a3-888d-be7b26e5276a None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:30.018295 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5965bc01-b928-49a3-888d-be7b26e5276a None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:30.018770 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5965bc01-b928-49a3-888d-be7b26e5276a None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:30.021133 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 197/398] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:03:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:03:30.027828 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84832887-7e38-426e-8d06-3aa7bb39bb0e None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:30.028459 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84832887-7e38-426e-8d06-3aa7bb39bb0e None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:30.028973 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84832887-7e38-426e-8d06-3aa7bb39bb0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:30.066672 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-84832887-7e38-426e-8d06-3aa7bb39bb0e None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:03:30.068271 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-84832887-7e38-426e-8d06-3aa7bb39bb0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:03:30.127898 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 202/399] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:03:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:03:30.142810 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79d7b30-6a11-4a0c-92c5-634157b6e5c8 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:30.167012 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:30.176732 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 198/400] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:03:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:03:30.301178 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:30.307956 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79d7b30-6a11-4a0c-92c5-634157b6e5c8 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:30.360947 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe69c69e-b31f-48ae-9c22-06f822efa3ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:30.361616 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe69c69e-b31f-48ae-9c22-06f822efa3ec None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:30.361896 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe69c69e-b31f-48ae-9c22-06f822efa3ec None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:30.362170 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe69c69e-b31f-48ae-9c22-06f822efa3ec None admin] PATH_INFO: `/v3/roles/member` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:30.375459 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe69c69e-b31f-48ae-9c22-06f822efa3ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:03:30.380722 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application [None req-fe69c69e-b31f-48ae-9c22-06f822efa3ec None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 05 12:03:30.380722 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:03:30.380722 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:03:30.380722 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:03:30.380722 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:03:30.380722 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:03:30.380722 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:03:30.380722 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:03:30.380722 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:03:30.380722 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:03:30.380722 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:03:30.380722 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:03:30.380722 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:03:30.380722 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:03:30.380722 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:03:30.380722 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:03:30.381756 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:03:30.381756 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:03:30.381756 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:03:30.381756 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:03:30.381756 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:03:30.381756 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:03:30.381756 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:03:30.381756 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:03:30.381756 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:03:30.381756 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:03:30.381756 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:03:30.381756 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application with Lock( Sep 05 12:03:30.381756 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:03:30.381756 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:03:30.381756 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:03:30.381756 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:03:30.382868 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:03:30.382868 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:03:30.382868 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:03:30.382868 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:03:30.382868 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:03:30.382868 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:03:30.382868 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:03:30.382868 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:03:30.382868 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:03:30.382868 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:03:30.382868 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 05 12:03:30.382868 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:03:30.382868 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 203/401] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Sep 5 12:03:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:03:30.391018 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84832887-7e38-426e-8d06-3aa7bb39bb0e None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:30.532846 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84832887-7e38-426e-8d06-3aa7bb39bb0e None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:30.570871 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120a60b3-b973-4fc9-b167-7ff124b40139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:30.571390 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120a60b3-b973-4fc9-b167-7ff124b40139 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:30.571677 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120a60b3-b973-4fc9-b167-7ff124b40139 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:30.571947 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120a60b3-b973-4fc9-b167-7ff124b40139 None admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:30.572628 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120a60b3-b973-4fc9-b167-7ff124b40139 None admin] RBAC: Adding query filter params (name=member) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:03:30.572955 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120a60b3-b973-4fc9-b167-7ff124b40139 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:30.574381 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120a60b3-b973-4fc9-b167-7ff124b40139 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:30.584222 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 199/402] 10.222.0.50 () {56 vars in 1101 bytes} [Mon Sep 5 12:03:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:30.584559 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe69c69e-b31f-48ae-9c22-06f822efa3ec None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:30.592425 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120a60b3-b973-4fc9-b167-7ff124b40139 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:30.727023 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:30.804552 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120a60b3-b973-4fc9-b167-7ff124b40139 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:30.805112 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe69c69e-b31f-48ae-9c22-06f822efa3ec None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:30.853341 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0378fe2f-7db3-447d-bfa6-ffa6022091c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:30.854085 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0378fe2f-7db3-447d-bfa6-ffa6022091c1 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:30.854378 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0378fe2f-7db3-447d-bfa6-ffa6022091c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:30.854646 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0378fe2f-7db3-447d-bfa6-ffa6022091c1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:30.856474 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4697e2-898a-446a-a85f-074cc4a692ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:30.857248 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4697e2-898a-446a-a85f-074cc4a692ff None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:30.857622 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4697e2-898a-446a-a85f-074cc4a692ff None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:30.857990 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4697e2-898a-446a-a85f-074cc4a692ff None admin] PATH_INFO: `/v3/groups/50bd65b79c2d438d8b531639b276c16a` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:30.859275 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4697e2-898a-446a-a85f-074cc4a692ff None admin] RBAC: Authorizing `identity:get_group(group_id=50bd65b79c2d438d8b531639b276c16a)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:30.860854 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4697e2-898a-446a-a85f-074cc4a692ff None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:30.867898 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 200/403] 10.222.0.50 () {56 vars in 1180 bytes} [Mon Sep 5 12:03:30 2022] GET /identity/v3/groups/50bd65b79c2d438d8b531639b276c16a => generated 226 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:30.868984 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4697e2-898a-446a-a85f-074cc4a692ff None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:30.869227 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0378fe2f-7db3-447d-bfa6-ffa6022091c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:03:30.875709 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application [None req-0378fe2f-7db3-447d-bfa6-ffa6022091c1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 05 12:03:30.875709 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:03:30.875709 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:03:30.875709 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:03:30.875709 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:03:30.875709 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:03:30.875709 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:03:30.875709 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:03:30.875709 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:03:30.875709 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:03:30.875709 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:03:30.875709 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:03:30.875709 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:03:30.875709 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:03:30.875709 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:03:30.875709 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:03:30.876779 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:03:30.876779 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:03:30.876779 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:03:30.876779 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:03:30.876779 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:03:30.876779 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:03:30.876779 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:03:30.876779 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:03:30.876779 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:03:30.876779 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:03:30.876779 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:03:30.876779 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application with Lock( Sep 05 12:03:30.876779 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:03:30.876779 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:03:30.876779 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:03:30.876779 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:03:30.878282 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:03:30.878282 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:03:30.878282 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:03:30.878282 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:03:30.878282 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:03:30.878282 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:03:30.878282 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:03:30.878282 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:03:30.878282 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:03:30.878282 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:03:30.878282 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 05 12:03:30.878282 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:03:30.878282 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 204/404] 10.222.0.50 () {56 vars in 1114 bytes} [Mon Sep 5 12:03:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:03:30.878282 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0378fe2f-7db3-447d-bfa6-ffa6022091c1 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:30.911576 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:30.997648 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4697e2-898a-446a-a85f-074cc4a692ff None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:31.006624 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0378fe2f-7db3-447d-bfa6-ffa6022091c1 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:31.043219 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fd93be-0a6e-4b9f-8600-c45bb7db3861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:31.044178 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:31.044794 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fd93be-0a6e-4b9f-8600-c45bb7db3861 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:31.045285 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fd93be-0a6e-4b9f-8600-c45bb7db3861 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:31.045702 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fd93be-0a6e-4b9f-8600-c45bb7db3861 None admin] PATH_INFO: `/v3/projects/b6c350f1ed014cad89f2c125d5de6e1e` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:31.047203 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fd93be-0a6e-4b9f-8600-c45bb7db3861 None admin] RBAC: Authorizing `identity:get_project(project_id=b6c350f1ed014cad89f2c125d5de6e1e)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:31.048807 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fd93be-0a6e-4b9f-8600-c45bb7db3861 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:31.050984 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 205/405] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Sep 5 12:03:30 2022] GET /identity/v3/projects/b6c350f1ed014cad89f2c125d5de6e1e => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:31.051949 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fd93be-0a6e-4b9f-8600-c45bb7db3861 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:31.071652 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cab7c9-9375-4de5-8259-d85e9319bb1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:31.072856 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cab7c9-9375-4de5-8259-d85e9319bb1a None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:31.073484 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cab7c9-9375-4de5-8259-d85e9319bb1a None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:31.074010 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cab7c9-9375-4de5-8259-d85e9319bb1a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:31.097396 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cab7c9-9375-4de5-8259-d85e9319bb1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:03:31.109046 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-46cab7c9-9375-4de5-8259-d85e9319bb1a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 12:03:31.109046 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:03:31.109046 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:03:31.109046 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:03:31.109046 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:03:31.109046 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:03:31.109046 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:03:31.109046 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:03:31.109046 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:03:31.109046 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:03:31.109046 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:03:31.109046 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:03:31.109046 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:03:31.109046 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:03:31.109046 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:03:31.109046 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:03:31.110176 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:03:31.110176 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:03:31.110176 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:03:31.110176 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:03:31.110176 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:03:31.110176 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:03:31.110176 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:03:31.110176 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:03:31.110176 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:03:31.110176 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:03:31.110176 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:03:31.110176 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:03:31.110176 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:03:31.110176 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:03:31.110176 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:03:31.110176 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:03:31.111172 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:03:31.111172 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:03:31.111172 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:03:31.111172 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:03:31.111172 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:03:31.111172 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:03:31.111172 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:03:31.111172 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:03:31.111172 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:03:31.111172 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:03:31.111172 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 12:03:31.111172 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:03:31.117233 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 201/406] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Sep 5 12:03:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:03:31.118885 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cab7c9-9375-4de5-8259-d85e9319bb1a None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:31.151681 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:31.165796 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fd93be-0a6e-4b9f-8600-c45bb7db3861 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:31.203117 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d17c7c-e1f2-47e1-a052-9ccc11eb0c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:31.204011 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d17c7c-e1f2-47e1-a052-9ccc11eb0c80 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:31.204439 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d17c7c-e1f2-47e1-a052-9ccc11eb0c80 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:31.204877 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d17c7c-e1f2-47e1-a052-9ccc11eb0c80 None admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:31.205790 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d17c7c-e1f2-47e1-a052-9ccc11eb0c80 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:03:31.206239 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d17c7c-e1f2-47e1-a052-9ccc11eb0c80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:31.207866 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d17c7c-e1f2-47e1-a052-9ccc11eb0c80 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:31.218256 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 206/407] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Sep 5 12:03:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:31.219422 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d17c7c-e1f2-47e1-a052-9ccc11eb0c80 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:31.318188 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cab7c9-9375-4de5-8259-d85e9319bb1a None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:31.326312 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d17c7c-e1f2-47e1-a052-9ccc11eb0c80 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:31.361885 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab8b489-f904-40d4-a4b0-30ae8a8b4f13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:31.362731 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab8b489-f904-40d4-a4b0-30ae8a8b4f13 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:31.363178 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab8b489-f904-40d4-a4b0-30ae8a8b4f13 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:31.363604 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab8b489-f904-40d4-a4b0-30ae8a8b4f13 None admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:31.364416 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab8b489-f904-40d4-a4b0-30ae8a8b4f13 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:03:31.364871 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab8b489-f904-40d4-a4b0-30ae8a8b4f13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:31.366416 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab8b489-f904-40d4-a4b0-30ae8a8b4f13 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:31.374818 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9b7267-9a56-409f-be4c-c43cb8eab174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:31.375919 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9b7267-9a56-409f-be4c-c43cb8eab174 None admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:31.376406 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9b7267-9a56-409f-be4c-c43cb8eab174 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:31.376886 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9b7267-9a56-409f-be4c-c43cb8eab174 None admin] PATH_INFO: `/v3/projects/b6c350f1ed014cad89f2c125d5de6e1e/groups/50bd65b79c2d438d8b531639b276c16a/roles/ed72181e1403401facb77dcf33644757` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:31.382159 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9b7267-9a56-409f-be4c-c43cb8eab174 None admin] RBAC: Authorizing `identity:create_grant(project_id=b6c350f1ed014cad89f2c125d5de6e1e, group_id=50bd65b79c2d438d8b531639b276c16a, role_id=ed72181e1403401facb77dcf33644757)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:31.383856 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9b7267-9a56-409f-be4c-c43cb8eab174 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:31.386826 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 207/408] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Sep 5 12:03:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:31.387903 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab8b489-f904-40d4-a4b0-30ae8a8b4f13 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:31.409279 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:31.411042 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 202/409] 10.222.0.50 () {58 vars in 1442 bytes} [Mon Sep 5 12:03:31 2022] PUT /identity/v3/projects/b6c350f1ed014cad89f2c125d5de6e1e/groups/50bd65b79c2d438d8b531639b276c16a/roles/ed72181e1403401facb77dcf33644757 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:03:31.412086 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9b7267-9a56-409f-be4c-c43cb8eab174 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:31.513382 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:31.610452 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab8b489-f904-40d4-a4b0-30ae8a8b4f13 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:31.632582 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9b7267-9a56-409f-be4c-c43cb8eab174 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:31.660749 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3d6e90-415f-4577-82ea-44360df3b2c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:31.660749 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3d6e90-415f-4577-82ea-44360df3b2c0 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:31.661218 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3d6e90-415f-4577-82ea-44360df3b2c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:31.661218 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3d6e90-415f-4577-82ea-44360df3b2c0 None admin] PATH_INFO: `/v3/groups/50bd65b79c2d438d8b531639b276c16a` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:31.662475 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3d6e90-415f-4577-82ea-44360df3b2c0 None admin] RBAC: Authorizing `identity:get_group(group_id=50bd65b79c2d438d8b531639b276c16a)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:31.664267 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3d6e90-415f-4577-82ea-44360df3b2c0 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:31.666447 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 208/410] 10.222.0.50 () {56 vars in 1180 bytes} [Mon Sep 5 12:03:31 2022] GET /identity/v3/groups/50bd65b79c2d438d8b531639b276c16a => generated 226 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:31.674158 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3d6e90-415f-4577-82ea-44360df3b2c0 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:31.685118 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368c1d9d-f87e-4af3-a1ad-34637c24eb26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:31.686123 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368c1d9d-f87e-4af3-a1ad-34637c24eb26 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:31.686621 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368c1d9d-f87e-4af3-a1ad-34637c24eb26 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:31.687113 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368c1d9d-f87e-4af3-a1ad-34637c24eb26 None admin] PATH_INFO: `/v3/groups/29b45639c59a420ea67e9165b0430bac` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:31.688548 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368c1d9d-f87e-4af3-a1ad-34637c24eb26 None admin] RBAC: Authorizing `identity:get_group(group_id=29b45639c59a420ea67e9165b0430bac)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:31.690302 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368c1d9d-f87e-4af3-a1ad-34637c24eb26 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:31.692137 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 203/411] 10.222.0.50 () {56 vars in 1180 bytes} [Mon Sep 5 12:03:31 2022] GET /identity/v3/groups/29b45639c59a420ea67e9165b0430bac => generated 229 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:31.703542 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368c1d9d-f87e-4af3-a1ad-34637c24eb26 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:31.791212 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:31.803805 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3d6e90-415f-4577-82ea-44360df3b2c0 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:31.871742 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aca85d0-146a-4c85-a3e7-4567011a03d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:31.872385 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aca85d0-146a-4c85-a3e7-4567011a03d3 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:31.872660 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aca85d0-146a-4c85-a3e7-4567011a03d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:31.872941 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aca85d0-146a-4c85-a3e7-4567011a03d3 None admin] PATH_INFO: `/v3/projects/b6c350f1ed014cad89f2c125d5de6e1e` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:31.874236 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aca85d0-146a-4c85-a3e7-4567011a03d3 None admin] RBAC: Authorizing `identity:get_project(project_id=b6c350f1ed014cad89f2c125d5de6e1e)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:31.879959 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aca85d0-146a-4c85-a3e7-4567011a03d3 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:31.882775 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 209/412] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Sep 5 12:03:31 2022] GET /identity/v3/projects/b6c350f1ed014cad89f2c125d5de6e1e => generated 302 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:03:31.892713 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aca85d0-146a-4c85-a3e7-4567011a03d3 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:32.012184 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368c1d9d-f87e-4af3-a1ad-34637c24eb26 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:32.061626 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aca85d0-146a-4c85-a3e7-4567011a03d3 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:32.063026 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:32.095980 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7456526f-b09b-46b1-8468-c3bc71d75e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:32.097112 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7456526f-b09b-46b1-8468-c3bc71d75e56 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:32.097604 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7456526f-b09b-46b1-8468-c3bc71d75e56 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:32.098086 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7456526f-b09b-46b1-8468-c3bc71d75e56 None admin] PATH_INFO: `/v3/projects/f7dbd9a59249418592cb2f883c3937fa` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:32.102017 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7456526f-b09b-46b1-8468-c3bc71d75e56 None admin] RBAC: Authorizing `identity:get_project(project_id=f7dbd9a59249418592cb2f883c3937fa)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:32.103523 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7456526f-b09b-46b1-8468-c3bc71d75e56 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:32.106426 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 204/413] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Sep 5 12:03:31 2022] GET /identity/v3/projects/f7dbd9a59249418592cb2f883c3937fa => generated 344 bytes in 404 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:32.112919 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7456526f-b09b-46b1-8468-c3bc71d75e56 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:32.158694 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0cd9cd-ca1e-4ddc-9350-54bc0c3c386d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:32.159571 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0cd9cd-ca1e-4ddc-9350-54bc0c3c386d None admin] REQUEST_METHOD: `PUT` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:32.159856 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0cd9cd-ca1e-4ddc-9350-54bc0c3c386d None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:32.160143 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0cd9cd-ca1e-4ddc-9350-54bc0c3c386d None admin] PATH_INFO: `/v3/projects/b6c350f1ed014cad89f2c125d5de6e1e/groups/50bd65b79c2d438d8b531639b276c16a/roles/bf853a508574493f9bc7d85f3c3b36fd` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:32.162524 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0cd9cd-ca1e-4ddc-9350-54bc0c3c386d None admin] RBAC: Authorizing `identity:create_grant(project_id=b6c350f1ed014cad89f2c125d5de6e1e, group_id=50bd65b79c2d438d8b531639b276c16a, role_id=bf853a508574493f9bc7d85f3c3b36fd)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:32.165264 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0cd9cd-ca1e-4ddc-9350-54bc0c3c386d None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:32.184715 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 210/414] 10.222.0.50 () {58 vars in 1442 bytes} [Mon Sep 5 12:03:31 2022] PUT /identity/v3/projects/b6c350f1ed014cad89f2c125d5de6e1e/groups/50bd65b79c2d438d8b531639b276c16a/roles/bf853a508574493f9bc7d85f3c3b36fd => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:03:32.186016 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bfdaa1-2857-40f6-a0af-6347431ef446 None None] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:32.186327 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bfdaa1-2857-40f6-a0af-6347431ef446 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:32.186635 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bfdaa1-2857-40f6-a0af-6347431ef446 None None] PATH_INFO: `/` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:32.187880 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 211/415] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:03:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:03:32.194641 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516acdc2-93f4-48dc-9da3-76025ad60dca None None] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:32.194641 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516acdc2-93f4-48dc-9da3-76025ad60dca None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:32.194641 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516acdc2-93f4-48dc-9da3-76025ad60dca None None] PATH_INFO: `/` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:32.194641 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 212/416] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:03:32 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:03:32.197247 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a08d3f-6080-49ff-b1b2-16818606bf72 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:32.197540 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a08d3f-6080-49ff-b1b2-16818606bf72 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:32.197821 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a08d3f-6080-49ff-b1b2-16818606bf72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:32.225675 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-a9a08d3f-6080-49ff-b1b2-16818606bf72 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:03:32.226990 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-a9a08d3f-6080-49ff-b1b2-16818606bf72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:03:32.230872 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:32.277473 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7456526f-b09b-46b1-8468-c3bc71d75e56 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:32.328754 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21268fb4-f6da-40c8-9673-37e3437b5805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:32.329618 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21268fb4-f6da-40c8-9673-37e3437b5805 None admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:32.329969 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21268fb4-f6da-40c8-9673-37e3437b5805 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:32.330319 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21268fb4-f6da-40c8-9673-37e3437b5805 None admin] PATH_INFO: `/v3/projects/f7dbd9a59249418592cb2f883c3937fa/groups/29b45639c59a420ea67e9165b0430bac/roles/16e2ccc8bd1b497d8cee780c1c7df0d2` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:32.332764 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21268fb4-f6da-40c8-9673-37e3437b5805 None admin] RBAC: Authorizing `identity:create_grant(project_id=f7dbd9a59249418592cb2f883c3937fa, group_id=29b45639c59a420ea67e9165b0430bac, role_id=16e2ccc8bd1b497d8cee780c1c7df0d2)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:32.334563 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21268fb4-f6da-40c8-9673-37e3437b5805 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:32.347527 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 213/417] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:03:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:03:32.349049 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c37fa8-65fa-4b9c-a8d3-835e02752a65 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:32.349333 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c37fa8-65fa-4b9c-a8d3-835e02752a65 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:32.350558 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c37fa8-65fa-4b9c-a8d3-835e02752a65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:32.357919 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 205/418] 10.222.0.50 () {58 vars in 1442 bytes} [Mon Sep 5 12:03:32 2022] PUT /identity/v3/projects/f7dbd9a59249418592cb2f883c3937fa/groups/29b45639c59a420ea67e9165b0430bac/roles/16e2ccc8bd1b497d8cee780c1c7df0d2 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:03:32.377464 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-f1c37fa8-65fa-4b9c-a8d3-835e02752a65 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:03:32.378888 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-f1c37fa8-65fa-4b9c-a8d3-835e02752a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:03:32.468879 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 214/419] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:03:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:03:32.664207 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21268fb4-f6da-40c8-9673-37e3437b5805 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:32.725938 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:32.831768 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c37fa8-65fa-4b9c-a8d3-835e02752a65 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:32.837544 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21268fb4-f6da-40c8-9673-37e3437b5805 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:32.913263 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec72dfb1-10bd-468d-85dc-185465ecd22d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:32.913906 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec72dfb1-10bd-468d-85dc-185465ecd22d None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:32.914183 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec72dfb1-10bd-468d-85dc-185465ecd22d None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:32.914454 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec72dfb1-10bd-468d-85dc-185465ecd22d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:32.934226 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec72dfb1-10bd-468d-85dc-185465ecd22d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:03:32.939654 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-ec72dfb1-10bd-468d-85dc-185465ecd22d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 05 12:03:32.939654 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:03:32.939654 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:03:32.939654 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:03:32.939654 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:03:32.939654 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:03:32.939654 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:03:32.939654 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:03:32.939654 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:03:32.939654 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:03:32.939654 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:03:32.939654 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:03:32.939654 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:03:32.939654 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:03:32.939654 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:03:32.939654 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:03:32.940734 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:03:32.940734 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:03:32.940734 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:03:32.940734 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:03:32.940734 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:03:32.940734 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:03:32.940734 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:03:32.940734 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:03:32.940734 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:03:32.940734 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:03:32.940734 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:03:32.940734 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:03:32.940734 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:03:32.940734 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:03:32.940734 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:03:32.940734 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:03:32.941728 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:03:32.941728 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:03:32.941728 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:03:32.941728 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:03:32.941728 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:03:32.941728 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:03:32.941728 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:03:32.941728 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:03:32.941728 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:03:32.941728 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:03:32.941728 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 05 12:03:32.941728 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:03:32.941728 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 206/420] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Sep 5 12:03:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:03:32.950188 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec72dfb1-10bd-468d-85dc-185465ecd22d None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:32.968765 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:32.997691 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c37fa8-65fa-4b9c-a8d3-835e02752a65 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:33.038566 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2957e5ff-d51b-4a25-ad31-6b606fab84fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:33.039533 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2957e5ff-d51b-4a25-ad31-6b606fab84fa None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:33.041087 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2957e5ff-d51b-4a25-ad31-6b606fab84fa None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:33.041568 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2957e5ff-d51b-4a25-ad31-6b606fab84fa None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:33.055730 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2957e5ff-d51b-4a25-ad31-6b606fab84fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:03:33.061122 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application [None req-2957e5ff-d51b-4a25-ad31-6b606fab84fa None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 05 12:03:33.061122 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:03:33.061122 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:03:33.061122 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:03:33.061122 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:03:33.061122 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:03:33.061122 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:03:33.061122 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:03:33.061122 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:03:33.061122 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:03:33.061122 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:03:33.061122 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:03:33.061122 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:03:33.061122 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:03:33.061122 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:03:33.061122 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:03:33.062067 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:03:33.062067 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:03:33.062067 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:03:33.062067 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:03:33.062067 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:03:33.062067 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:03:33.062067 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:03:33.062067 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:03:33.062067 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:03:33.062067 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:03:33.062067 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:03:33.062067 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application with Lock( Sep 05 12:03:33.062067 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:03:33.062067 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:03:33.062067 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:03:33.062067 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:03:33.062868 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:03:33.062868 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:03:33.062868 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:03:33.062868 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:03:33.062868 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:03:33.062868 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:03:33.062868 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:03:33.062868 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:03:33.062868 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:03:33.062868 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:03:33.062868 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 05 12:03:33.062868 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:03:33.065617 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 215/421] 10.222.0.50 () {56 vars in 1114 bytes} [Mon Sep 5 12:03:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 12:03:33.076606 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2957e5ff-d51b-4a25-ad31-6b606fab84fa None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:33.148942 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec72dfb1-10bd-468d-85dc-185465ecd22d None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:33.151032 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:33.208491 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2957e5ff-d51b-4a25-ad31-6b606fab84fa None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:33.230110 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce2ca53-94cb-4c18-84d2-e6f50417c318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:33.230774 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce2ca53-94cb-4c18-84d2-e6f50417c318 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:33.231055 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce2ca53-94cb-4c18-84d2-e6f50417c318 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:33.231354 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce2ca53-94cb-4c18-84d2-e6f50417c318 None admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:33.232065 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce2ca53-94cb-4c18-84d2-e6f50417c318 None admin] RBAC: Adding query filter params (name=member) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:03:33.232339 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce2ca53-94cb-4c18-84d2-e6f50417c318 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:33.233753 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce2ca53-94cb-4c18-84d2-e6f50417c318 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:33.258820 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 207/422] 10.222.0.50 () {56 vars in 1101 bytes} [Mon Sep 5 12:03:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:33.259100 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:33.266325 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce2ca53-94cb-4c18-84d2-e6f50417c318 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:33.268653 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39605af0-5007-4334-97c0-dd8cf21e64dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:33.269315 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39605af0-5007-4334-97c0-dd8cf21e64dd None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:33.269612 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39605af0-5007-4334-97c0-dd8cf21e64dd None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:33.269868 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39605af0-5007-4334-97c0-dd8cf21e64dd None admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:33.270552 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39605af0-5007-4334-97c0-dd8cf21e64dd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:03:33.270903 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39605af0-5007-4334-97c0-dd8cf21e64dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:33.272322 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39605af0-5007-4334-97c0-dd8cf21e64dd None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:33.282509 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 216/423] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Sep 5 12:03:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:33.288004 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39605af0-5007-4334-97c0-dd8cf21e64dd None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:33.437997 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39605af0-5007-4334-97c0-dd8cf21e64dd None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:33.475376 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a278d0-8bf4-403c-9f71-e201e730ecf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:33.476013 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a278d0-8bf4-403c-9f71-e201e730ecf9 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:33.476291 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a278d0-8bf4-403c-9f71-e201e730ecf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:33.476563 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a278d0-8bf4-403c-9f71-e201e730ecf9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:33.553415 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:33.557735 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a278d0-8bf4-403c-9f71-e201e730ecf9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:33.560316 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a278d0-8bf4-403c-9f71-e201e730ecf9 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:33.582998 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce2ca53-94cb-4c18-84d2-e6f50417c318 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:33.680296 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 217/424] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Sep 5 12:03:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 12:03:33.686915 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a278d0-8bf4-403c-9f71-e201e730ecf9 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:33.697375 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bf2f50-ec45-497b-b3a1-1c9ff4e9be24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:33.698572 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bf2f50-ec45-497b-b3a1-1c9ff4e9be24 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:33.699038 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bf2f50-ec45-497b-b3a1-1c9ff4e9be24 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:33.699486 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bf2f50-ec45-497b-b3a1-1c9ff4e9be24 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:33.768081 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:33.815136 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bf2f50-ec45-497b-b3a1-1c9ff4e9be24 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:33.817185 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bf2f50-ec45-497b-b3a1-1c9ff4e9be24 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:33.848910 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:33.861288 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a278d0-8bf4-403c-9f71-e201e730ecf9 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:33.899014 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6bad0e-f085-4d0d-8ca3-f0d01e3b6d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:33.900665 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6bad0e-f085-4d0d-8ca3-f0d01e3b6d9c None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:33.901210 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6bad0e-f085-4d0d-8ca3-f0d01e3b6d9c None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:33.902376 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6bad0e-f085-4d0d-8ca3-f0d01e3b6d9c None admin] PATH_INFO: `/v3/projects/2370f3588c6e4c5798f29493d9842333` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:33.904426 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6bad0e-f085-4d0d-8ca3-f0d01e3b6d9c None admin] RBAC: Authorizing `identity:get_project(project_id=2370f3588c6e4c5798f29493d9842333)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:33.906596 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6bad0e-f085-4d0d-8ca3-f0d01e3b6d9c None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:33.909113 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 218/425] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Sep 5 12:03:33 2022] GET /identity/v3/projects/2370f3588c6e4c5798f29493d9842333 => generated 298 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:33.910533 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3ac737-713c-42e0-be1b-04df0aa4ca4b None None] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:33.911018 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3ac737-713c-42e0-be1b-04df0aa4ca4b None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:33.911494 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3ac737-713c-42e0-be1b-04df0aa4ca4b None None] PATH_INFO: `/` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:33.917196 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 219/426] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:03:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:03:33.919525 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3ac737-713c-42e0-be1b-04df0aa4ca4b None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:33.962373 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 208/427] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Sep 5 12:03:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 696 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 12:03:33.963758 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d48da1-38cb-4c40-94c9-fd6af42b0452 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:33.964042 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d48da1-38cb-4c40-94c9-fd6af42b0452 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:33.964836 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d48da1-38cb-4c40-94c9-fd6af42b0452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:33.987844 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-80d48da1-38cb-4c40-94c9-fd6af42b0452 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:03:33.989086 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-80d48da1-38cb-4c40-94c9-fd6af42b0452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:03:34.052529 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3ac737-713c-42e0-be1b-04df0aa4ca4b None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:34.067417 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:34.085582 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 209/428] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:03:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:03:34.087740 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d48da1-38cb-4c40-94c9-fd6af42b0452 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:34.095526 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc14902d-9a55-4f4d-98c0-bcbc20cd3790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:34.096208 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc14902d-9a55-4f4d-98c0-bcbc20cd3790 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:34.096486 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc14902d-9a55-4f4d-98c0-bcbc20cd3790 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:34.096760 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc14902d-9a55-4f4d-98c0-bcbc20cd3790 None admin] PATH_INFO: `/v3/groups/50bd65b79c2d438d8b531639b276c16a` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:34.097946 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc14902d-9a55-4f4d-98c0-bcbc20cd3790 None admin] RBAC: Authorizing `identity:get_group(group_id=50bd65b79c2d438d8b531639b276c16a)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:34.099410 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc14902d-9a55-4f4d-98c0-bcbc20cd3790 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:34.101069 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 220/429] 10.222.0.50 () {56 vars in 1180 bytes} [Mon Sep 5 12:03:33 2022] GET /identity/v3/groups/50bd65b79c2d438d8b531639b276c16a => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:34.108409 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc14902d-9a55-4f4d-98c0-bcbc20cd3790 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:34.137774 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:34.218511 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc14902d-9a55-4f4d-98c0-bcbc20cd3790 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:34.260451 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e960dd-db51-4bc7-b433-2e9177ca231b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:34.261094 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e960dd-db51-4bc7-b433-2e9177ca231b None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:34.261900 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e960dd-db51-4bc7-b433-2e9177ca231b None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:34.262168 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e960dd-db51-4bc7-b433-2e9177ca231b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:34.262896 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e960dd-db51-4bc7-b433-2e9177ca231b None admin] RBAC: Adding query filter params (group.id=50bd65b79c2d438d8b531639b276c16a, role.id=bf853a508574493f9bc7d85f3c3b36fd, scope.project.id=2370f3588c6e4c5798f29493d9842333) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:03:34.263202 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e960dd-db51-4bc7-b433-2e9177ca231b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:34.264751 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e960dd-db51-4bc7-b433-2e9177ca231b None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:34.277687 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 221/430] 10.222.0.50 () {56 vars in 1376 bytes} [Mon Sep 5 12:03:34 2022] GET /identity/v3/role_assignments?group.id=50bd65b79c2d438d8b531639b276c16a&scope.project.id=2370f3588c6e4c5798f29493d9842333&role.id=bf853a508574493f9bc7d85f3c3b36fd => generated 611 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:03:34.304317 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d48da1-38cb-4c40-94c9-fd6af42b0452 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:34.359751 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8b8156-20d3-4738-8177-6a7a1ef2a80b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:34.360402 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8b8156-20d3-4738-8177-6a7a1ef2a80b None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:34.360678 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8b8156-20d3-4738-8177-6a7a1ef2a80b None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:34.360971 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8b8156-20d3-4738-8177-6a7a1ef2a80b None admin] PATH_INFO: `/v3/projects/2370f3588c6e4c5798f29493d9842333` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:34.362122 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8b8156-20d3-4738-8177-6a7a1ef2a80b None admin] RBAC: Authorizing `identity:get_project(project_id=2370f3588c6e4c5798f29493d9842333)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:34.363575 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8b8156-20d3-4738-8177-6a7a1ef2a80b None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:34.365425 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 210/431] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Sep 5 12:03:34 2022] GET /identity/v3/projects/2370f3588c6e4c5798f29493d9842333 => generated 298 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:34.370925 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e960dd-db51-4bc7-b433-2e9177ca231b None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:34.475776 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8b8156-20d3-4738-8177-6a7a1ef2a80b None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:34.501382 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:34.513000 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e960dd-db51-4bc7-b433-2e9177ca231b None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:34.546881 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:34.553923 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c733ad-009b-43c5-a000-186a66f40546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:34.554577 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c733ad-009b-43c5-a000-186a66f40546 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:34.554856 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c733ad-009b-43c5-a000-186a66f40546 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:34.555130 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c733ad-009b-43c5-a000-186a66f40546 None admin] PATH_INFO: `/v3/groups/50bd65b79c2d438d8b531639b276c16a` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:34.557426 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c733ad-009b-43c5-a000-186a66f40546 None admin] RBAC: Authorizing `identity:get_group(group_id=50bd65b79c2d438d8b531639b276c16a)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:34.559411 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c733ad-009b-43c5-a000-186a66f40546 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:34.560690 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 222/432] 10.222.0.50 () {56 vars in 1180 bytes} [Mon Sep 5 12:03:34 2022] GET /identity/v3/groups/50bd65b79c2d438d8b531639b276c16a => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:34.561902 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb54c53c-b321-4fa5-912f-32710130b0f1 None None] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:34.562185 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb54c53c-b321-4fa5-912f-32710130b0f1 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:34.562456 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb54c53c-b321-4fa5-912f-32710130b0f1 None None] PATH_INFO: `/` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:34.563807 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 223/433] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:03:34 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:03:34.570049 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb54c53c-b321-4fa5-912f-32710130b0f1 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:34.603625 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8b8156-20d3-4738-8177-6a7a1ef2a80b None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:34.647447 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5624db64-9a76-461e-9b7c-0e67e5e911cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:34.648001 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5624db64-9a76-461e-9b7c-0e67e5e911cf None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:34.648527 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5624db64-9a76-461e-9b7c-0e67e5e911cf None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:34.648793 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5624db64-9a76-461e-9b7c-0e67e5e911cf None admin] PATH_INFO: `/v3/roles/member` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:34.659955 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5624db64-9a76-461e-9b7c-0e67e5e911cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:03:34.665076 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-5624db64-9a76-461e-9b7c-0e67e5e911cf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 05 12:03:34.665076 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:03:34.665076 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:03:34.665076 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:03:34.665076 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:03:34.665076 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:03:34.665076 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:03:34.665076 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:03:34.665076 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:03:34.665076 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:03:34.665076 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:03:34.665076 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:03:34.665076 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:03:34.665076 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:03:34.665076 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:03:34.665076 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:03:34.666152 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:03:34.666152 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:03:34.666152 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:03:34.666152 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:03:34.666152 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:03:34.666152 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:03:34.666152 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:03:34.666152 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:03:34.666152 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:03:34.666152 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:03:34.666152 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:03:34.666152 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:03:34.666152 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:03:34.666152 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:03:34.666152 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:03:34.666152 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:03:34.666957 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:03:34.666957 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:03:34.666957 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:03:34.666957 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:03:34.666957 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:03:34.666957 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:03:34.666957 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:03:34.666957 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:03:34.666957 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:03:34.666957 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:03:34.666957 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 05 12:03:34.666957 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:03:34.666957 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 211/434] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Sep 5 12:03:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:03:34.667730 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d8760d-7c00-4423-9bdb-03463ebd14ab None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:34.667730 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d8760d-7c00-4423-9bdb-03463ebd14ab None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:34.667857 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d8760d-7c00-4423-9bdb-03463ebd14ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:34.686544 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-68d8760d-7c00-4423-9bdb-03463ebd14ab None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:03:34.687749 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-68d8760d-7c00-4423-9bdb-03463ebd14ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:03:34.701883 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb54c53c-b321-4fa5-912f-32710130b0f1 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:34.741750 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd95b3e-37ae-40fe-a506-f526b7d657b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:34.742365 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd95b3e-37ae-40fe-a506-f526b7d657b5 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:34.742644 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd95b3e-37ae-40fe-a506-f526b7d657b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:34.742911 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd95b3e-37ae-40fe-a506-f526b7d657b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:34.743634 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd95b3e-37ae-40fe-a506-f526b7d657b5 None admin] RBAC: Adding query filter params (group.id=50bd65b79c2d438d8b531639b276c16a, role.id=ed72181e1403401facb77dcf33644757, scope.project.id=2370f3588c6e4c5798f29493d9842333) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:03:34.743939 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd95b3e-37ae-40fe-a506-f526b7d657b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:34.745398 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd95b3e-37ae-40fe-a506-f526b7d657b5 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:34.753315 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 224/435] 10.222.0.50 () {56 vars in 1376 bytes} [Mon Sep 5 12:03:34 2022] GET /identity/v3/role_assignments?group.id=50bd65b79c2d438d8b531639b276c16a&scope.project.id=2370f3588c6e4c5798f29493d9842333&role.id=ed72181e1403401facb77dcf33644757 => generated 611 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:34.762790 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd95b3e-37ae-40fe-a506-f526b7d657b5 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:34.799110 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:34.806368 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 212/436] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:03:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:03:34.807646 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac778a4-f372-44a8-b8c2-6b9bcc257254 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:34.807931 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac778a4-f372-44a8-b8c2-6b9bcc257254 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:34.808729 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac778a4-f372-44a8-b8c2-6b9bcc257254 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:34.810214 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 213/437] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:03:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:03:34.815569 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ec1b45-f91f-4e18-bf9b-5937561c267d None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:34.815852 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ec1b45-f91f-4e18-bf9b-5937561c267d None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:34.816124 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ec1b45-f91f-4e18-bf9b-5937561c267d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:34.835694 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-59ec1b45-f91f-4e18-bf9b-5937561c267d None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:03:34.836917 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-59ec1b45-f91f-4e18-bf9b-5937561c267d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:03:34.907348 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:34.936103 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 214/438] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:03:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 05 12:03:34.950462 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd95b3e-37ae-40fe-a506-f526b7d657b5 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:35.012060 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630baa69-1daa-4b19-9c8b-a70d2fae9ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:35.013144 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630baa69-1daa-4b19-9c8b-a70d2fae9ef4 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:35.013633 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630baa69-1daa-4b19-9c8b-a70d2fae9ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:35.014109 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630baa69-1daa-4b19-9c8b-a70d2fae9ef4 None admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:35.015320 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630baa69-1daa-4b19-9c8b-a70d2fae9ef4 None admin] RBAC: Adding query filter params (name=member) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:03:35.015867 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630baa69-1daa-4b19-9c8b-a70d2fae9ef4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:35.018480 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630baa69-1daa-4b19-9c8b-a70d2fae9ef4 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:35.034788 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 225/439] 10.222.0.50 () {56 vars in 1101 bytes} [Mon Sep 5 12:03:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:35.040792 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ec1b45-f91f-4e18-bf9b-5937561c267d None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:35.090602 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630baa69-1daa-4b19-9c8b-a70d2fae9ef4 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:35.208256 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:35.222683 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ec1b45-f91f-4e18-bf9b-5937561c267d None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:35.232441 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630baa69-1daa-4b19-9c8b-a70d2fae9ef4 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:35.272717 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed768ca2-ff34-4c87-9b7c-a21d15c0f22a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:35.273991 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed768ca2-ff34-4c87-9b7c-a21d15c0f22a None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:35.274274 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed768ca2-ff34-4c87-9b7c-a21d15c0f22a None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:35.274546 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed768ca2-ff34-4c87-9b7c-a21d15c0f22a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:35.278604 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b685e79c-86a5-4cad-81c7-bb81a270686b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:35.279633 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b685e79c-86a5-4cad-81c7-bb81a270686b None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:35.279633 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b685e79c-86a5-4cad-81c7-bb81a270686b None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:35.279823 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b685e79c-86a5-4cad-81c7-bb81a270686b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:35.291643 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b685e79c-86a5-4cad-81c7-bb81a270686b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:03:35.297564 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application [None req-b685e79c-86a5-4cad-81c7-bb81a270686b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 05 12:03:35.297564 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:03:35.297564 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:03:35.297564 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:03:35.297564 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:03:35.297564 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:03:35.297564 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:03:35.297564 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:03:35.297564 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:03:35.297564 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:03:35.297564 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:03:35.297564 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:03:35.297564 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:03:35.297564 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:03:35.297564 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:03:35.297564 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:03:35.299173 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:03:35.299173 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:03:35.299173 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:03:35.299173 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:03:35.299173 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:03:35.299173 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:03:35.299173 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:03:35.299173 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:03:35.299173 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:03:35.299173 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:03:35.299173 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:03:35.299173 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application with Lock( Sep 05 12:03:35.299173 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:03:35.299173 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:03:35.299173 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:03:35.299173 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:03:35.300706 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:03:35.300706 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:03:35.300706 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:03:35.300706 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:03:35.300706 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:03:35.300706 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:03:35.300706 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:03:35.300706 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:03:35.300706 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:03:35.300706 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:03:35.300706 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 05 12:03:35.300706 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:03:35.300706 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 226/440] 10.222.0.50 () {56 vars in 1114 bytes} [Mon Sep 5 12:03:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 12:03:35.300706 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b685e79c-86a5-4cad-81c7-bb81a270686b None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:35.342041 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:35.375471 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed768ca2-ff34-4c87-9b7c-a21d15c0f22a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:35.378210 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed768ca2-ff34-4c87-9b7c-a21d15c0f22a None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:35.428419 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b685e79c-86a5-4cad-81c7-bb81a270686b None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:35.473391 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077dd2e1-b867-4498-b95b-137eeaee7114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:35.474351 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077dd2e1-b867-4498-b95b-137eeaee7114 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:35.474829 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077dd2e1-b867-4498-b95b-137eeaee7114 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:35.475298 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077dd2e1-b867-4498-b95b-137eeaee7114 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:35.495390 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077dd2e1-b867-4498-b95b-137eeaee7114 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:03:35.500457 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 215/441] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Sep 5 12:03:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 12:03:35.500457 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed768ca2-ff34-4c87-9b7c-a21d15c0f22a None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:35.505143 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application [None req-077dd2e1-b867-4498-b95b-137eeaee7114 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 12:03:35.505143 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:03:35.505143 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:03:35.505143 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:03:35.505143 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:03:35.505143 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:03:35.505143 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:03:35.505143 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:03:35.505143 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:03:35.505143 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:03:35.505143 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:03:35.505143 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:03:35.505143 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:03:35.505143 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:03:35.505143 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:03:35.505143 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:03:35.506379 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:03:35.506379 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:03:35.506379 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:03:35.506379 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:03:35.506379 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:03:35.506379 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:03:35.506379 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:03:35.506379 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:03:35.506379 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:03:35.506379 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:03:35.506379 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:03:35.506379 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application with Lock( Sep 05 12:03:35.506379 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:03:35.506379 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:03:35.506379 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:03:35.506379 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:03:35.507171 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:03:35.507171 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:03:35.507171 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:03:35.507171 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:03:35.507171 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:03:35.507171 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:03:35.507171 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:03:35.507171 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:03:35.507171 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:03:35.507171 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:03:35.507171 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 12:03:35.507171 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:03:35.507171 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 227/442] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Sep 5 12:03:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:03:35.508378 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077dd2e1-b867-4498-b95b-137eeaee7114 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:35.514069 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:35.581108 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:35.602031 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed768ca2-ff34-4c87-9b7c-a21d15c0f22a None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:35.634125 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077dd2e1-b867-4498-b95b-137eeaee7114 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:35.637289 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe4c719-614f-4e11-88f8-819ff20dca47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:35.637895 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe4c719-614f-4e11-88f8-819ff20dca47 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:35.638171 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe4c719-614f-4e11-88f8-819ff20dca47 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:35.638439 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe4c719-614f-4e11-88f8-819ff20dca47 None admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:35.639099 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe4c719-614f-4e11-88f8-819ff20dca47 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:03:35.639438 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe4c719-614f-4e11-88f8-819ff20dca47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:35.640809 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe4c719-614f-4e11-88f8-819ff20dca47 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:35.649689 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 216/443] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Sep 5 12:03:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:35.650495 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe4c719-614f-4e11-88f8-819ff20dca47 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:35.678553 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3fabf6-744b-4101-a424-e13849695695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:35.679297 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3fabf6-744b-4101-a424-e13849695695 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:35.679649 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3fabf6-744b-4101-a424-e13849695695 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:35.680012 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3fabf6-744b-4101-a424-e13849695695 None admin] PATH_INFO: `/v3/projects/b6c350f1ed014cad89f2c125d5de6e1e` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:35.681290 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3fabf6-744b-4101-a424-e13849695695 None admin] RBAC: Authorizing `identity:get_project(project_id=b6c350f1ed014cad89f2c125d5de6e1e)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:35.682752 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3fabf6-744b-4101-a424-e13849695695 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:35.684418 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 228/444] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Sep 5 12:03:35 2022] GET /identity/v3/projects/b6c350f1ed014cad89f2c125d5de6e1e => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:35.685213 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3fabf6-744b-4101-a424-e13849695695 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:35.768560 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe4c719-614f-4e11-88f8-819ff20dca47 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:35.769520 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:35.804069 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3fabf6-744b-4101-a424-e13849695695 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:35.809827 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1152d7a8-0773-463e-960d-cce7eb341311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:35.810428 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1152d7a8-0773-463e-960d-cce7eb341311 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:35.810706 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1152d7a8-0773-463e-960d-cce7eb341311 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:35.810976 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1152d7a8-0773-463e-960d-cce7eb341311 None admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:35.811643 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1152d7a8-0773-463e-960d-cce7eb341311 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:03:35.811941 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1152d7a8-0773-463e-960d-cce7eb341311 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:35.813363 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1152d7a8-0773-463e-960d-cce7eb341311 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:35.821943 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 217/445] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Sep 5 12:03:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:35.822785 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1152d7a8-0773-463e-960d-cce7eb341311 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:35.832706 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:35.848163 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cba17b-74a5-4b02-84d0-8d47901c4e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:35.848786 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cba17b-74a5-4b02-84d0-8d47901c4e24 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:35.849095 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cba17b-74a5-4b02-84d0-8d47901c4e24 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:35.849364 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cba17b-74a5-4b02-84d0-8d47901c4e24 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:35.916130 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cba17b-74a5-4b02-84d0-8d47901c4e24 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:35.917670 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cba17b-74a5-4b02-84d0-8d47901c4e24 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:35.966702 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1152d7a8-0773-463e-960d-cce7eb341311 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:35.995001 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:36.001009 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bbfadd-3072-47f5-9573-152199ee5a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:36.001646 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bbfadd-3072-47f5-9573-152199ee5a2d None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:36.001919 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bbfadd-3072-47f5-9573-152199ee5a2d None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:36.002190 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bbfadd-3072-47f5-9573-152199ee5a2d None admin] PATH_INFO: `/v3/groups/50bd65b79c2d438d8b531639b276c16a` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:36.003720 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bbfadd-3072-47f5-9573-152199ee5a2d None admin] RBAC: Authorizing `identity:get_group(group_id=50bd65b79c2d438d8b531639b276c16a)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:36.004762 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bbfadd-3072-47f5-9573-152199ee5a2d None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:36.006573 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 218/446] 10.222.0.50 () {56 vars in 1180 bytes} [Mon Sep 5 12:03:35 2022] GET /identity/v3/groups/50bd65b79c2d438d8b531639b276c16a => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:36.007134 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bbfadd-3072-47f5-9573-152199ee5a2d None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:36.042279 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 229/447] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Sep 5 12:03:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 12:03:36.043908 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cba17b-74a5-4b02-84d0-8d47901c4e24 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:36.105084 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:36.131688 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bbfadd-3072-47f5-9573-152199ee5a2d None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:36.157718 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cba17b-74a5-4b02-84d0-8d47901c4e24 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:36.167473 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f4814a-cced-4cbf-8b91-2fad71bc3def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:36.168098 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f4814a-cced-4cbf-8b91-2fad71bc3def None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:36.168367 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f4814a-cced-4cbf-8b91-2fad71bc3def None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:36.168636 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f4814a-cced-4cbf-8b91-2fad71bc3def None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:36.193330 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd66ab0b-e1f1-4cf9-b7f3-cda07df983b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:36.193939 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd66ab0b-e1f1-4cf9-b7f3-cda07df983b8 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:36.194211 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd66ab0b-e1f1-4cf9-b7f3-cda07df983b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:36.194478 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd66ab0b-e1f1-4cf9-b7f3-cda07df983b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:36.195197 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd66ab0b-e1f1-4cf9-b7f3-cda07df983b8 None admin] RBAC: Adding query filter params (group.id=50bd65b79c2d438d8b531639b276c16a, role.id=ed72181e1403401facb77dcf33644757, scope.project.id=b6c350f1ed014cad89f2c125d5de6e1e) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:03:36.195499 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd66ab0b-e1f1-4cf9-b7f3-cda07df983b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:36.196938 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd66ab0b-e1f1-4cf9-b7f3-cda07df983b8 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:36.203332 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 230/448] 10.222.0.50 () {56 vars in 1376 bytes} [Mon Sep 5 12:03:36 2022] GET /identity/v3/role_assignments?group.id=50bd65b79c2d438d8b531639b276c16a&scope.project.id=b6c350f1ed014cad89f2c125d5de6e1e&role.id=ed72181e1403401facb77dcf33644757 => generated 611 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:36.208749 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd66ab0b-e1f1-4cf9-b7f3-cda07df983b8 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:36.246935 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f4814a-cced-4cbf-8b91-2fad71bc3def None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:36.248526 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f4814a-cced-4cbf-8b91-2fad71bc3def None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:36.259968 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:36.344634 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd66ab0b-e1f1-4cf9-b7f3-cda07df983b8 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:36.345276 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:36.381547 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 219/449] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Sep 5 12:03:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 12:03:36.388522 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f4814a-cced-4cbf-8b91-2fad71bc3def None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:36.394651 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19edf03e-ad1f-4cc6-a785-832abbe1da13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:36.396950 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19edf03e-ad1f-4cc6-a785-832abbe1da13 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:36.396950 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19edf03e-ad1f-4cc6-a785-832abbe1da13 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:36.396950 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19edf03e-ad1f-4cc6-a785-832abbe1da13 None admin] PATH_INFO: `/v3/projects/b6c350f1ed014cad89f2c125d5de6e1e` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:36.397927 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19edf03e-ad1f-4cc6-a785-832abbe1da13 None admin] RBAC: Authorizing `identity:get_project(project_id=b6c350f1ed014cad89f2c125d5de6e1e)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:36.399645 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19edf03e-ad1f-4cc6-a785-832abbe1da13 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:36.401380 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 231/450] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Sep 5 12:03:36 2022] GET /identity/v3/projects/b6c350f1ed014cad89f2c125d5de6e1e => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:36.407029 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19edf03e-ad1f-4cc6-a785-832abbe1da13 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:36.527297 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f4814a-cced-4cbf-8b91-2fad71bc3def None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:36.556365 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19edf03e-ad1f-4cc6-a785-832abbe1da13 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:36.561743 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:36.577533 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eed2af-f513-4223-9be2-58193374073b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:36.578297 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eed2af-f513-4223-9be2-58193374073b None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:36.578584 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eed2af-f513-4223-9be2-58193374073b None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:36.578858 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eed2af-f513-4223-9be2-58193374073b None admin] PATH_INFO: `/v3/projects/f7dbd9a59249418592cb2f883c3937fa` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:36.581692 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97eed2af-f513-4223-9be2-58193374073b None admin] RBAC: Authorizing `identity:get_project(project_id=f7dbd9a59249418592cb2f883c3937fa)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:36.583361 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97eed2af-f513-4223-9be2-58193374073b None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:36.588961 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 220/451] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Sep 5 12:03:36 2022] GET /identity/v3/projects/f7dbd9a59249418592cb2f883c3937fa => generated 344 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:36.592798 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eed2af-f513-4223-9be2-58193374073b None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:36.610863 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98213c75-bc84-4c8c-9937-d2e9cb4c3c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:36.611845 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98213c75-bc84-4c8c-9937-d2e9cb4c3c91 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:36.612299 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98213c75-bc84-4c8c-9937-d2e9cb4c3c91 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:36.612745 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98213c75-bc84-4c8c-9937-d2e9cb4c3c91 None admin] PATH_INFO: `/v3/groups/50bd65b79c2d438d8b531639b276c16a` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:36.614417 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98213c75-bc84-4c8c-9937-d2e9cb4c3c91 None admin] RBAC: Authorizing `identity:get_group(group_id=50bd65b79c2d438d8b531639b276c16a)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:36.616921 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98213c75-bc84-4c8c-9937-d2e9cb4c3c91 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:36.624818 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 232/452] 10.222.0.50 () {56 vars in 1180 bytes} [Mon Sep 5 12:03:36 2022] GET /identity/v3/groups/50bd65b79c2d438d8b531639b276c16a => generated 226 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:03:36.626393 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98213c75-bc84-4c8c-9937-d2e9cb4c3c91 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:36.652494 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:36.714224 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eed2af-f513-4223-9be2-58193374073b None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:36.749203 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b954afd-2be8-4bd4-9249-a0e105ab39cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:36.749832 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b954afd-2be8-4bd4-9249-a0e105ab39cb None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:36.750105 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b954afd-2be8-4bd4-9249-a0e105ab39cb None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:36.750374 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b954afd-2be8-4bd4-9249-a0e105ab39cb None admin] PATH_INFO: `/v3/groups/29b45639c59a420ea67e9165b0430bac` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:36.751492 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b954afd-2be8-4bd4-9249-a0e105ab39cb None admin] RBAC: Authorizing `identity:get_group(group_id=29b45639c59a420ea67e9165b0430bac)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:36.752953 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b954afd-2be8-4bd4-9249-a0e105ab39cb None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:36.754519 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 221/453] 10.222.0.50 () {56 vars in 1180 bytes} [Mon Sep 5 12:03:36 2022] GET /identity/v3/groups/29b45639c59a420ea67e9165b0430bac => generated 229 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:03:36.761020 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b954afd-2be8-4bd4-9249-a0e105ab39cb None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:36.765991 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98213c75-bc84-4c8c-9937-d2e9cb4c3c91 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:36.803046 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a19c4e-4a26-4b18-99e1-03fe1132a50e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:36.803996 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a19c4e-4a26-4b18-99e1-03fe1132a50e None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:36.804437 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a19c4e-4a26-4b18-99e1-03fe1132a50e None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:36.804863 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a19c4e-4a26-4b18-99e1-03fe1132a50e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:36.806173 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a19c4e-4a26-4b18-99e1-03fe1132a50e None admin] RBAC: Adding query filter params (group.id=50bd65b79c2d438d8b531639b276c16a, role.id=bf853a508574493f9bc7d85f3c3b36fd, scope.project.id=b6c350f1ed014cad89f2c125d5de6e1e) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:03:36.806719 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a19c4e-4a26-4b18-99e1-03fe1132a50e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:36.810130 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a19c4e-4a26-4b18-99e1-03fe1132a50e None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:36.817922 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 233/454] 10.222.0.50 () {56 vars in 1376 bytes} [Mon Sep 5 12:03:36 2022] GET /identity/v3/role_assignments?group.id=50bd65b79c2d438d8b531639b276c16a&scope.project.id=b6c350f1ed014cad89f2c125d5de6e1e&role.id=bf853a508574493f9bc7d85f3c3b36fd => generated 611 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:36.897423 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b954afd-2be8-4bd4-9249-a0e105ab39cb None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:36.912510 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:36.942147 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7235c67c-77e7-4db5-b951-92f0a1c35ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:36.942782 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7235c67c-77e7-4db5-b951-92f0a1c35ddf None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:36.943065 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7235c67c-77e7-4db5-b951-92f0a1c35ddf None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:36.943340 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7235c67c-77e7-4db5-b951-92f0a1c35ddf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:36.944124 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7235c67c-77e7-4db5-b951-92f0a1c35ddf None admin] RBAC: Adding query filter params (group.id=29b45639c59a420ea67e9165b0430bac, role.id=16e2ccc8bd1b497d8cee780c1c7df0d2, scope.project.id=f7dbd9a59249418592cb2f883c3937fa) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:03:36.944435 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7235c67c-77e7-4db5-b951-92f0a1c35ddf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:36.946019 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7235c67c-77e7-4db5-b951-92f0a1c35ddf None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:36.953127 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 222/455] 10.222.0.50 () {56 vars in 1376 bytes} [Mon Sep 5 12:03:36 2022] GET /identity/v3/role_assignments?group.id=29b45639c59a420ea67e9165b0430bac&scope.project.id=f7dbd9a59249418592cb2f883c3937fa&role.id=16e2ccc8bd1b497d8cee780c1c7df0d2 => generated 611 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:03:39.536493 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a35f3d5-1517-4b15-8257-63178d117877 None None] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:39.536493 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a35f3d5-1517-4b15-8257-63178d117877 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:39.536493 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a35f3d5-1517-4b15-8257-63178d117877 None None] PATH_INFO: `/` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:39.539732 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 234/456] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:03:39 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:03:39.548066 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb1c507-be3b-4a13-b30c-5c184a162791 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:39.548775 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb1c507-be3b-4a13-b30c-5c184a162791 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:39.548775 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb1c507-be3b-4a13-b30c-5c184a162791 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:39.549955 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0795f53-10e5-45aa-a5bc-ac99a8ccf0ab None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:39.550254 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 223/457] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:03:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:03:39.550951 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0795f53-10e5-45aa-a5bc-ac99a8ccf0ab None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:39.551692 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0795f53-10e5-45aa-a5bc-ac99a8ccf0ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:39.555811 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e84039e-8ecb-480d-b545-bcb313adfd91 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:39.556104 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e84039e-8ecb-480d-b545-bcb313adfd91 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:39.556361 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e84039e-8ecb-480d-b545-bcb313adfd91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:39.600422 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-b0795f53-10e5-45aa-a5bc-ac99a8ccf0ab None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:03:39.602784 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-4e84039e-8ecb-480d-b545-bcb313adfd91 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:03:39.603164 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-b0795f53-10e5-45aa-a5bc-ac99a8ccf0ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:03:39.604014 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-4e84039e-8ecb-480d-b545-bcb313adfd91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:03:39.692731 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:39.745491 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 224/458] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:03:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:03:39.800848 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 235/459] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:03:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:03:40.031804 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e84039e-8ecb-480d-b545-bcb313adfd91 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:40.268045 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e84039e-8ecb-480d-b545-bcb313adfd91 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:40.276209 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:40.311828 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03af4456-6488-422a-bff9-97738a857e3a None None] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:40.312144 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03af4456-6488-422a-bff9-97738a857e3a None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:40.312390 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03af4456-6488-422a-bff9-97738a857e3a None None] PATH_INFO: `/` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:40.318142 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 236/460] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:03:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:03:40.319814 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a46330d-a802-4a1b-83f3-e049ba9d225e None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:40.320104 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a46330d-a802-4a1b-83f3-e049ba9d225e None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:40.320397 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a46330d-a802-4a1b-83f3-e049ba9d225e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:40.332498 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c42a61-ec8b-4218-9c25-1570715503e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:40.333514 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c42a61-ec8b-4218-9c25-1570715503e3 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:40.334080 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c42a61-ec8b-4218-9c25-1570715503e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:40.334407 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c42a61-ec8b-4218-9c25-1570715503e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:40.339881 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-8a46330d-a802-4a1b-83f3-e049ba9d225e None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:03:40.341449 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-8a46330d-a802-4a1b-83f3-e049ba9d225e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:03:40.351832 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c42a61-ec8b-4218-9c25-1570715503e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:40.353352 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c42a61-ec8b-4218-9c25-1570715503e3 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:40.371729 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-40c42a61-ec8b-4218-9c25-1570715503e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:03:40.371729 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:03:40.371729 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:03:40.371729 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:03:40.371729 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:03:40.371729 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:03:40.371729 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:03:40.371729 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:03:40.371729 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:03:40.371729 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:03:40.371729 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:03:40.371729 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:03:40.371729 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:03:40.371729 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:03:40.371729 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:03:40.371729 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:03:40.372712 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:03:40.372712 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:03:40.372712 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:03:40.372712 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:03:40.372712 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:03:40.372712 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:03:40.372712 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:03:40.372712 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:03:40.372712 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:03:40.372712 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:03:40.372712 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:03:40.372712 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:03:40.372712 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:03:40.372712 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:03:40.372712 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:03:40.372712 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:03:40.372712 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:03:40.373603 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:03:40.373603 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:03:40.373603 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:03:40.373603 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 225/461] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 5 12:03:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:03:40.373825 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c42a61-ec8b-4218-9c25-1570715503e3 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:40.458513 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 237/462] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:03:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:03:40.459689 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a46330d-a802-4a1b-83f3-e049ba9d225e None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:40.515944 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c42a61-ec8b-4218-9c25-1570715503e3 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:40.557316 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce74acc1-5ea4-4ebd-827a-2ce7f94b89b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:40.558000 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce74acc1-5ea4-4ebd-827a-2ce7f94b89b7 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:40.558588 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce74acc1-5ea4-4ebd-827a-2ce7f94b89b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:40.558854 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce74acc1-5ea4-4ebd-827a-2ce7f94b89b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:40.573061 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce74acc1-5ea4-4ebd-827a-2ce7f94b89b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:40.574778 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce74acc1-5ea4-4ebd-827a-2ce7f94b89b7 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:40.592319 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-ce74acc1-5ea4-4ebd-827a-2ce7f94b89b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:03:40.592319 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:03:40.592319 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:03:40.592319 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:03:40.592319 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:03:40.592319 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:03:40.592319 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:03:40.592319 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:03:40.592319 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:03:40.592319 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:03:40.592319 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:03:40.592319 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:03:40.592319 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:03:40.592319 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:03:40.592319 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:03:40.592319 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:03:40.594200 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:03:40.594200 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:03:40.594200 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:03:40.594200 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:03:40.594200 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:03:40.594200 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:03:40.594200 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:03:40.594200 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:03:40.594200 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:03:40.594200 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:03:40.594200 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:03:40.594200 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:03:40.594200 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:03:40.594200 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:03:40.594200 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:03:40.594200 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:03:40.594200 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:03:40.595916 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:03:40.595916 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:03:40.595916 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:03:40.595916 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 226/463] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 5 12:03:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:03:40.595916 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55be8030-b91a-407c-a5f6-1cf9aea7316c None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:40.595916 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55be8030-b91a-407c-a5f6-1cf9aea7316c None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:40.595916 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55be8030-b91a-407c-a5f6-1cf9aea7316c None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:40.603213 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 227/464] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:03:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:03:40.603213 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5de68a7-69d8-4a64-affb-4b8c8c447c6a None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:40.603213 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5de68a7-69d8-4a64-affb-4b8c8c447c6a None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:40.603213 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5de68a7-69d8-4a64-affb-4b8c8c447c6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:40.605837 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:40.621420 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a46330d-a802-4a1b-83f3-e049ba9d225e None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:40.628314 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-f5de68a7-69d8-4a64-affb-4b8c8c447c6a None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:03:40.629728 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-f5de68a7-69d8-4a64-affb-4b8c8c447c6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:03:40.632483 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:40.684920 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa5a114-ba4f-4655-9d48-30c0033f95ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:40.684920 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa5a114-ba4f-4655-9d48-30c0033f95ee None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:40.684920 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa5a114-ba4f-4655-9d48-30c0033f95ee None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:40.684920 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa5a114-ba4f-4655-9d48-30c0033f95ee None admin] PATH_INFO: `/v3/domains` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:40.685352 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa5a114-ba4f-4655-9d48-30c0033f95ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:03:40.685352 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa5a114-ba4f-4655-9d48-30c0033f95ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:40.685352 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa5a114-ba4f-4655-9d48-30c0033f95ee None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:40.704257 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 238/465] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 5 12:03:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:40.705853 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa5a114-ba4f-4655-9d48-30c0033f95ee None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:40.759963 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 228/466] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:03:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:03:40.760876 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5de68a7-69d8-4a64-affb-4b8c8c447c6a None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:40.874223 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5de68a7-69d8-4a64-affb-4b8c8c447c6a None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:40.909520 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa5a114-ba4f-4655-9d48-30c0033f95ee None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:40.915954 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f40a6c8-7c47-46bf-ab10-4365e81b3f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:40.916591 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f40a6c8-7c47-46bf-ab10-4365e81b3f6b None admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:40.916843 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f40a6c8-7c47-46bf-ab10-4365e81b3f6b None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:40.917163 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f40a6c8-7c47-46bf-ab10-4365e81b3f6b None admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:40.918377 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f40a6c8-7c47-46bf-ab10-4365e81b3f6b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:40.919948 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f40a6c8-7c47-46bf-ab10-4365e81b3f6b None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:40.931899 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:40.953113 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 229/467] 10.222.0.50 () {60 vars in 1132 bytes} [Mon Sep 5 12:03:40 2022] POST /identity/v3/users => generated 248 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:03:40.955306 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f40a6c8-7c47-46bf-ab10-4365e81b3f6b None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:41.006204 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8a221d-df2d-4a0d-b08d-10f877606ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:41.010029 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a221d-df2d-4a0d-b08d-10f877606ba4 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:41.012810 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a221d-df2d-4a0d-b08d-10f877606ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:41.013582 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a221d-df2d-4a0d-b08d-10f877606ba4 None admin] PATH_INFO: `/v3/domains` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:41.016713 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8a221d-df2d-4a0d-b08d-10f877606ba4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:03:41.017603 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8a221d-df2d-4a0d-b08d-10f877606ba4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:41.020715 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8a221d-df2d-4a0d-b08d-10f877606ba4 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:41.048790 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 239/468] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 5 12:03:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:41.049482 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8a221d-df2d-4a0d-b08d-10f877606ba4 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:41.084436 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:41.196658 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8a221d-df2d-4a0d-b08d-10f877606ba4 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:41.197873 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f40a6c8-7c47-46bf-ab10-4365e81b3f6b None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:41.245220 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b5d51e-04f6-4eb8-9db3-eca5d3c46ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:41.245912 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b5d51e-04f6-4eb8-9db3-eca5d3c46ac5 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:41.246188 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b5d51e-04f6-4eb8-9db3-eca5d3c46ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:41.246458 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b5d51e-04f6-4eb8-9db3-eca5d3c46ac5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:41.258631 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b5d51e-04f6-4eb8-9db3-eca5d3c46ac5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:41.260420 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b5d51e-04f6-4eb8-9db3-eca5d3c46ac5 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:41.265754 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0010695d-a086-4c43-8bc4-bd77e4e61d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:41.266861 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0010695d-a086-4c43-8bc4-bd77e4e61d0f None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:41.267363 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0010695d-a086-4c43-8bc4-bd77e4e61d0f None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:41.267863 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0010695d-a086-4c43-8bc4-bd77e4e61d0f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:41.279377 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application [None req-70b5d51e-04f6-4eb8-9db3-eca5d3c46ac5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:03:41.279377 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:03:41.279377 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:03:41.279377 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:03:41.279377 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:03:41.279377 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:03:41.279377 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:03:41.279377 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:03:41.279377 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:03:41.279377 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:03:41.279377 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:03:41.279377 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:03:41.279377 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:03:41.279377 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:03:41.279377 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:03:41.279377 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:03:41.280399 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:03:41.280399 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:03:41.280399 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:03:41.280399 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:03:41.280399 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:03:41.280399 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:03:41.280399 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:03:41.280399 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application with Lock( Sep 05 12:03:41.280399 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:03:41.280399 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:03:41.280399 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:03:41.280399 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:03:41.280399 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:03:41.280399 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:03:41.280399 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:03:41.280399 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:03:41.280399 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:03:41.281289 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:03:41.281289 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:03:41.281289 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:03:41.281289 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 240/469] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 5 12:03:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:03:41.281973 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b5d51e-04f6-4eb8-9db3-eca5d3c46ac5 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:41.290570 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0010695d-a086-4c43-8bc4-bd77e4e61d0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:41.292073 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0010695d-a086-4c43-8bc4-bd77e4e61d0f None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:41.308661 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-0010695d-a086-4c43-8bc4-bd77e4e61d0f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:03:41.308661 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:03:41.308661 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:03:41.308661 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:03:41.308661 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:03:41.308661 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:03:41.308661 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:03:41.308661 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:03:41.308661 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:03:41.308661 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:03:41.308661 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:03:41.308661 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:03:41.308661 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:03:41.308661 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:03:41.308661 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:03:41.308661 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:03:41.309750 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:03:41.309750 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:03:41.309750 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:03:41.309750 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:03:41.309750 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:03:41.309750 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:03:41.309750 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:03:41.309750 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:03:41.309750 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:03:41.309750 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:03:41.309750 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:03:41.309750 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:03:41.309750 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:03:41.309750 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:03:41.309750 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:03:41.309750 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:03:41.309750 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:03:41.315705 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:03:41.315705 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:03:41.315705 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:03:41.315705 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 230/470] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 5 12:03:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 356 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:03:41.315705 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cffc5a0-3882-4b13-9f22-c5899f577ea6 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:41.315705 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cffc5a0-3882-4b13-9f22-c5899f577ea6 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:41.315705 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cffc5a0-3882-4b13-9f22-c5899f577ea6 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:41.315705 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 231/471] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:03:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:03:41.315705 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cffc5a0-3882-4b13-9f22-c5899f577ea6 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:41.374734 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:41.398747 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:41.423194 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b5d51e-04f6-4eb8-9db3-eca5d3c46ac5 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:41.460831 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b975912e-8a8a-4c8a-90ff-d7640f99f089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:41.461418 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b975912e-8a8a-4c8a-90ff-d7640f99f089 None admin] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:41.461705 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b975912e-8a8a-4c8a-90ff-d7640f99f089 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:41.462250 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b975912e-8a8a-4c8a-90ff-d7640f99f089 None admin] PATH_INFO: `/v3/users` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:41.462665 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b975912e-8a8a-4c8a-90ff-d7640f99f089 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:41.464192 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b975912e-8a8a-4c8a-90ff-d7640f99f089 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:41.488367 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 241/472] 10.222.0.50 () {60 vars in 1132 bytes} [Mon Sep 5 12:03:41 2022] POST /identity/v3/users => generated 246 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:03:41.489349 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b975912e-8a8a-4c8a-90ff-d7640f99f089 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:41.501670 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cffc5a0-3882-4b13-9f22-c5899f577ea6 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:41.560125 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caadecd-d367-4ad0-aad0-a31f00c6dba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:41.561682 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caadecd-d367-4ad0-aad0-a31f00c6dba5 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:41.561968 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caadecd-d367-4ad0-aad0-a31f00c6dba5 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:41.562294 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caadecd-d367-4ad0-aad0-a31f00c6dba5 None admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:41.563980 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caadecd-d367-4ad0-aad0-a31f00c6dba5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:03:41.564302 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caadecd-d367-4ad0-aad0-a31f00c6dba5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:41.565798 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caadecd-d367-4ad0-aad0-a31f00c6dba5 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:41.589226 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 232/473] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 5 12:03:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:41.590802 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf91520-c3fb-4073-8e3b-a7f8cadb2c11 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:41.591127 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf91520-c3fb-4073-8e3b-a7f8cadb2c11 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:41.591422 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf91520-c3fb-4073-8e3b-a7f8cadb2c11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:41.618549 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b975912e-8a8a-4c8a-90ff-d7640f99f089 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:41.619279 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-ddf91520-c3fb-4073-8e3b-a7f8cadb2c11 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:03:41.621298 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-ddf91520-c3fb-4073-8e3b-a7f8cadb2c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:03:41.651072 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:41.668323 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2051590e-39d6-453d-bd8a-900043e5ade3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:41.669613 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2051590e-39d6-453d-bd8a-900043e5ade3 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:41.669770 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2051590e-39d6-453d-bd8a-900043e5ade3 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:41.670060 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2051590e-39d6-453d-bd8a-900043e5ade3 None admin] PATH_INFO: `/v3/domains` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:41.670805 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2051590e-39d6-453d-bd8a-900043e5ade3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:03:41.671198 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2051590e-39d6-453d-bd8a-900043e5ade3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:41.672837 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2051590e-39d6-453d-bd8a-900043e5ade3 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:41.696687 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 242/474] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 5 12:03:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:41.696687 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2051590e-39d6-453d-bd8a-900043e5ade3 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:41.734922 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 233/475] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:03:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:03:41.736089 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf91520-c3fb-4073-8e3b-a7f8cadb2c11 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:41.793934 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:41.853404 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2051590e-39d6-453d-bd8a-900043e5ade3 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:41.867641 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf91520-c3fb-4073-8e3b-a7f8cadb2c11 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:41.893955 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601cf72b-1305-4590-9899-f48c48048e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:41.894757 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601cf72b-1305-4590-9899-f48c48048e65 None admin] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:41.895132 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601cf72b-1305-4590-9899-f48c48048e65 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:41.895481 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601cf72b-1305-4590-9899-f48c48048e65 None admin] PATH_INFO: `/v3/users` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:41.896527 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601cf72b-1305-4590-9899-f48c48048e65 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:41.897848 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601cf72b-1305-4590-9899-f48c48048e65 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:41.908957 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adbfbe4-8f24-478e-9b49-a1b0f2b9a59a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:41.909961 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adbfbe4-8f24-478e-9b49-a1b0f2b9a59a None admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:41.910815 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adbfbe4-8f24-478e-9b49-a1b0f2b9a59a None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:41.911062 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adbfbe4-8f24-478e-9b49-a1b0f2b9a59a None admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:41.912150 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adbfbe4-8f24-478e-9b49-a1b0f2b9a59a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:41.913928 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adbfbe4-8f24-478e-9b49-a1b0f2b9a59a None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:41.928035 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 243/476] 10.222.0.50 () {60 vars in 1132 bytes} [Mon Sep 5 12:03:41 2022] POST /identity/v3/users => generated 249 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:03:41.940359 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 234/477] 10.222.0.50 () {60 vars in 1132 bytes} [Mon Sep 5 12:03:41 2022] POST /identity/v3/users => generated 248 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:03:42.224078 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601cf72b-1305-4590-9899-f48c48048e65 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:42.288529 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:42.360951 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601cf72b-1305-4590-9899-f48c48048e65 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:42.401166 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e44fb5-93f5-4c72-b980-6c8b0ef990c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:42.402432 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e44fb5-93f5-4c72-b980-6c8b0ef990c6 None admin] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:42.402716 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e44fb5-93f5-4c72-b980-6c8b0ef990c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:42.402991 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e44fb5-93f5-4c72-b980-6c8b0ef990c6 None admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:42.403695 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e44fb5-93f5-4c72-b980-6c8b0ef990c6 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:42.405121 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e44fb5-93f5-4c72-b980-6c8b0ef990c6 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:42.413770 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.sql.core [None req-14e44fb5-93f5-4c72-b980-6c8b0ef990c6 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 05 12:03:42.413770 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 05 12:03:42.413770 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [parameters: {'id': '4461d72279464ccc8d0d41fdd1b06c38', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 05 12:03:42.413770 dv-cinder-855189-1-smb devstack@keystone.service[81719]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81719) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 05 12:03:42.431517 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application [None req-14e44fb5-93f5-4c72-b980-6c8b0ef990c6 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 05 12:03:42.431517 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:03:42.431517 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 05 12:03:42.431517 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 05 12:03:42.431517 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 05 12:03:42.431517 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 05 12:03:42.431517 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 05 12:03:42.431517 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application result = self._query(query) Sep 05 12:03:42.431517 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 05 12:03:42.431517 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application conn.query(q) Sep 05 12:03:42.431517 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 05 12:03:42.431517 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 05 12:03:42.431517 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 05 12:03:42.431517 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application result.read() Sep 05 12:03:42.431517 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 05 12:03:42.432483 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 05 12:03:42.432483 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 05 12:03:42.432483 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 05 12:03:42.432483 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 05 12:03:42.432483 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 05 12:03:42.432483 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 05 12:03:42.432483 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 05 12:03:42.432483 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 05 12:03:42.432483 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:03:42.432483 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 05 12:03:42.432483 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:03:42.432483 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:03:42.432483 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 05 12:03:42.432483 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 05 12:03:42.432483 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 05 12:03:42.432483 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return ref.to_dict() Sep 05 12:03:42.432483 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 05 12:03:42.432483 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application next(self.gen) Sep 05 12:03:42.433613 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 05 12:03:42.433613 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application yield resource Sep 05 12:03:42.433613 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 05 12:03:42.433613 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application next(self.gen) Sep 05 12:03:42.433613 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 05 12:03:42.433613 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application self.session.rollback() Sep 05 12:03:42.433613 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 05 12:03:42.433613 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application self.force_reraise() Sep 05 12:03:42.433613 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 05 12:03:42.433613 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise self.value Sep 05 12:03:42.433613 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 05 12:03:42.433613 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 05 12:03:42.433613 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 05 12:03:42.433613 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application session.commit() Sep 05 12:03:42.433613 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 05 12:03:42.433613 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 05 12:03:42.433613 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 05 12:03:42.434467 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application self._prepare_impl() Sep 05 12:03:42.434467 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 05 12:03:42.434467 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application self.session.flush() Sep 05 12:03:42.434467 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 05 12:03:42.434467 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application self._flush(objects) Sep 05 12:03:42.434467 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 05 12:03:42.434467 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 05 12:03:42.434467 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 05 12:03:42.434467 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application compat.raise_( Sep 05 12:03:42.434467 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 05 12:03:42.434467 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception Sep 05 12:03:42.434467 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 05 12:03:42.434467 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application flush_context.execute() Sep 05 12:03:42.434467 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 05 12:03:42.434467 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application rec.execute(self) Sep 05 12:03:42.434467 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 05 12:03:42.434467 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 05 12:03:42.435364 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 05 12:03:42.435364 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 05 12:03:42.435364 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 05 12:03:42.435364 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 05 12:03:42.435364 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 05 12:03:42.435364 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 05 12:03:42.435364 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 05 12:03:42.435364 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 05 12:03:42.435364 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 05 12:03:42.435364 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 05 12:03:42.435364 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 05 12:03:42.435364 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 05 12:03:42.435364 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 05 12:03:42.435364 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 05 12:03:42.435364 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 05 12:03:42.435364 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception Sep 05 12:03:42.436193 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 05 12:03:42.436193 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 05 12:03:42.436193 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 05 12:03:42.436193 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 05 12:03:42.436193 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 05 12:03:42.436193 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application result = self._query(query) Sep 05 12:03:42.436193 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 05 12:03:42.436193 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application conn.query(q) Sep 05 12:03:42.436193 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 05 12:03:42.436193 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 05 12:03:42.436193 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 05 12:03:42.436193 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application result.read() Sep 05 12:03:42.436193 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 05 12:03:42.436193 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 05 12:03:42.436193 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 05 12:03:42.436193 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 05 12:03:42.438592 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 05 12:03:42.438592 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 05 12:03:42.438592 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 05 12:03:42.438592 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 05 12:03:42.438592 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 05 12:03:42.438592 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 05 12:03:42.438592 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application [parameters: {'id': '4461d72279464ccc8d0d41fdd1b06c38', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 05 12:03:42.438592 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 05 12:03:42.438592 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:03:42.438592 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 12:03:42.438592 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:03:42.438592 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:03:42.438592 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:03:42.438592 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:03:42.438592 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:03:42.438592 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:03:42.440702 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:03:42.440702 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:03:42.440702 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:03:42.440702 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:03:42.440702 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:03:42.440702 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:03:42.440702 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 05 12:03:42.440702 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 05 12:03:42.440702 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:03:42.440702 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:03:42.440702 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 05 12:03:42.440702 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 05 12:03:42.440702 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 05 12:03:42.440702 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 05 12:03:42.440702 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 05 12:03:42.440702 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:03:42.442756 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 244/478] 10.222.0.50 () {60 vars in 1131 bytes} [Mon Sep 5 12:03:42 2022] POST /identity/v3/roles => generated 144 bytes in 210 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:03:42.442896 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adbfbe4-8f24-478e-9b49-a1b0f2b9a59a None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:42.554910 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:42.568302 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adbfbe4-8f24-478e-9b49-a1b0f2b9a59a None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:42.609350 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de257a57-4e5f-437b-8755-827eb35c0b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:42.609993 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de257a57-4e5f-437b-8755-827eb35c0b29 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:42.610272 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de257a57-4e5f-437b-8755-827eb35c0b29 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:42.610538 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de257a57-4e5f-437b-8755-827eb35c0b29 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:42.624092 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de257a57-4e5f-437b-8755-827eb35c0b29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:03:42.629774 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-de257a57-4e5f-437b-8755-827eb35c0b29 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 05 12:03:42.629774 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:03:42.629774 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:03:42.629774 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:03:42.629774 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:03:42.629774 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:03:42.629774 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:03:42.629774 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:03:42.629774 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:03:42.629774 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:03:42.629774 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:03:42.629774 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:03:42.629774 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:03:42.629774 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:03:42.629774 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:03:42.629774 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:03:42.632039 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:03:42.632039 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:03:42.632039 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:03:42.632039 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:03:42.632039 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:03:42.632039 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:03:42.632039 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:03:42.632039 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:03:42.632039 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:03:42.632039 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:03:42.632039 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:03:42.632039 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:03:42.632039 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:03:42.632039 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:03:42.632039 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:03:42.632039 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:03:42.634074 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:03:42.634074 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:03:42.634074 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:03:42.634074 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:03:42.634074 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:03:42.634074 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:03:42.634074 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:03:42.634074 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:03:42.634074 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:03:42.634074 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:03:42.634074 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 05 12:03:42.634074 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:03:42.634074 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 235/479] 10.222.0.50 () {56 vars in 1114 bytes} [Mon Sep 5 12:03:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:03:42.640936 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e44fb5-93f5-4c72-b980-6c8b0ef990c6 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:42.754422 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e44fb5-93f5-4c72-b980-6c8b0ef990c6 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:42.757527 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:42.793834 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8270bd00-386b-480e-bef8-e3cb3501ab51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:42.794462 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8270bd00-386b-480e-bef8-e3cb3501ab51 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:42.794743 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8270bd00-386b-480e-bef8-e3cb3501ab51 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:42.795018 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8270bd00-386b-480e-bef8-e3cb3501ab51 None admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:42.795702 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8270bd00-386b-480e-bef8-e3cb3501ab51 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:03:42.796004 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8270bd00-386b-480e-bef8-e3cb3501ab51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:42.797425 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8270bd00-386b-480e-bef8-e3cb3501ab51 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:42.807054 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 245/480] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Sep 5 12:03:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:43.194225 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37193d7e-c036-44ba-a7d6-49625e9c5c69 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:43.194603 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37193d7e-c036-44ba-a7d6-49625e9c5c69 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:43.194842 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37193d7e-c036-44ba-a7d6-49625e9c5c69 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:43.196449 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 236/481] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:03:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:03:43.202369 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eff6986-168c-4f66-8a0a-f8e3bce9bd6d None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:43.202679 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eff6986-168c-4f66-8a0a-f8e3bce9bd6d None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:43.202925 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eff6986-168c-4f66-8a0a-f8e3bce9bd6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:43.224054 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-7eff6986-168c-4f66-8a0a-f8e3bce9bd6d None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:03:43.225382 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-7eff6986-168c-4f66-8a0a-f8e3bce9bd6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:03:43.334356 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 246/482] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:03:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:03:43.675272 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37193d7e-c036-44ba-a7d6-49625e9c5c69 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:43.829451 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37193d7e-c036-44ba-a7d6-49625e9c5c69 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:43.915336 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a27e676-d8c8-491f-bce7-6c6dc16d41a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:43.916354 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a27e676-d8c8-491f-bce7-6c6dc16d41a9 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:43.916815 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a27e676-d8c8-491f-bce7-6c6dc16d41a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:43.917859 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a27e676-d8c8-491f-bce7-6c6dc16d41a9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:43.943115 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a27e676-d8c8-491f-bce7-6c6dc16d41a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:03:43.952766 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-9a27e676-d8c8-491f-bce7-6c6dc16d41a9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 05 12:03:43.952766 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:03:43.952766 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:03:43.952766 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:03:43.952766 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:03:43.952766 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:03:43.952766 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:03:43.952766 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:03:43.952766 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:03:43.952766 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:03:43.952766 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:03:43.952766 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:03:43.952766 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:03:43.952766 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:03:43.952766 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:03:43.952766 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:03:43.953747 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:03:43.953747 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:03:43.953747 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:03:43.953747 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:03:43.953747 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:03:43.953747 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:03:43.953747 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:03:43.953747 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:03:43.953747 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:03:43.953747 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:03:43.953747 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:03:43.953747 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:03:43.953747 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:03:43.953747 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:03:43.953747 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:03:43.953747 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:03:43.954571 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:03:43.954571 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:03:43.954571 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:03:43.954571 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:03:43.954571 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:03:43.954571 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:03:43.954571 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:03:43.954571 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:03:43.954571 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:03:43.954571 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:03:43.954571 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 05 12:03:43.954571 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:03:43.959168 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 237/483] 10.222.0.50 () {56 vars in 1102 bytes} [Mon Sep 5 12:03:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 12:03:43.962010 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eff6986-168c-4f66-8a0a-f8e3bce9bd6d None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:44.134443 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eff6986-168c-4f66-8a0a-f8e3bce9bd6d None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:44.137229 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:44.172334 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b60f80-9596-4cf3-8925-d5be27a57f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:44.172973 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b60f80-9596-4cf3-8925-d5be27a57f5c None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:44.173253 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b60f80-9596-4cf3-8925-d5be27a57f5c None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:44.173522 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b60f80-9596-4cf3-8925-d5be27a57f5c None admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:44.174197 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b60f80-9596-4cf3-8925-d5be27a57f5c None admin] RBAC: Adding query filter params (name=service) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:03:44.174495 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b60f80-9596-4cf3-8925-d5be27a57f5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:44.175863 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b60f80-9596-4cf3-8925-d5be27a57f5c None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:44.185021 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 247/484] 10.222.0.50 () {56 vars in 1103 bytes} [Mon Sep 5 12:03:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:44.190437 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a27e676-d8c8-491f-bce7-6c6dc16d41a9 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:44.207690 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:44.329465 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a27e676-d8c8-491f-bce7-6c6dc16d41a9 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:44.373354 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96da48c4-29e1-43f5-a20d-6b6d37a4a4d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:44.373999 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96da48c4-29e1-43f5-a20d-6b6d37a4a4d9 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:44.374283 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96da48c4-29e1-43f5-a20d-6b6d37a4a4d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:44.374552 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96da48c4-29e1-43f5-a20d-6b6d37a4a4d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:44.392873 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96da48c4-29e1-43f5-a20d-6b6d37a4a4d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:44.394512 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96da48c4-29e1-43f5-a20d-6b6d37a4a4d9 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:44.412394 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-96da48c4-29e1-43f5-a20d-6b6d37a4a4d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:03:44.412394 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:03:44.412394 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:03:44.412394 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:03:44.412394 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:03:44.412394 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:03:44.412394 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:03:44.412394 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:03:44.412394 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:03:44.412394 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:03:44.412394 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:03:44.412394 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:03:44.412394 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:03:44.412394 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:03:44.412394 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:03:44.412394 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:03:44.413430 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:03:44.413430 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:03:44.413430 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:03:44.413430 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:03:44.413430 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:03:44.413430 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:03:44.413430 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:03:44.413430 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:03:44.413430 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:03:44.413430 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:03:44.413430 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:03:44.413430 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:03:44.413430 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:03:44.413430 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:03:44.413430 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:03:44.413430 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:03:44.413430 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:03:44.414287 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:03:44.414287 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:03:44.414287 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:03:44.414287 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 238/485] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 5 12:03:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:03:44.420225 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b60f80-9596-4cf3-8925-d5be27a57f5c None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:44.528762 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b60f80-9596-4cf3-8925-d5be27a57f5c None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:44.564743 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4f598d-9806-41d3-9e89-c17453b5d3c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:44.565394 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4f598d-9806-41d3-9e89-c17453b5d3c5 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:44.565672 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4f598d-9806-41d3-9e89-c17453b5d3c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:44.565942 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4f598d-9806-41d3-9e89-c17453b5d3c5 None admin] PATH_INFO: `/v3/domains` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:44.566592 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4f598d-9806-41d3-9e89-c17453b5d3c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:03:44.566891 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4f598d-9806-41d3-9e89-c17453b5d3c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:44.568269 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4f598d-9806-41d3-9e89-c17453b5d3c5 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:44.581665 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093eca97-3e46-431c-bffe-bbce0c6d19f0 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:44.581965 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093eca97-3e46-431c-bffe-bbce0c6d19f0 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:44.582208 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093eca97-3e46-431c-bffe-bbce0c6d19f0 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:44.583538 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 239/486] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:03:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 12:03:44.585293 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 248/487] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 5 12:03:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:44.589133 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae649b2c-0505-4d9b-8522-cb57ffb204b2 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:44.589420 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae649b2c-0505-4d9b-8522-cb57ffb204b2 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:44.589697 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae649b2c-0505-4d9b-8522-cb57ffb204b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:44.590593 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4f598d-9806-41d3-9e89-c17453b5d3c5 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:44.609575 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-ae649b2c-0505-4d9b-8522-cb57ffb204b2 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:03:44.610836 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-ae649b2c-0505-4d9b-8522-cb57ffb204b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:03:44.617328 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:44.694239 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:44.695841 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4f598d-9806-41d3-9e89-c17453b5d3c5 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:44.705183 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 240/488] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:03:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:03:44.714968 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686e2032-b88f-44f7-ba5e-5c7ea5cce0c9 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:44.715466 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686e2032-b88f-44f7-ba5e-5c7ea5cce0c9 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:44.715885 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686e2032-b88f-44f7-ba5e-5c7ea5cce0c9 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:44.717714 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 241/489] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:03:44 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:03:44.733386 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca968155-b69c-40ab-a6da-3e3d07536484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:44.734013 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca968155-b69c-40ab-a6da-3e3d07536484 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:44.734284 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca968155-b69c-40ab-a6da-3e3d07536484 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:44.734555 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca968155-b69c-40ab-a6da-3e3d07536484 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:44.736436 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0000cb81-c914-4cf9-a994-29f52eff0428 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:44.736872 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0000cb81-c914-4cf9-a994-29f52eff0428 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:44.737327 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0000cb81-c914-4cf9-a994-29f52eff0428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:44.748984 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca968155-b69c-40ab-a6da-3e3d07536484 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:44.748984 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca968155-b69c-40ab-a6da-3e3d07536484 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:44.758203 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application [None req-ca968155-b69c-40ab-a6da-3e3d07536484 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 05 12:03:44.758203 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:03:44.758203 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:03:44.758203 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:03:44.758203 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:03:44.758203 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:03:44.758203 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:03:44.758203 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:03:44.758203 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:03:44.758203 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:03:44.758203 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:03:44.758203 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:03:44.758203 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 12:03:44.758203 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 12:03:44.758203 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 12:03:44.758203 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 12:03:44.759373 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:03:44.759373 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:03:44.759373 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 12:03:44.759373 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:03:44.759373 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 12:03:44.759373 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:03:44.759373 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:03:44.759373 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:03:44.759373 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:03:44.759373 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:03:44.759373 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:03:44.759373 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application with Lock( Sep 05 12:03:44.759373 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:03:44.759373 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:03:44.759373 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:03:44.759373 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:03:44.759373 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:03:44.759373 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:03:44.760376 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:03:44.760376 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:03:44.760376 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 12:03:44.760376 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 12:03:44.760376 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 12:03:44.760376 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 12:03:44.760376 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 12:03:44.760376 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 12:03:44.760376 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 05 12:03:44.760376 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:03:44.764587 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 249/490] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Sep 5 12:03:44 2022] GET /identity/v3/users/glance => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:03:44.765545 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca968155-b69c-40ab-a6da-3e3d07536484 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:44.776044 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-0000cb81-c914-4cf9-a994-29f52eff0428 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:03:44.778080 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-0000cb81-c914-4cf9-a994-29f52eff0428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:03:44.853647 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 242/491] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:03:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:03:44.982804 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:45.025053 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca968155-b69c-40ab-a6da-3e3d07536484 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:45.090268 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0000cb81-c914-4cf9-a994-29f52eff0428 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:45.092367 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ae8879-b675-4871-95be-5eb2396f3561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:45.096946 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ae8879-b675-4871-95be-5eb2396f3561 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:45.096946 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ae8879-b675-4871-95be-5eb2396f3561 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:45.096946 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ae8879-b675-4871-95be-5eb2396f3561 None admin] PATH_INFO: `/v3/users` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:45.096946 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ae8879-b675-4871-95be-5eb2396f3561 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:03:45.096946 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ae8879-b675-4871-95be-5eb2396f3561 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:45.098521 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ae8879-b675-4871-95be-5eb2396f3561 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:45.170357 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 250/492] 10.222.0.50 () {56 vars in 1137 bytes} [Mon Sep 5 12:03:44 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 405 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:45.171925 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ae8879-b675-4871-95be-5eb2396f3561 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:45.273042 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0000cb81-c914-4cf9-a994-29f52eff0428 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:45.295389 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ae8879-b675-4871-95be-5eb2396f3561 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:45.315103 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:45.333473 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88a3cec-6bc0-4af3-9755-4f8cd932b7f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:45.334512 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a56f96-56d8-4538-90d0-2d1873a7d61b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:45.334637 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88a3cec-6bc0-4af3-9755-4f8cd932b7f9 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:45.335006 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88a3cec-6bc0-4af3-9755-4f8cd932b7f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:45.335172 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a56f96-56d8-4538-90d0-2d1873a7d61b None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:45.335417 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a56f96-56d8-4538-90d0-2d1873a7d61b None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:45.335508 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88a3cec-6bc0-4af3-9755-4f8cd932b7f9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:45.335690 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a56f96-56d8-4538-90d0-2d1873a7d61b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:45.338756 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:45.349224 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88a3cec-6bc0-4af3-9755-4f8cd932b7f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:03:45.350602 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a56f96-56d8-4538-90d0-2d1873a7d61b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:03:45.354073 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-a88a3cec-6bc0-4af3-9755-4f8cd932b7f9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 05 12:03:45.354073 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:03:45.354073 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:03:45.354073 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:03:45.354073 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:03:45.354073 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:03:45.354073 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:03:45.354073 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:03:45.354073 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:03:45.354073 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:03:45.354073 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:03:45.354073 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:03:45.354073 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:03:45.354073 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:03:45.354073 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:03:45.354073 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:03:45.356252 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:03:45.356252 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:03:45.356252 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:03:45.356252 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:03:45.356252 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:03:45.356252 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:03:45.356252 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:03:45.356252 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:03:45.356252 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:03:45.356252 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:03:45.356252 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:03:45.356252 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:03:45.356252 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:03:45.356252 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:03:45.356252 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:03:45.356252 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:03:45.358501 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:03:45.358501 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:03:45.358501 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:03:45.358501 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:03:45.358501 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:03:45.358501 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:03:45.358501 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:03:45.358501 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:03:45.358501 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:03:45.358501 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:03:45.358501 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 05 12:03:45.358501 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:03:45.358501 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 243/493] 10.222.0.50 () {56 vars in 1102 bytes} [Mon Sep 5 12:03:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:03:45.358501 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88a3cec-6bc0-4af3-9755-4f8cd932b7f9 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:45.361268 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application [None req-86a56f96-56d8-4538-90d0-2d1873a7d61b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 05 12:03:45.361268 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:03:45.361268 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:03:45.361268 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:03:45.361268 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:03:45.361268 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:03:45.361268 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:03:45.361268 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:03:45.361268 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:03:45.361268 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:03:45.361268 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:03:45.361268 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:03:45.361268 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:03:45.361268 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:03:45.361268 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:03:45.361268 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:03:45.364690 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:03:45.364690 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:03:45.364690 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:03:45.364690 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:03:45.364690 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:03:45.364690 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:03:45.364690 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:03:45.364690 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:03:45.364690 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:03:45.364690 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:03:45.364690 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:03:45.364690 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application with Lock( Sep 05 12:03:45.364690 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:03:45.364690 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:03:45.364690 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:03:45.364690 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:03:45.370375 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:03:45.370375 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:03:45.370375 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:03:45.370375 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:03:45.370375 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:03:45.370375 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:03:45.370375 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:03:45.370375 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:03:45.370375 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:03:45.370375 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:03:45.370375 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 05 12:03:45.370375 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:03:45.370375 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 251/494] 10.222.0.50 () {56 vars in 1102 bytes} [Mon Sep 5 12:03:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:03:45.370375 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c0d4c9-dca4-483b-bd1e-d0baa51d4e21 None None] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:45.372501 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c0d4c9-dca4-483b-bd1e-d0baa51d4e21 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:45.372501 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c0d4c9-dca4-483b-bd1e-d0baa51d4e21 None None] PATH_INFO: `/` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:45.372501 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 252/495] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:03:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:03:45.372501 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c0d4c9-dca4-483b-bd1e-d0baa51d4e21 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:45.519936 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88a3cec-6bc0-4af3-9755-4f8cd932b7f9 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:45.536927 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c0d4c9-dca4-483b-bd1e-d0baa51d4e21 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:45.565035 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28031a21-399b-4696-aa2b-130dd1710f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:45.565917 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28031a21-399b-4696-aa2b-130dd1710f20 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:45.566335 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28031a21-399b-4696-aa2b-130dd1710f20 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:45.566746 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28031a21-399b-4696-aa2b-130dd1710f20 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:45.615380 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba261257-b801-4d47-a5d3-56b198a8bf98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:45.616845 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba261257-b801-4d47-a5d3-56b198a8bf98 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:45.617636 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba261257-b801-4d47-a5d3-56b198a8bf98 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:45.618379 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba261257-b801-4d47-a5d3-56b198a8bf98 None admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:45.619947 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba261257-b801-4d47-a5d3-56b198a8bf98 None admin] RBAC: Adding query filter params (name=service) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:03:45.621342 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba261257-b801-4d47-a5d3-56b198a8bf98 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:45.624232 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba261257-b801-4d47-a5d3-56b198a8bf98 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:45.633552 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:45.650432 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 253/496] 10.222.0.50 () {56 vars in 1103 bytes} [Mon Sep 5 12:03:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:45.650432 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba261257-b801-4d47-a5d3-56b198a8bf98 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:45.664185 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28031a21-399b-4696-aa2b-130dd1710f20 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:45.666717 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28031a21-399b-4696-aa2b-130dd1710f20 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:45.733605 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:45.812951 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba261257-b801-4d47-a5d3-56b198a8bf98 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:45.831413 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 244/497] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Sep 5 12:03:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 12:03:45.831413 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac08e42a-6653-4398-a78f-a78a34293041 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:45.831413 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac08e42a-6653-4398-a78f-a78a34293041 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:45.831413 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac08e42a-6653-4398-a78f-a78a34293041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:45.852172 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-ac08e42a-6653-4398-a78f-a78a34293041 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:03:45.854376 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-ac08e42a-6653-4398-a78f-a78a34293041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:03:45.861451 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ea92e0-4c54-489d-9238-ab23aff0eed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:45.862070 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ea92e0-4c54-489d-9238-ab23aff0eed8 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:45.862355 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ea92e0-4c54-489d-9238-ab23aff0eed8 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:45.862628 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ea92e0-4c54-489d-9238-ab23aff0eed8 None admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:45.863308 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ea92e0-4c54-489d-9238-ab23aff0eed8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:03:45.863612 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ea92e0-4c54-489d-9238-ab23aff0eed8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:45.865017 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ea92e0-4c54-489d-9238-ab23aff0eed8 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:45.875103 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 254/498] 10.222.0.50 () {56 vars in 1103 bytes} [Mon Sep 5 12:03:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:45.875887 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ea92e0-4c54-489d-9238-ab23aff0eed8 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:45.988881 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 245/499] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:03:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:03:45.990100 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac08e42a-6653-4398-a78f-a78a34293041 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:46.012591 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:46.016707 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ea92e0-4c54-489d-9238-ab23aff0eed8 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:46.041649 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:46.059163 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd23fe3-e482-448a-8fb5-1710db9beb28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:46.059828 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd23fe3-e482-448a-8fb5-1710db9beb28 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:46.060112 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd23fe3-e482-448a-8fb5-1710db9beb28 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:46.060388 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd23fe3-e482-448a-8fb5-1710db9beb28 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:46.073672 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd23fe3-e482-448a-8fb5-1710db9beb28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:46.075168 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd23fe3-e482-448a-8fb5-1710db9beb28 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:46.091139 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application [None req-bbd23fe3-e482-448a-8fb5-1710db9beb28 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:03:46.091139 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:03:46.091139 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:03:46.091139 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:03:46.091139 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:03:46.091139 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:03:46.091139 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:03:46.091139 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:03:46.091139 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:03:46.091139 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:03:46.091139 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:03:46.091139 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:03:46.091139 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:03:46.091139 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:03:46.091139 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:03:46.091139 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:03:46.092168 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:03:46.092168 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:03:46.092168 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:03:46.092168 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:03:46.092168 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:03:46.092168 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:03:46.092168 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:03:46.092168 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application with Lock( Sep 05 12:03:46.092168 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:03:46.092168 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:03:46.092168 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:03:46.092168 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:03:46.092168 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:03:46.092168 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:03:46.092168 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:03:46.092168 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:03:46.092168 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:03:46.093033 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:03:46.093033 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:03:46.093033 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:03:46.093033 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 255/500] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 5 12:03:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:03:46.093265 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd23fe3-e482-448a-8fb5-1710db9beb28 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:46.122301 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac08e42a-6653-4398-a78f-a78a34293041 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:46.161500 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1366058a-da91-4bfa-9a3e-b47702554f55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:46.162186 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1366058a-da91-4bfa-9a3e-b47702554f55 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:46.162535 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1366058a-da91-4bfa-9a3e-b47702554f55 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:46.162885 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1366058a-da91-4bfa-9a3e-b47702554f55 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:46.174752 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1366058a-da91-4bfa-9a3e-b47702554f55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:46.176357 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1366058a-da91-4bfa-9a3e-b47702554f55 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:46.195700 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-1366058a-da91-4bfa-9a3e-b47702554f55 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:03:46.195700 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:03:46.195700 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:03:46.195700 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:03:46.195700 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:03:46.195700 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:03:46.195700 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:03:46.195700 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:03:46.195700 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:03:46.195700 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:03:46.195700 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:03:46.195700 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:03:46.195700 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:03:46.195700 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:03:46.195700 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:03:46.195700 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:03:46.196790 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:03:46.196790 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:03:46.196790 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:03:46.196790 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:03:46.196790 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:03:46.196790 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:03:46.196790 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:03:46.196790 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:03:46.196790 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:03:46.196790 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:03:46.196790 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:03:46.196790 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:03:46.196790 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:03:46.196790 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:03:46.196790 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:03:46.196790 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:03:46.196790 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:03:46.197767 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:03:46.197767 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:03:46.197767 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:03:46.197767 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 246/501] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 5 12:03:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:03:46.198053 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b230109-c873-4893-ba8b-99c1fa1fb2ff None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:46.198467 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b230109-c873-4893-ba8b-99c1fa1fb2ff None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:46.198752 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b230109-c873-4893-ba8b-99c1fa1fb2ff None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:46.204123 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 247/502] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:03:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:03:46.204123 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b230109-c873-4893-ba8b-99c1fa1fb2ff None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:46.232403 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd23fe3-e482-448a-8fb5-1710db9beb28 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:46.281004 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:46.297366 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b985567b-11db-485f-b559-757f2ee7d907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:46.298368 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b985567b-11db-485f-b559-757f2ee7d907 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:46.298836 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b985567b-11db-485f-b559-757f2ee7d907 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:46.299295 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b985567b-11db-485f-b559-757f2ee7d907 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:46.318884 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b985567b-11db-485f-b559-757f2ee7d907 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:46.321550 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b985567b-11db-485f-b559-757f2ee7d907 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:46.323057 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b230109-c873-4893-ba8b-99c1fa1fb2ff None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:46.348405 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application [None req-b985567b-11db-485f-b559-757f2ee7d907 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:03:46.348405 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:03:46.348405 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:03:46.348405 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:03:46.348405 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:03:46.348405 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:03:46.348405 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:03:46.348405 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:03:46.348405 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:03:46.348405 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:03:46.348405 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:03:46.348405 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:03:46.348405 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:03:46.348405 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:03:46.348405 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:03:46.348405 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:03:46.349435 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:03:46.349435 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:03:46.349435 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:03:46.349435 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:03:46.349435 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:03:46.349435 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:03:46.349435 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:03:46.349435 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application with Lock( Sep 05 12:03:46.349435 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:03:46.349435 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:03:46.349435 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:03:46.349435 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:03:46.349435 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:03:46.349435 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:03:46.349435 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:03:46.349435 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:03:46.349435 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:03:46.350295 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:03:46.350295 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:03:46.350295 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:03:46.350459 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 256/503] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 5 12:03:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:03:46.352347 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c692fa3-d708-4d5e-be1f-211ced2d4e80 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:46.352814 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c692fa3-d708-4d5e-be1f-211ced2d4e80 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:46.353374 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c692fa3-d708-4d5e-be1f-211ced2d4e80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:46.367216 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69225a8-41cf-46ac-b89d-657143ef8e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:46.367828 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69225a8-41cf-46ac-b89d-657143ef8e47 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:46.368107 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69225a8-41cf-46ac-b89d-657143ef8e47 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:46.368378 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69225a8-41cf-46ac-b89d-657143ef8e47 None admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:46.369077 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69225a8-41cf-46ac-b89d-657143ef8e47 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:03:46.369382 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69225a8-41cf-46ac-b89d-657143ef8e47 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:46.370824 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69225a8-41cf-46ac-b89d-657143ef8e47 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:46.382490 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-0c692fa3-d708-4d5e-be1f-211ced2d4e80 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:03:46.383357 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 248/504] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 5 12:03:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:46.384190 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69225a8-41cf-46ac-b89d-657143ef8e47 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:46.384476 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-0c692fa3-d708-4d5e-be1f-211ced2d4e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:03:46.406501 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:46.461161 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 257/505] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:03:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:03:46.465851 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c692fa3-d708-4d5e-be1f-211ced2d4e80 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:46.494771 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69225a8-41cf-46ac-b89d-657143ef8e47 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:46.535488 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:46.548773 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433206e4-d10f-4795-90d8-5f6a48b7af51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:46.549612 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433206e4-d10f-4795-90d8-5f6a48b7af51 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:46.550036 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433206e4-d10f-4795-90d8-5f6a48b7af51 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:46.550576 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433206e4-d10f-4795-90d8-5f6a48b7af51 None admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:46.551717 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433206e4-d10f-4795-90d8-5f6a48b7af51 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:03:46.552362 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433206e4-d10f-4795-90d8-5f6a48b7af51 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:46.554489 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433206e4-d10f-4795-90d8-5f6a48b7af51 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:46.571534 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 249/506] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 5 12:03:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:46.572961 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433206e4-d10f-4795-90d8-5f6a48b7af51 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:46.610735 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c692fa3-d708-4d5e-be1f-211ced2d4e80 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:46.669878 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9318a5d-7fc1-46ac-acef-359259387caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:46.670916 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9318a5d-7fc1-46ac-acef-359259387caa None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:46.671368 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9318a5d-7fc1-46ac-acef-359259387caa None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:46.672214 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9318a5d-7fc1-46ac-acef-359259387caa None admin] PATH_INFO: `/v3/roles/service` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:46.690588 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9318a5d-7fc1-46ac-acef-359259387caa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:03:46.698889 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application [None req-a9318a5d-7fc1-46ac-acef-359259387caa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 05 12:03:46.698889 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:03:46.698889 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:03:46.698889 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:03:46.698889 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:03:46.698889 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:03:46.698889 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:03:46.698889 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:03:46.698889 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:03:46.698889 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:03:46.698889 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:03:46.698889 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:03:46.698889 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:03:46.698889 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:03:46.698889 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:03:46.698889 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:03:46.699985 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:03:46.699985 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:03:46.699985 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:03:46.699985 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:03:46.699985 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:03:46.699985 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:03:46.699985 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:03:46.699985 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:03:46.699985 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:03:46.699985 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:03:46.699985 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:03:46.699985 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application with Lock( Sep 05 12:03:46.699985 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:03:46.699985 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:03:46.699985 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:03:46.699985 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:03:46.705672 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:03:46.705672 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:03:46.705672 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:03:46.705672 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:03:46.705672 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:03:46.705672 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:03:46.705672 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:03:46.705672 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:03:46.705672 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:03:46.705672 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:03:46.705672 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 05 12:03:46.705672 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:03:46.705672 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 258/507] 10.222.0.50 () {56 vars in 1102 bytes} [Mon Sep 5 12:03:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:03:46.705672 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9318a5d-7fc1-46ac-acef-359259387caa None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:46.724145 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:46.742089 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433206e4-d10f-4795-90d8-5f6a48b7af51 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:46.790600 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b16529-ea31-4ca5-a80d-fd7f0a0ab65d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:46.791224 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b16529-ea31-4ca5-a80d-fd7f0a0ab65d None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:46.791511 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b16529-ea31-4ca5-a80d-fd7f0a0ab65d None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:46.791790 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b16529-ea31-4ca5-a80d-fd7f0a0ab65d None admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:46.793001 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b16529-ea31-4ca5-a80d-fd7f0a0ab65d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:03:46.793308 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b16529-ea31-4ca5-a80d-fd7f0a0ab65d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:46.794827 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b16529-ea31-4ca5-a80d-fd7f0a0ab65d None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:46.807222 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 250/508] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 5 12:03:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:46.808654 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b16529-ea31-4ca5-a80d-fd7f0a0ab65d None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:46.830371 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9318a5d-7fc1-46ac-acef-359259387caa None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:46.865060 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:46.868074 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a996216-ab3b-4f70-999f-f3480fe19389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:46.868719 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a996216-ab3b-4f70-999f-f3480fe19389 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:46.869032 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a996216-ab3b-4f70-999f-f3480fe19389 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:46.869316 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a996216-ab3b-4f70-999f-f3480fe19389 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:46.878213 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a996216-ab3b-4f70-999f-f3480fe19389 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:46.879727 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a996216-ab3b-4f70-999f-f3480fe19389 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:46.892065 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application [None req-9a996216-ab3b-4f70-999f-f3480fe19389 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 05 12:03:46.892065 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:03:46.892065 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:03:46.892065 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:03:46.892065 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:03:46.892065 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:03:46.892065 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:03:46.892065 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:03:46.892065 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:03:46.892065 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:03:46.892065 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:03:46.892065 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:03:46.892065 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 12:03:46.892065 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 12:03:46.892065 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 12:03:46.892065 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 12:03:46.893411 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:03:46.893411 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:03:46.893411 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 12:03:46.893411 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:03:46.893411 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 12:03:46.893411 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:03:46.893411 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:03:46.893411 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:03:46.893411 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:03:46.893411 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:03:46.893411 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:03:46.893411 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application with Lock( Sep 05 12:03:46.893411 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:03:46.893411 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:03:46.893411 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:03:46.893411 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:03:46.893411 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:03:46.893411 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:03:46.895152 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:03:46.895152 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:03:46.895152 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 12:03:46.895152 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 12:03:46.895152 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 12:03:46.895152 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 12:03:46.895152 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 12:03:46.895152 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 12:03:46.895152 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 05 12:03:46.895152 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:03:46.895152 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 259/509] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Sep 5 12:03:46 2022] GET /identity/v3/users/cinder => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:03:46.895152 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a996216-ab3b-4f70-999f-f3480fe19389 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:46.927577 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b16529-ea31-4ca5-a80d-fd7f0a0ab65d None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:46.965931 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add7b3d3-8940-40cb-ad42-05413dac3809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:46.966567 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add7b3d3-8940-40cb-ad42-05413dac3809 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:46.966856 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add7b3d3-8940-40cb-ad42-05413dac3809 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:46.967130 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add7b3d3-8940-40cb-ad42-05413dac3809 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:46.974571 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add7b3d3-8940-40cb-ad42-05413dac3809 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:46.975970 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add7b3d3-8940-40cb-ad42-05413dac3809 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:46.984159 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:46.990188 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-add7b3d3-8940-40cb-ad42-05413dac3809 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:03:46.990188 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:03:46.990188 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:03:46.990188 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:03:46.990188 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:03:46.990188 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:03:46.990188 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:03:46.990188 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:03:46.990188 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:03:46.990188 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:03:46.990188 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:03:46.990188 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:03:46.990188 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 12:03:46.990188 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 12:03:46.990188 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 12:03:46.991953 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 12:03:46.991953 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:03:46.991953 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:03:46.991953 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:03:46.991953 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:03:46.991953 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:03:46.991953 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:03:46.991953 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:03:46.991953 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:03:46.991953 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:03:46.991953 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:03:46.991953 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:03:46.991953 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:03:46.991953 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:03:46.991953 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:03:46.991953 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:03:46.991953 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:03:46.994016 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 12:03:46.994016 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 12:03:46.994016 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 12:03:46.994016 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 12:03:46.994016 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 12:03:46.994016 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 12:03:46.994016 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:03:46.994016 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:03:46.996793 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 251/510] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Sep 5 12:03:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:03:46.997674 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add7b3d3-8940-40cb-ad42-05413dac3809 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:47.013996 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a996216-ab3b-4f70-999f-f3480fe19389 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:47.050906 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9567dbf-2fc6-48b8-b248-b6224b8f538c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:47.051595 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9567dbf-2fc6-48b8-b248-b6224b8f538c None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:47.051793 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9567dbf-2fc6-48b8-b248-b6224b8f538c None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:47.052058 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9567dbf-2fc6-48b8-b248-b6224b8f538c None admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:47.052748 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9567dbf-2fc6-48b8-b248-b6224b8f538c None admin] RBAC: Adding query filter params (name=service) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:03:47.053073 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9567dbf-2fc6-48b8-b248-b6224b8f538c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:47.054451 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9567dbf-2fc6-48b8-b248-b6224b8f538c None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:47.063192 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 260/511] 10.222.0.50 () {56 vars in 1103 bytes} [Mon Sep 5 12:03:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:47.064028 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9567dbf-2fc6-48b8-b248-b6224b8f538c None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:47.113609 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add7b3d3-8940-40cb-ad42-05413dac3809 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:47.121652 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:47.151036 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b676bf1-5fe8-4fe2-a8ea-d0fc3480b9d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:47.152186 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b676bf1-5fe8-4fe2-a8ea-d0fc3480b9d8 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:47.152473 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b676bf1-5fe8-4fe2-a8ea-d0fc3480b9d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:47.152750 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b676bf1-5fe8-4fe2-a8ea-d0fc3480b9d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:47.170157 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b676bf1-5fe8-4fe2-a8ea-d0fc3480b9d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:47.171942 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b676bf1-5fe8-4fe2-a8ea-d0fc3480b9d8 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:47.179141 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9567dbf-2fc6-48b8-b248-b6224b8f538c None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:47.189246 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-7b676bf1-5fe8-4fe2-a8ea-d0fc3480b9d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:03:47.189246 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:03:47.189246 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:03:47.189246 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:03:47.189246 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:03:47.189246 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:03:47.189246 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:03:47.189246 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:03:47.189246 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:03:47.189246 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:03:47.189246 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:03:47.189246 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:03:47.189246 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:03:47.189246 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:03:47.189246 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:03:47.189246 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:03:47.190321 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:03:47.190321 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:03:47.190321 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:03:47.190321 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:03:47.190321 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:03:47.190321 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:03:47.190321 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:03:47.190321 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:03:47.190321 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:03:47.190321 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:03:47.190321 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:03:47.190321 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:03:47.190321 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:03:47.190321 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:03:47.190321 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:03:47.190321 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:03:47.190321 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:03:47.191512 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:03:47.191512 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:03:47.191512 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:03:47.191512 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 252/512] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 5 12:03:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:03:47.191512 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b676bf1-5fe8-4fe2-a8ea-d0fc3480b9d8 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:47.220745 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21e8803-c698-4a08-abeb-93241e19c65c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:47.221431 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21e8803-c698-4a08-abeb-93241e19c65c None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:47.221711 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21e8803-c698-4a08-abeb-93241e19c65c None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:47.221986 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21e8803-c698-4a08-abeb-93241e19c65c None admin] PATH_INFO: `/v3/users/nova` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:47.225242 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:47.231858 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21e8803-c698-4a08-abeb-93241e19c65c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:47.233572 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21e8803-c698-4a08-abeb-93241e19c65c None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:47.246909 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application [None req-a21e8803-c698-4a08-abeb-93241e19c65c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 05 12:03:47.246909 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:03:47.246909 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:03:47.246909 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:03:47.246909 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:03:47.246909 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:03:47.246909 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:03:47.246909 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:03:47.246909 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:03:47.246909 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:03:47.246909 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:03:47.246909 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:03:47.246909 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 12:03:47.246909 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 12:03:47.246909 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 12:03:47.246909 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 12:03:47.247963 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:03:47.247963 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:03:47.247963 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 12:03:47.247963 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:03:47.247963 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 12:03:47.247963 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:03:47.247963 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:03:47.247963 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:03:47.247963 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:03:47.247963 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:03:47.247963 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:03:47.247963 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application with Lock( Sep 05 12:03:47.247963 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:03:47.247963 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:03:47.247963 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:03:47.247963 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:03:47.247963 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:03:47.247963 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:03:47.248964 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:03:47.248964 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:03:47.248964 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 12:03:47.248964 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 12:03:47.248964 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 12:03:47.248964 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 12:03:47.248964 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 12:03:47.248964 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 12:03:47.248964 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 05 12:03:47.248964 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:03:47.248964 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 261/513] 10.222.0.50 () {56 vars in 1093 bytes} [Mon Sep 5 12:03:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:03:47.248964 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21e8803-c698-4a08-abeb-93241e19c65c None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:47.321245 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b676bf1-5fe8-4fe2-a8ea-d0fc3480b9d8 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:47.359044 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d3db31-f706-4374-bcc0-ac6f71705cac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:47.359663 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d3db31-f706-4374-bcc0-ac6f71705cac None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:47.359947 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d3db31-f706-4374-bcc0-ac6f71705cac None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:47.360219 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d3db31-f706-4374-bcc0-ac6f71705cac None admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:47.360988 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d3db31-f706-4374-bcc0-ac6f71705cac None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:03:47.361302 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d3db31-f706-4374-bcc0-ac6f71705cac None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:47.362764 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d3db31-f706-4374-bcc0-ac6f71705cac None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:47.396031 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21e8803-c698-4a08-abeb-93241e19c65c None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:47.416760 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 253/514] 10.222.0.50 () {56 vars in 1137 bytes} [Mon Sep 5 12:03:47 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:47.416760 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d3db31-f706-4374-bcc0-ac6f71705cac None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:47.433593 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9799d749-98a9-45b5-8791-582c1e59c346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:47.434210 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9799d749-98a9-45b5-8791-582c1e59c346 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:47.434492 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9799d749-98a9-45b5-8791-582c1e59c346 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:47.434768 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9799d749-98a9-45b5-8791-582c1e59c346 None admin] PATH_INFO: `/v3/projects` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:47.435490 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9799d749-98a9-45b5-8791-582c1e59c346 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:03:47.435801 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9799d749-98a9-45b5-8791-582c1e59c346 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:47.437333 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9799d749-98a9-45b5-8791-582c1e59c346 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:47.444409 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:47.457459 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 262/515] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Sep 5 12:03:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:47.458342 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9799d749-98a9-45b5-8791-582c1e59c346 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:47.532584 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:47.545090 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d3db31-f706-4374-bcc0-ac6f71705cac None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:47.582472 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb80993d-71dc-4135-87b9-e78acb4a78e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:47.583112 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb80993d-71dc-4135-87b9-e78acb4a78e5 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:47.583386 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb80993d-71dc-4135-87b9-e78acb4a78e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:47.583672 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb80993d-71dc-4135-87b9-e78acb4a78e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:47.595917 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb80993d-71dc-4135-87b9-e78acb4a78e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:47.597485 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb80993d-71dc-4135-87b9-e78acb4a78e5 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:47.601106 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9799d749-98a9-45b5-8791-582c1e59c346 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:47.613428 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-cb80993d-71dc-4135-87b9-e78acb4a78e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:03:47.613428 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:03:47.613428 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:03:47.613428 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:03:47.613428 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:03:47.613428 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:03:47.613428 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:03:47.613428 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:03:47.613428 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:03:47.613428 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:03:47.613428 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:03:47.613428 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:03:47.613428 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:03:47.613428 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:03:47.613428 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:03:47.613428 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:03:47.615390 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:03:47.615390 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:03:47.615390 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:03:47.615390 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:03:47.615390 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:03:47.615390 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:03:47.615390 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:03:47.615390 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:03:47.615390 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:03:47.615390 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:03:47.615390 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:03:47.615390 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:03:47.615390 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:03:47.615390 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:03:47.615390 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:03:47.615390 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:03:47.615390 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:03:47.617099 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:03:47.617099 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:03:47.617099 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:03:47.617099 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 254/516] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 5 12:03:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:03:47.617099 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb80993d-71dc-4135-87b9-e78acb4a78e5 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:47.644048 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a798ddd-8a85-47d7-8752-c0940a804dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:47.644968 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a798ddd-8a85-47d7-8752-c0940a804dd4 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:47.645376 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a798ddd-8a85-47d7-8752-c0940a804dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:47.645802 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a798ddd-8a85-47d7-8752-c0940a804dd4 None admin] PATH_INFO: `/v3/domains` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:47.646568 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a798ddd-8a85-47d7-8752-c0940a804dd4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:03:47.646943 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a798ddd-8a85-47d7-8752-c0940a804dd4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:47.648750 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a798ddd-8a85-47d7-8752-c0940a804dd4 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:47.664449 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 263/517] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 5 12:03:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:47.665113 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a798ddd-8a85-47d7-8752-c0940a804dd4 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:47.696100 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:47.733771 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb80993d-71dc-4135-87b9-e78acb4a78e5 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:47.771594 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c336789c-cd6f-4d9d-9197-05641d518cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:47.772240 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c336789c-cd6f-4d9d-9197-05641d518cad None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:47.772518 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c336789c-cd6f-4d9d-9197-05641d518cad None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:47.772794 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c336789c-cd6f-4d9d-9197-05641d518cad None admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:47.773811 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c336789c-cd6f-4d9d-9197-05641d518cad None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:03:47.774117 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c336789c-cd6f-4d9d-9197-05641d518cad None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:47.775602 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c336789c-cd6f-4d9d-9197-05641d518cad None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:47.776039 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a798ddd-8a85-47d7-8752-c0940a804dd4 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:47.795601 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:47.796182 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 255/518] 10.222.0.50 () {56 vars in 1133 bytes} [Mon Sep 5 12:03:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:47.797084 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c336789c-cd6f-4d9d-9197-05641d518cad None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:47.821691 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9915f079-a941-48d4-83e6-c7047b2e7e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:47.822403 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9915f079-a941-48d4-83e6-c7047b2e7e55 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:47.822798 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9915f079-a941-48d4-83e6-c7047b2e7e55 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:47.823133 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9915f079-a941-48d4-83e6-c7047b2e7e55 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:47.903167 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9915f079-a941-48d4-83e6-c7047b2e7e55 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:47.904660 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9915f079-a941-48d4-83e6-c7047b2e7e55 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:47.909597 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c336789c-cd6f-4d9d-9197-05641d518cad None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:47.940337 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:47.951556 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e59fdc-cd37-4f66-a6e1-63d4a5c03965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:47.952511 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e59fdc-cd37-4f66-a6e1-63d4a5c03965 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:47.952912 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e59fdc-cd37-4f66-a6e1-63d4a5c03965 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:47.953299 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e59fdc-cd37-4f66-a6e1-63d4a5c03965 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:47.954147 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e59fdc-cd37-4f66-a6e1-63d4a5c03965 None admin] RBAC: Adding query filter params (role.id=fe10209913504171981606bfdf25a9bb, scope.project.id=ae4f8939fcc040bca99783a77e6ede4d, user.id=b2b08e831af84a658b0f5b28ad03e4f7) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:03:47.954549 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e59fdc-cd37-4f66-a6e1-63d4a5c03965 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:47.956242 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e59fdc-cd37-4f66-a6e1-63d4a5c03965 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:47.962141 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 256/519] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Sep 5 12:03:47 2022] GET /identity/v3/role_assignments?user.id=b2b08e831af84a658b0f5b28ad03e4f7&scope.project.id=ae4f8939fcc040bca99783a77e6ede4d&role.id=fe10209913504171981606bfdf25a9bb => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:47.962984 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e59fdc-cd37-4f66-a6e1-63d4a5c03965 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:48.021579 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 264/520] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Sep 5 12:03:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 12:03:48.022318 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9915f079-a941-48d4-83e6-c7047b2e7e55 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:48.047974 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:48.104682 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e59fdc-cd37-4f66-a6e1-63d4a5c03965 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:48.146295 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d8ac64-f0fb-4f25-b693-0cdeb6211c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:48.146925 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d8ac64-f0fb-4f25-b693-0cdeb6211c06 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:48.147208 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d8ac64-f0fb-4f25-b693-0cdeb6211c06 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:48.147479 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d8ac64-f0fb-4f25-b693-0cdeb6211c06 None admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:48.148506 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d8ac64-f0fb-4f25-b693-0cdeb6211c06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:03:48.148808 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d8ac64-f0fb-4f25-b693-0cdeb6211c06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:48.150246 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d8ac64-f0fb-4f25-b693-0cdeb6211c06 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:48.165199 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 257/521] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 5 12:03:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:48.165825 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d8ac64-f0fb-4f25-b693-0cdeb6211c06 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:48.178706 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9915f079-a941-48d4-83e6-c7047b2e7e55 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:48.232242 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07188ca0-658c-4d49-83e4-55def03c0e32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:48.233268 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07188ca0-658c-4d49-83e4-55def03c0e32 None admin] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:48.233721 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07188ca0-658c-4d49-83e4-55def03c0e32 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:48.234169 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07188ca0-658c-4d49-83e4-55def03c0e32 None admin] PATH_INFO: `/v3/users` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:48.235304 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07188ca0-658c-4d49-83e4-55def03c0e32 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:48.237860 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07188ca0-658c-4d49-83e4-55def03c0e32 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:48.252322 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:48.280931 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 265/522] 10.222.0.50 () {60 vars in 1132 bytes} [Mon Sep 5 12:03:48 2022] POST /identity/v3/users => generated 247 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:03:48.280931 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07188ca0-658c-4d49-83e4-55def03c0e32 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:48.359827 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d8ac64-f0fb-4f25-b693-0cdeb6211c06 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:48.408937 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649302c9-fa59-4d17-8eed-a318b9c8d59e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:48.410298 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649302c9-fa59-4d17-8eed-a318b9c8d59e None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:48.410298 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649302c9-fa59-4d17-8eed-a318b9c8d59e None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:48.410298 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649302c9-fa59-4d17-8eed-a318b9c8d59e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:48.441527 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:48.485944 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07188ca0-658c-4d49-83e4-55def03c0e32 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:48.531582 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381b67ab-d2e0-499e-95b6-6abfc026521e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:48.532242 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381b67ab-d2e0-499e-95b6-6abfc026521e None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:48.532822 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381b67ab-d2e0-499e-95b6-6abfc026521e None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:48.533137 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381b67ab-d2e0-499e-95b6-6abfc026521e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:48.534024 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649302c9-fa59-4d17-8eed-a318b9c8d59e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:48.537105 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649302c9-fa59-4d17-8eed-a318b9c8d59e None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:48.547180 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381b67ab-d2e0-499e-95b6-6abfc026521e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:48.550385 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381b67ab-d2e0-499e-95b6-6abfc026521e None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:48.570961 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application [None req-381b67ab-d2e0-499e-95b6-6abfc026521e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:03:48.570961 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:03:48.570961 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:03:48.570961 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:03:48.570961 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:03:48.570961 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:03:48.570961 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:03:48.570961 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:03:48.570961 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:03:48.570961 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:03:48.570961 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:03:48.570961 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:03:48.570961 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:03:48.570961 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:03:48.570961 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:03:48.570961 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:03:48.572723 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:03:48.572723 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:03:48.572723 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:03:48.572723 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:03:48.572723 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:03:48.572723 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:03:48.572723 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:03:48.572723 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application with Lock( Sep 05 12:03:48.572723 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:03:48.572723 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:03:48.572723 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:03:48.572723 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:03:48.572723 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:03:48.572723 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:03:48.572723 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:03:48.572723 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:03:48.572723 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:03:48.574464 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:03:48.574464 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:03:48.574464 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:03:48.574464 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 266/523] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 5 12:03:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:03:48.574464 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381b67ab-d2e0-499e-95b6-6abfc026521e None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:48.623204 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:48.688428 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 258/524] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Sep 5 12:03:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 518 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 12:03:48.688428 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649302c9-fa59-4d17-8eed-a318b9c8d59e None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:48.752012 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381b67ab-d2e0-499e-95b6-6abfc026521e None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:48.789649 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:48.800614 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649302c9-fa59-4d17-8eed-a318b9c8d59e None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:48.804767 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d3ce13-876a-40fe-b234-fc6f5efa8d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:48.805686 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d3ce13-876a-40fe-b234-fc6f5efa8d5f None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:48.806170 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d3ce13-876a-40fe-b234-fc6f5efa8d5f None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:48.806662 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d3ce13-876a-40fe-b234-fc6f5efa8d5f None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:48.815851 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d3ce13-876a-40fe-b234-fc6f5efa8d5f None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:48.817656 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d3ce13-876a-40fe-b234-fc6f5efa8d5f None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:48.831069 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application [None req-b6d3ce13-876a-40fe-b234-fc6f5efa8d5f None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 05 12:03:48.831069 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:03:48.831069 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:03:48.831069 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:03:48.831069 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:03:48.831069 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:03:48.831069 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:03:48.831069 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:03:48.831069 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:03:48.831069 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:03:48.831069 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:03:48.831069 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:03:48.831069 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 12:03:48.831069 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 12:03:48.831069 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 12:03:48.831069 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 12:03:48.832089 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:03:48.832089 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:03:48.832089 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 12:03:48.832089 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:03:48.832089 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 12:03:48.832089 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:03:48.832089 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:03:48.832089 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:03:48.832089 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:03:48.832089 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:03:48.832089 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:03:48.832089 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application with Lock( Sep 05 12:03:48.832089 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:03:48.832089 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:03:48.832089 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:03:48.832089 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:03:48.832089 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:03:48.832089 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:03:48.833119 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:03:48.833119 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:03:48.833119 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 12:03:48.833119 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 12:03:48.833119 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 12:03:48.833119 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 12:03:48.833119 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 12:03:48.833119 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 12:03:48.833119 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 05 12:03:48.833119 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:03:48.835737 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 267/525] 10.222.0.50 () {56 vars in 1102 bytes} [Mon Sep 5 12:03:48 2022] GET /identity/v3/users/neutron => generated 85 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:03:48.836657 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf04131c-0ae0-4fa5-8fff-81baa5a05bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:48.837077 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d3ce13-876a-40fe-b234-fc6f5efa8d5f None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:48.837465 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf04131c-0ae0-4fa5-8fff-81baa5a05bf2 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:48.837752 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf04131c-0ae0-4fa5-8fff-81baa5a05bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:48.838026 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf04131c-0ae0-4fa5-8fff-81baa5a05bf2 None admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:48.838689 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf04131c-0ae0-4fa5-8fff-81baa5a05bf2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:03:48.839513 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf04131c-0ae0-4fa5-8fff-81baa5a05bf2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:48.841082 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf04131c-0ae0-4fa5-8fff-81baa5a05bf2 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:48.854466 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 259/526] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 5 12:03:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:48.855889 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf04131c-0ae0-4fa5-8fff-81baa5a05bf2 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:48.869225 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:48.957667 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d3ce13-876a-40fe-b234-fc6f5efa8d5f None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:48.969590 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf04131c-0ae0-4fa5-8fff-81baa5a05bf2 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:48.998203 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e898f7d-2754-4a77-a969-cd453c803dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:48.999337 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e898f7d-2754-4a77-a969-cd453c803dc6 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:48.999826 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e898f7d-2754-4a77-a969-cd453c803dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:49.000452 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e898f7d-2754-4a77-a969-cd453c803dc6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:49.006747 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d00c831-4aa6-496f-b3d5-f2dcfe239ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:49.007369 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d00c831-4aa6-496f-b3d5-f2dcfe239ace None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:49.007652 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d00c831-4aa6-496f-b3d5-f2dcfe239ace None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:49.007931 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d00c831-4aa6-496f-b3d5-f2dcfe239ace None admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:49.008671 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d00c831-4aa6-496f-b3d5-f2dcfe239ace None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:03:49.009017 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d00c831-4aa6-496f-b3d5-f2dcfe239ace None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:49.011614 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d00c831-4aa6-496f-b3d5-f2dcfe239ace None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:49.015542 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e898f7d-2754-4a77-a969-cd453c803dc6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:49.017406 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e898f7d-2754-4a77-a969-cd453c803dc6 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:49.035109 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 260/527] 10.222.0.50 () {56 vars in 1139 bytes} [Mon Sep 5 12:03:48 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:49.036047 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d00c831-4aa6-496f-b3d5-f2dcfe239ace None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:49.036671 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application [None req-3e898f7d-2754-4a77-a969-cd453c803dc6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:03:49.036671 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:03:49.036671 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:03:49.036671 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:03:49.036671 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:03:49.036671 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:03:49.036671 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:03:49.036671 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:03:49.036671 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:03:49.036671 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:03:49.036671 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:03:49.036671 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:03:49.036671 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:03:49.036671 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:03:49.036671 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:03:49.036671 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:03:49.037691 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:03:49.037691 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:03:49.037691 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:03:49.037691 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:03:49.037691 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:03:49.037691 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:03:49.037691 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:03:49.037691 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application with Lock( Sep 05 12:03:49.037691 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:03:49.037691 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:03:49.037691 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:03:49.037691 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:03:49.037691 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:03:49.037691 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:03:49.037691 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:03:49.037691 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:03:49.037691 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:03:49.038546 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:03:49.038546 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:03:49.038546 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:03:49.045108 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 268/528] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 5 12:03:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:03:49.046629 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e898f7d-2754-4a77-a969-cd453c803dc6 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:49.099375 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:49.117777 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:49.159351 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d00c831-4aa6-496f-b3d5-f2dcfe239ace None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:49.199296 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c40b38-d7d1-4ab7-9ee9-f9e01e5dcef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:49.199968 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c40b38-d7d1-4ab7-9ee9-f9e01e5dcef5 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:49.200254 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c40b38-d7d1-4ab7-9ee9-f9e01e5dcef5 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:49.200523 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c40b38-d7d1-4ab7-9ee9-f9e01e5dcef5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:49.201322 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e898f7d-2754-4a77-a969-cd453c803dc6 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:49.209585 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c40b38-d7d1-4ab7-9ee9-f9e01e5dcef5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:49.212158 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c40b38-d7d1-4ab7-9ee9-f9e01e5dcef5 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:49.233985 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-a4c40b38-d7d1-4ab7-9ee9-f9e01e5dcef5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:03:49.233985 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:03:49.233985 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:03:49.233985 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:03:49.233985 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:03:49.233985 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:03:49.233985 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:03:49.233985 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:03:49.233985 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:03:49.233985 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:03:49.233985 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:03:49.233985 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:03:49.233985 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 12:03:49.233985 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 12:03:49.233985 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 12:03:49.234928 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 12:03:49.234928 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:03:49.234928 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:03:49.234928 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:03:49.234928 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:03:49.234928 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:03:49.234928 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:03:49.234928 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:03:49.234928 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:03:49.234928 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:03:49.234928 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:03:49.234928 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:03:49.234928 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:03:49.234928 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:03:49.234928 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:03:49.234928 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:03:49.234928 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:03:49.235792 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 12:03:49.235792 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 12:03:49.235792 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 12:03:49.235792 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 12:03:49.235792 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 12:03:49.235792 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 12:03:49.235792 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:03:49.235792 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:03:49.241443 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 261/529] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Sep 5 12:03:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:03:49.243720 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c40b38-d7d1-4ab7-9ee9-f9e01e5dcef5 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:49.246786 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbedb659-8faf-40df-afa8-81f149a6b95b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:49.247431 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbedb659-8faf-40df-afa8-81f149a6b95b None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:49.247713 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbedb659-8faf-40df-afa8-81f149a6b95b None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:49.247986 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbedb659-8faf-40df-afa8-81f149a6b95b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:49.347715 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbedb659-8faf-40df-afa8-81f149a6b95b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:49.349229 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbedb659-8faf-40df-afa8-81f149a6b95b None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:49.387630 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:49.402019 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c40b38-d7d1-4ab7-9ee9-f9e01e5dcef5 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:49.435455 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:49.450352 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dde8d9b-2c6f-40fe-9195-be98c89708e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:49.451579 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dde8d9b-2c6f-40fe-9195-be98c89708e9 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:49.452120 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dde8d9b-2c6f-40fe-9195-be98c89708e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:49.452785 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dde8d9b-2c6f-40fe-9195-be98c89708e9 None admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:49.453650 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dde8d9b-2c6f-40fe-9195-be98c89708e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:03:49.454049 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dde8d9b-2c6f-40fe-9195-be98c89708e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:49.456509 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dde8d9b-2c6f-40fe-9195-be98c89708e9 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:49.475854 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 262/530] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 5 12:03:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:49.476869 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dde8d9b-2c6f-40fe-9195-be98c89708e9 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:49.479408 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 269/531] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Sep 5 12:03:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 12:03:49.481391 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbedb659-8faf-40df-afa8-81f149a6b95b None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:49.603797 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dde8d9b-2c6f-40fe-9195-be98c89708e9 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:49.621865 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbedb659-8faf-40df-afa8-81f149a6b95b None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:49.643611 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295fe704-7123-48e6-861d-d270000fce81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:49.644571 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295fe704-7123-48e6-861d-d270000fce81 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:49.645060 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295fe704-7123-48e6-861d-d270000fce81 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:49.645556 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295fe704-7123-48e6-861d-d270000fce81 None admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:49.646410 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295fe704-7123-48e6-861d-d270000fce81 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:03:49.646937 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295fe704-7123-48e6-861d-d270000fce81 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:49.648987 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295fe704-7123-48e6-861d-d270000fce81 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:49.668560 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c212a0-0f51-4061-891f-b157c181791d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:49.669373 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c212a0-0f51-4061-891f-b157c181791d None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:49.669746 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c212a0-0f51-4061-891f-b157c181791d None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:49.670108 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c212a0-0f51-4061-891f-b157c181791d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:49.673486 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:49.676501 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 263/532] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Sep 5 12:03:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:49.677698 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295fe704-7123-48e6-861d-d270000fce81 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:49.679833 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c212a0-0f51-4061-891f-b157c181791d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:49.683457 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c212a0-0f51-4061-891f-b157c181791d None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:49.701355 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application [None req-a6c212a0-0f51-4061-891f-b157c181791d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:03:49.701355 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:03:49.701355 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:03:49.701355 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:03:49.701355 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:03:49.701355 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:03:49.701355 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:03:49.701355 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:03:49.701355 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:03:49.701355 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:03:49.701355 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:03:49.701355 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:03:49.701355 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 12:03:49.701355 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 12:03:49.701355 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 12:03:49.702254 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 12:03:49.702254 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:03:49.702254 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:03:49.702254 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:03:49.702254 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:03:49.702254 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:03:49.702254 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:03:49.702254 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:03:49.702254 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application with Lock( Sep 05 12:03:49.702254 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:03:49.702254 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:03:49.702254 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:03:49.702254 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:03:49.702254 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:03:49.702254 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:03:49.702254 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:03:49.702254 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:03:49.703083 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 12:03:49.703083 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 12:03:49.703083 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 12:03:49.703083 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 12:03:49.703083 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 12:03:49.703083 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 12:03:49.703083 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:03:49.703083 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:03:49.705561 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 270/533] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Sep 5 12:03:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:03:49.706526 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c212a0-0f51-4061-891f-b157c181791d None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:49.738954 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:49.807619 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295fe704-7123-48e6-861d-d270000fce81 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:49.845936 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d587ae0d-5892-47ed-a5b9-5c0e287b208b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:49.846730 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d587ae0d-5892-47ed-a5b9-5c0e287b208b None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:49.847208 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d587ae0d-5892-47ed-a5b9-5c0e287b208b None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:49.847605 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d587ae0d-5892-47ed-a5b9-5c0e287b208b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:49.848565 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c212a0-0f51-4061-891f-b157c181791d None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:49.861671 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d587ae0d-5892-47ed-a5b9-5c0e287b208b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:49.863591 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d587ae0d-5892-47ed-a5b9-5c0e287b208b None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:49.879669 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-d587ae0d-5892-47ed-a5b9-5c0e287b208b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:03:49.879669 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:03:49.879669 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:03:49.879669 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:03:49.879669 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:03:49.879669 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:03:49.879669 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:03:49.879669 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:03:49.879669 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:03:49.879669 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:03:49.879669 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:03:49.879669 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:03:49.879669 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:03:49.879669 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:03:49.879669 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:03:49.879669 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:03:49.880813 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:03:49.880813 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:03:49.880813 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:03:49.880813 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:03:49.880813 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:03:49.880813 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:03:49.880813 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:03:49.880813 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:03:49.880813 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:03:49.880813 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:03:49.880813 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:03:49.880813 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:03:49.880813 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:03:49.880813 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:03:49.880813 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:03:49.880813 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:03:49.880813 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:03:49.881865 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:03:49.881865 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:03:49.881865 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:03:49.888097 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 264/534] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 5 12:03:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:03:49.889168 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d587ae0d-5892-47ed-a5b9-5c0e287b208b None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:49.895703 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c72554-2cbb-4f43-8f57-18bd4590c679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:49.896559 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c72554-2cbb-4f43-8f57-18bd4590c679 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:49.897019 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c72554-2cbb-4f43-8f57-18bd4590c679 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:49.897433 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c72554-2cbb-4f43-8f57-18bd4590c679 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:49.898563 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c72554-2cbb-4f43-8f57-18bd4590c679 None admin] RBAC: Adding query filter params (role.id=fe10209913504171981606bfdf25a9bb, scope.project.id=ae4f8939fcc040bca99783a77e6ede4d, user.id=37633bbae0c2423c81ccd61ac3a17ccf) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:03:49.899027 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c72554-2cbb-4f43-8f57-18bd4590c679 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:49.901148 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c72554-2cbb-4f43-8f57-18bd4590c679 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:49.908327 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 271/535] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Sep 5 12:03:49 2022] GET /identity/v3/role_assignments?user.id=37633bbae0c2423c81ccd61ac3a17ccf&scope.project.id=ae4f8939fcc040bca99783a77e6ede4d&role.id=fe10209913504171981606bfdf25a9bb => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:49.914187 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c72554-2cbb-4f43-8f57-18bd4590c679 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:50.024041 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:50.030297 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d587ae0d-5892-47ed-a5b9-5c0e287b208b None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:50.048708 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:50.080751 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e4901d-a154-47ee-8288-726aac47c674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:50.081847 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e4901d-a154-47ee-8288-726aac47c674 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:50.082339 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e4901d-a154-47ee-8288-726aac47c674 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:50.082816 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e4901d-a154-47ee-8288-726aac47c674 None admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:50.084568 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e4901d-a154-47ee-8288-726aac47c674 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:03:50.085217 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e4901d-a154-47ee-8288-726aac47c674 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:50.086970 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e4901d-a154-47ee-8288-726aac47c674 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:50.105157 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 265/536] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Sep 5 12:03:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:50.106819 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbe3e36-a930-4a6c-823c-c48725ec8ecd None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:50.107311 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbe3e36-a930-4a6c-823c-c48725ec8ecd None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:50.107879 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbe3e36-a930-4a6c-823c-c48725ec8ecd None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:50.109972 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 266/537] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:03:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:03:50.115494 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbe3e36-a930-4a6c-823c-c48725ec8ecd None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:50.146635 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c72554-2cbb-4f43-8f57-18bd4590c679 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:50.190919 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d44e9f-63f3-4105-b4cd-38955a74999b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:50.191811 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d44e9f-63f3-4105-b4cd-38955a74999b None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:50.192256 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d44e9f-63f3-4105-b4cd-38955a74999b None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:50.192672 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d44e9f-63f3-4105-b4cd-38955a74999b None admin] PATH_INFO: `/v3/domains` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:50.193556 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d44e9f-63f3-4105-b4cd-38955a74999b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:03:50.193997 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d44e9f-63f3-4105-b4cd-38955a74999b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:50.195607 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d44e9f-63f3-4105-b4cd-38955a74999b None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:50.209621 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 272/538] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 5 12:03:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:50.212100 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efb9791-f294-4d35-adef-cdb0d5f5ea99 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:50.212541 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efb9791-f294-4d35-adef-cdb0d5f5ea99 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:50.213027 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efb9791-f294-4d35-adef-cdb0d5f5ea99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:50.234847 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-7efb9791-f294-4d35-adef-cdb0d5f5ea99 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:03:50.236569 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-7efb9791-f294-4d35-adef-cdb0d5f5ea99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:03:50.302264 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbe3e36-a930-4a6c-823c-c48725ec8ecd None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:50.321529 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 273/539] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:03:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:03:50.322670 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efb9791-f294-4d35-adef-cdb0d5f5ea99 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:50.387065 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:50.394066 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c842dce2-6526-4175-a1bf-1df57ef50495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:50.395222 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c842dce2-6526-4175-a1bf-1df57ef50495 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:50.395927 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c842dce2-6526-4175-a1bf-1df57ef50495 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:50.396553 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c842dce2-6526-4175-a1bf-1df57ef50495 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:50.398491 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c842dce2-6526-4175-a1bf-1df57ef50495 None admin] RBAC: Adding query filter params (role.id=fe10209913504171981606bfdf25a9bb, scope.project.id=ae4f8939fcc040bca99783a77e6ede4d, user.id=cb060ff495bc4abb83ff88992fb7be09) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:03:50.399135 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c842dce2-6526-4175-a1bf-1df57ef50495 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:50.402461 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c842dce2-6526-4175-a1bf-1df57ef50495 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:50.419439 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 267/540] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Sep 5 12:03:50 2022] GET /identity/v3/role_assignments?user.id=cb060ff495bc4abb83ff88992fb7be09&scope.project.id=ae4f8939fcc040bca99783a77e6ede4d&role.id=fe10209913504171981606bfdf25a9bb => generated 259 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:50.421854 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b5dfa3-6ba3-4527-9645-058b17668eae None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:50.422507 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b5dfa3-6ba3-4527-9645-058b17668eae None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:50.423086 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b5dfa3-6ba3-4527-9645-058b17668eae None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:50.425860 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 268/541] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:03:50 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:03:50.434018 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f9c1b8-943b-4120-be6c-c7c0f5a8ccd2 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:50.434610 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f9c1b8-943b-4120-be6c-c7c0f5a8ccd2 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:50.435408 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f9c1b8-943b-4120-be6c-c7c0f5a8ccd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:50.448191 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efb9791-f294-4d35-adef-cdb0d5f5ea99 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:50.488129 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c883792c-0423-4170-bfae-e4b3a1570391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:50.489099 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c883792c-0423-4170-bfae-e4b3a1570391 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:50.489539 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c883792c-0423-4170-bfae-e4b3a1570391 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:50.490003 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c883792c-0423-4170-bfae-e4b3a1570391 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:50.491680 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-26f9c1b8-943b-4120-be6c-c7c0f5a8ccd2 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:03:50.493703 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-26f9c1b8-943b-4120-be6c-c7c0f5a8ccd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:03:50.499517 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c883792c-0423-4170-bfae-e4b3a1570391 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:50.501486 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c883792c-0423-4170-bfae-e4b3a1570391 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:50.515668 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application [None req-c883792c-0423-4170-bfae-e4b3a1570391 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:03:50.515668 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:03:50.515668 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:03:50.515668 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:03:50.515668 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:03:50.515668 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:03:50.515668 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:03:50.515668 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:03:50.515668 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:03:50.515668 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:03:50.515668 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:03:50.515668 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:03:50.515668 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 12:03:50.515668 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 12:03:50.515668 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 12:03:50.516574 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 12:03:50.516574 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:03:50.516574 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:03:50.516574 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:03:50.516574 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:03:50.516574 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:03:50.516574 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:03:50.516574 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:03:50.516574 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application with Lock( Sep 05 12:03:50.516574 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:03:50.516574 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:03:50.516574 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:03:50.516574 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:03:50.516574 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:03:50.516574 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:03:50.516574 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:03:50.516574 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:03:50.517452 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 12:03:50.517452 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 12:03:50.517452 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 12:03:50.517452 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 12:03:50.517452 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 12:03:50.517452 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 12:03:50.517452 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:03:50.517452 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:03:50.519989 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 274/542] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Sep 5 12:03:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:03:50.526704 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c883792c-0423-4170-bfae-e4b3a1570391 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:50.547836 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:50.657398 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 269/543] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:03:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:03:50.658707 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f9c1b8-943b-4120-be6c-c7c0f5a8ccd2 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:50.751415 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c883792c-0423-4170-bfae-e4b3a1570391 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:50.771833 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:50.792596 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f9c1b8-943b-4120-be6c-c7c0f5a8ccd2 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:50.839952 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3930eec3-9a08-4b89-af05-3b217bdf5985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:50.840946 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3930eec3-9a08-4b89-af05-3b217bdf5985 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:50.841556 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3930eec3-9a08-4b89-af05-3b217bdf5985 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:50.842108 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3930eec3-9a08-4b89-af05-3b217bdf5985 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:50.856521 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3930eec3-9a08-4b89-af05-3b217bdf5985 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:03:50.862012 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-3930eec3-9a08-4b89-af05-3b217bdf5985 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 05 12:03:50.862012 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:03:50.862012 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:03:50.862012 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:03:50.862012 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:03:50.862012 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:03:50.862012 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:03:50.862012 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:03:50.862012 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:03:50.862012 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:03:50.862012 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:03:50.862012 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:03:50.862012 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:03:50.862012 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:03:50.862012 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:03:50.862012 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:03:50.863025 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:03:50.863025 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:03:50.863025 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:03:50.863025 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:03:50.863025 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:03:50.863025 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:03:50.863025 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:03:50.863025 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:03:50.863025 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:03:50.863025 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:03:50.863025 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:03:50.863025 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:03:50.863025 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:03:50.863025 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:03:50.863025 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:03:50.863025 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:03:50.863872 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:03:50.863872 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:03:50.863872 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:03:50.863872 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:03:50.863872 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:03:50.863872 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:03:50.863872 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:03:50.863872 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:03:50.863872 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:03:50.863872 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:03:50.863872 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 05 12:03:50.863872 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:03:50.866635 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2c9cab-1990-4258-9086-53593fe84b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:50.870762 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2c9cab-1990-4258-9086-53593fe84b3b None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:50.870762 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2c9cab-1990-4258-9086-53593fe84b3b None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:50.870762 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2c9cab-1990-4258-9086-53593fe84b3b None admin] PATH_INFO: `/v3/projects` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:50.870762 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2c9cab-1990-4258-9086-53593fe84b3b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:03:50.870762 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2c9cab-1990-4258-9086-53593fe84b3b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:50.871414 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 270/544] 10.222.0.50 () {56 vars in 1102 bytes} [Mon Sep 5 12:03:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:03:50.871513 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2c9cab-1990-4258-9086-53593fe84b3b None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:50.878898 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3930eec3-9a08-4b89-af05-3b217bdf5985 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:50.904965 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 275/545] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Sep 5 12:03:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 379 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:50.912600 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2c9cab-1990-4258-9086-53593fe84b3b None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:50.925673 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:51.107876 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2c9cab-1990-4258-9086-53593fe84b3b None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:51.119998 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3930eec3-9a08-4b89-af05-3b217bdf5985 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:51.157031 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1002381-bfd0-4df0-a73e-6fedf1ac50e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:51.157696 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1002381-bfd0-4df0-a73e-6fedf1ac50e1 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:51.158050 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1002381-bfd0-4df0-a73e-6fedf1ac50e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:51.158391 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1002381-bfd0-4df0-a73e-6fedf1ac50e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:51.159286 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1002381-bfd0-4df0-a73e-6fedf1ac50e1 None admin] RBAC: Adding query filter params (role.id=fe10209913504171981606bfdf25a9bb, scope.project.id=ae4f8939fcc040bca99783a77e6ede4d, user.id=4994b4faa4ec4aa088f3dc32c9c5614d) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:03:51.159663 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1002381-bfd0-4df0-a73e-6fedf1ac50e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:51.161368 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1002381-bfd0-4df0-a73e-6fedf1ac50e1 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:51.167674 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb562ae-0fde-453f-bafb-696873c9fc31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:51.168571 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb562ae-0fde-453f-bafb-696873c9fc31 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:51.169072 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb562ae-0fde-453f-bafb-696873c9fc31 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:51.169338 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 276/546] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Sep 5 12:03:50 2022] GET /identity/v3/role_assignments?user.id=4994b4faa4ec4aa088f3dc32c9c5614d&scope.project.id=ae4f8939fcc040bca99783a77e6ede4d&role.id=fe10209913504171981606bfdf25a9bb => generated 259 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:51.169805 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb562ae-0fde-453f-bafb-696873c9fc31 None admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:51.170389 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1002381-bfd0-4df0-a73e-6fedf1ac50e1 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:51.170945 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb562ae-0fde-453f-bafb-696873c9fc31 None admin] RBAC: Adding query filter params (name=service) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:03:51.171439 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb562ae-0fde-453f-bafb-696873c9fc31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:51.173094 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb562ae-0fde-453f-bafb-696873c9fc31 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:51.185459 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 271/547] 10.222.0.50 () {56 vars in 1103 bytes} [Mon Sep 5 12:03:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:51.194529 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb562ae-0fde-453f-bafb-696873c9fc31 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:51.240129 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:51.326012 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1002381-bfd0-4df0-a73e-6fedf1ac50e1 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:51.365239 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01829d1-e4da-4d13-8c40-2293d8bbb0ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:51.365909 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01829d1-e4da-4d13-8c40-2293d8bbb0ba None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:51.366189 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01829d1-e4da-4d13-8c40-2293d8bbb0ba None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:51.366465 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01829d1-e4da-4d13-8c40-2293d8bbb0ba None admin] PATH_INFO: `/v3/roles/service` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:51.375633 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:51.380211 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01829d1-e4da-4d13-8c40-2293d8bbb0ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:03:51.386054 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application [None req-b01829d1-e4da-4d13-8c40-2293d8bbb0ba None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 05 12:03:51.386054 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:03:51.386054 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:03:51.386054 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:03:51.386054 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:03:51.386054 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:03:51.386054 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:03:51.386054 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:03:51.386054 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:03:51.386054 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:03:51.386054 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:03:51.386054 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:03:51.386054 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:03:51.386054 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:03:51.386054 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:03:51.386054 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:03:51.387073 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:03:51.387073 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:03:51.387073 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:03:51.387073 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:03:51.387073 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:03:51.387073 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:03:51.387073 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:03:51.387073 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:03:51.387073 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:03:51.387073 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:03:51.387073 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:03:51.387073 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application with Lock( Sep 05 12:03:51.387073 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:03:51.387073 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:03:51.387073 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:03:51.387073 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:03:51.387882 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:03:51.387882 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:03:51.387882 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:03:51.387882 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:03:51.387882 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:03:51.387882 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:03:51.387882 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:03:51.387882 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:03:51.387882 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:03:51.387882 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:03:51.387882 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 05 12:03:51.387882 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:03:51.389111 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 277/548] 10.222.0.50 () {56 vars in 1102 bytes} [Mon Sep 5 12:03:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:03:51.395154 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01829d1-e4da-4d13-8c40-2293d8bbb0ba None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:51.415277 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb562ae-0fde-453f-bafb-696873c9fc31 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:51.456659 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23929d27-1e55-44c2-b360-eb1d3391eebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:51.457275 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23929d27-1e55-44c2-b360-eb1d3391eebc None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:51.457560 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23929d27-1e55-44c2-b360-eb1d3391eebc None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:51.457837 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23929d27-1e55-44c2-b360-eb1d3391eebc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:51.471893 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23929d27-1e55-44c2-b360-eb1d3391eebc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:51.481017 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23929d27-1e55-44c2-b360-eb1d3391eebc None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:51.506004 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:51.513366 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01829d1-e4da-4d13-8c40-2293d8bbb0ba None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:51.524024 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-23929d27-1e55-44c2-b360-eb1d3391eebc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:03:51.524024 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:03:51.524024 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:03:51.524024 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:03:51.524024 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:03:51.524024 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:03:51.524024 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:03:51.524024 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:03:51.524024 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:03:51.524024 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:03:51.524024 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:03:51.524024 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:03:51.524024 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:03:51.524024 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:03:51.524024 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:03:51.524024 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:03:51.526931 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:03:51.526931 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:03:51.526931 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:03:51.526931 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:03:51.526931 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:03:51.526931 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:03:51.526931 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:03:51.526931 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:03:51.526931 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:03:51.526931 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:03:51.526931 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:03:51.526931 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:03:51.526931 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:03:51.526931 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:03:51.526931 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:03:51.526931 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:03:51.526931 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:03:51.528683 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:03:51.528683 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:03:51.528683 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:03:51.528683 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 272/549] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 5 12:03:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:03:51.539847 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23929d27-1e55-44c2-b360-eb1d3391eebc None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:51.587462 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58388a52-9607-4f91-b916-2d6941a3c590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:51.588497 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58388a52-9607-4f91-b916-2d6941a3c590 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:51.589537 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58388a52-9607-4f91-b916-2d6941a3c590 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:51.590013 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58388a52-9607-4f91-b916-2d6941a3c590 None admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:51.591195 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58388a52-9607-4f91-b916-2d6941a3c590 None admin] RBAC: Adding query filter params (name=service) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:03:51.591687 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58388a52-9607-4f91-b916-2d6941a3c590 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:51.598444 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58388a52-9607-4f91-b916-2d6941a3c590 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:51.624286 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 278/550] 10.222.0.50 () {56 vars in 1103 bytes} [Mon Sep 5 12:03:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:03:51.629648 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58388a52-9607-4f91-b916-2d6941a3c590 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:51.763794 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23929d27-1e55-44c2-b360-eb1d3391eebc None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:51.799651 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:51.821678 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124bca6e-67af-4fc6-8a90-1b69ed4a1f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:51.822622 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124bca6e-67af-4fc6-8a90-1b69ed4a1f9e None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:51.823058 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124bca6e-67af-4fc6-8a90-1b69ed4a1f9e None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:51.823555 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124bca6e-67af-4fc6-8a90-1b69ed4a1f9e None admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:51.824536 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124bca6e-67af-4fc6-8a90-1b69ed4a1f9e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:03:51.825030 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124bca6e-67af-4fc6-8a90-1b69ed4a1f9e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:51.827344 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124bca6e-67af-4fc6-8a90-1b69ed4a1f9e None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:51.879163 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 273/551] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 5 12:03:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:51.888971 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124bca6e-67af-4fc6-8a90-1b69ed4a1f9e None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:51.969010 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58388a52-9607-4f91-b916-2d6941a3c590 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:52.099137 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4550754e-78e5-4af1-9202-f5cb33aacd14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:52.100051 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4550754e-78e5-4af1-9202-f5cb33aacd14 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:52.100503 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4550754e-78e5-4af1-9202-f5cb33aacd14 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:52.100988 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4550754e-78e5-4af1-9202-f5cb33aacd14 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:52.126817 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124bca6e-67af-4fc6-8a90-1b69ed4a1f9e None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:52.130155 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4550754e-78e5-4af1-9202-f5cb33aacd14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:52.131726 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4550754e-78e5-4af1-9202-f5cb33aacd14 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:52.148314 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application [None req-4550754e-78e5-4af1-9202-f5cb33aacd14 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:03:52.148314 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:03:52.148314 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:03:52.148314 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:03:52.148314 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:03:52.148314 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:03:52.148314 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:03:52.148314 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:03:52.148314 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:03:52.148314 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:03:52.148314 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:03:52.148314 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:03:52.148314 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:03:52.148314 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:03:52.148314 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:03:52.148314 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:03:52.150579 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:03:52.150579 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:03:52.150579 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:03:52.150579 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:03:52.150579 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:03:52.150579 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:03:52.150579 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:03:52.150579 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application with Lock( Sep 05 12:03:52.150579 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:03:52.150579 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:03:52.150579 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:03:52.150579 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:03:52.150579 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:03:52.150579 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:03:52.150579 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:03:52.150579 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:03:52.150579 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:03:52.152989 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:03:52.152989 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:03:52.152989 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:03:52.152989 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 279/552] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 5 12:03:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 522 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:03:52.154198 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cb75ef-c039-49d9-8165-c8e8b27d93a0 None None] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:52.154568 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cb75ef-c039-49d9-8165-c8e8b27d93a0 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:52.154930 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cb75ef-c039-49d9-8165-c8e8b27d93a0 None None] PATH_INFO: `/` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:52.160705 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 280/553] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:03:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:03:52.161584 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cb75ef-c039-49d9-8165-c8e8b27d93a0 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:52.174703 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:52.212547 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00bf55e-b08f-45d0-9335-6a391bbfedf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:52.213803 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00bf55e-b08f-45d0-9335-6a391bbfedf2 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:52.214777 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00bf55e-b08f-45d0-9335-6a391bbfedf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:52.215200 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00bf55e-b08f-45d0-9335-6a391bbfedf2 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:52.227017 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00bf55e-b08f-45d0-9335-6a391bbfedf2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:52.229837 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00bf55e-b08f-45d0-9335-6a391bbfedf2 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:52.251686 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-e00bf55e-b08f-45d0-9335-6a391bbfedf2 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 05 12:03:52.251686 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:03:52.251686 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:03:52.251686 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:03:52.251686 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:03:52.251686 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:03:52.251686 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:03:52.251686 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:03:52.251686 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:03:52.251686 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:03:52.251686 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:03:52.251686 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:03:52.251686 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 12:03:52.251686 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 12:03:52.251686 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 12:03:52.251686 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 12:03:52.252741 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:03:52.252741 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:03:52.252741 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 12:03:52.252741 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:03:52.252741 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 12:03:52.252741 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:03:52.252741 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:03:52.252741 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:03:52.252741 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:03:52.252741 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:03:52.252741 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:03:52.252741 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:03:52.252741 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:03:52.252741 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:03:52.252741 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:03:52.252741 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:03:52.252741 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:03:52.252741 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:03:52.253776 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:03:52.253776 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:03:52.253776 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 12:03:52.253776 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 12:03:52.253776 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 12:03:52.253776 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 12:03:52.253776 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 12:03:52.253776 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 12:03:52.253776 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 05 12:03:52.253776 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:03:52.257079 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 274/554] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Sep 5 12:03:51 2022] GET /identity/v3/users/glance => generated 84 bytes in 369 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:03:52.258815 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b980ca91-eced-47ff-a0ee-1722ca06862b None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:52.259636 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b980ca91-eced-47ff-a0ee-1722ca06862b None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:52.260130 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b980ca91-eced-47ff-a0ee-1722ca06862b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:52.290861 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-b980ca91-eced-47ff-a0ee-1722ca06862b None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:03:52.292488 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-b980ca91-eced-47ff-a0ee-1722ca06862b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:03:52.322756 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cb75ef-c039-49d9-8165-c8e8b27d93a0 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:52.343628 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:52.361526 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e95e960-5283-43e9-9ff6-a657a7c89240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:52.362142 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e95e960-5283-43e9-9ff6-a657a7c89240 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:52.362460 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e95e960-5283-43e9-9ff6-a657a7c89240 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:52.362735 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e95e960-5283-43e9-9ff6-a657a7c89240 None admin] PATH_INFO: `/v3/domains` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:52.363457 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e95e960-5283-43e9-9ff6-a657a7c89240 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:03:52.363680 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e95e960-5283-43e9-9ff6-a657a7c89240 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:52.365208 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e95e960-5283-43e9-9ff6-a657a7c89240 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:52.374694 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 275/555] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:03:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:03:52.375900 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b980ca91-eced-47ff-a0ee-1722ca06862b None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:52.385678 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 281/556] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 5 12:03:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:52.391401 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e95e960-5283-43e9-9ff6-a657a7c89240 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:52.489301 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b980ca91-eced-47ff-a0ee-1722ca06862b None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:52.528659 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70b7743-a78c-4d3c-920d-927e8da2ce07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:52.529676 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70b7743-a78c-4d3c-920d-927e8da2ce07 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:52.530189 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70b7743-a78c-4d3c-920d-927e8da2ce07 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:52.530707 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70b7743-a78c-4d3c-920d-927e8da2ce07 None admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:52.531680 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70b7743-a78c-4d3c-920d-927e8da2ce07 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:03:52.532188 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70b7743-a78c-4d3c-920d-927e8da2ce07 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:52.533876 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70b7743-a78c-4d3c-920d-927e8da2ce07 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:52.553729 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 276/557] 10.222.0.50 () {56 vars in 1137 bytes} [Mon Sep 5 12:03:52 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:52.562721 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70b7743-a78c-4d3c-920d-927e8da2ce07 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:52.579333 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:52.630612 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:52.638519 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e95e960-5283-43e9-9ff6-a657a7c89240 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:52.700523 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374d9e58-8642-456b-b204-7a369867d4f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:52.701207 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374d9e58-8642-456b-b204-7a369867d4f2 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:52.701489 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374d9e58-8642-456b-b204-7a369867d4f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:52.701761 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374d9e58-8642-456b-b204-7a369867d4f2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:52.713810 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374d9e58-8642-456b-b204-7a369867d4f2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:52.715328 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374d9e58-8642-456b-b204-7a369867d4f2 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:52.729125 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application [None req-374d9e58-8642-456b-b204-7a369867d4f2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 05 12:03:52.729125 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:03:52.729125 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:03:52.729125 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:03:52.729125 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:03:52.729125 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:03:52.729125 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:03:52.729125 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:03:52.729125 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:03:52.729125 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:03:52.729125 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:03:52.729125 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:03:52.729125 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 12:03:52.729125 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 12:03:52.729125 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 12:03:52.729125 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 12:03:52.731520 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:03:52.731520 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:03:52.731520 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 12:03:52.731520 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:03:52.731520 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 12:03:52.731520 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:03:52.731520 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:03:52.731520 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:03:52.731520 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:03:52.731520 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:03:52.731520 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:03:52.731520 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application with Lock( Sep 05 12:03:52.731520 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:03:52.731520 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:03:52.731520 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:03:52.731520 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:03:52.731520 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:03:52.731520 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:03:52.732693 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:03:52.732693 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:03:52.732693 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 12:03:52.732693 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 12:03:52.732693 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 12:03:52.732693 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 12:03:52.732693 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 12:03:52.732693 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 12:03:52.732693 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 05 12:03:52.732693 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:03:52.732693 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 282/558] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Sep 5 12:03:52 2022] GET /identity/v3/users/swift => generated 83 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 12:03:52.732693 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374d9e58-8642-456b-b204-7a369867d4f2 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:52.740379 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70b7743-a78c-4d3c-920d-927e8da2ce07 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:52.786712 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bab37b-6081-4007-bd17-52002f141b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:52.787365 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bab37b-6081-4007-bd17-52002f141b92 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:52.787668 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bab37b-6081-4007-bd17-52002f141b92 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:52.787959 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bab37b-6081-4007-bd17-52002f141b92 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:52.800574 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bab37b-6081-4007-bd17-52002f141b92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:52.802232 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bab37b-6081-4007-bd17-52002f141b92 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:52.819221 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-c7bab37b-6081-4007-bd17-52002f141b92 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:03:52.819221 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:03:52.819221 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:03:52.819221 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:03:52.819221 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:03:52.819221 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:03:52.819221 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:03:52.819221 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:03:52.819221 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:03:52.819221 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:03:52.819221 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:03:52.819221 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:03:52.819221 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:03:52.819221 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:03:52.819221 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:03:52.819221 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:03:52.820536 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:03:52.820536 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:03:52.820536 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:03:52.820536 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:03:52.820536 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:03:52.820536 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:03:52.820536 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:03:52.820536 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:03:52.820536 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:03:52.820536 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:03:52.820536 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:03:52.820536 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:03:52.820536 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:03:52.820536 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:03:52.820536 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:03:52.820536 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:03:52.820536 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:03:52.821647 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:03:52.821647 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:03:52.821647 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:03:52.827548 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 277/559] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 5 12:03:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:03:52.827548 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bab37b-6081-4007-bd17-52002f141b92 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:52.877912 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374d9e58-8642-456b-b204-7a369867d4f2 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:52.935693 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:52.947122 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:52.957955 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bab37b-6081-4007-bd17-52002f141b92 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:52.966604 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50570259-281b-47d2-85fe-9d9ecdc63982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:52.967890 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50570259-281b-47d2-85fe-9d9ecdc63982 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:52.969333 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50570259-281b-47d2-85fe-9d9ecdc63982 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:52.969999 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50570259-281b-47d2-85fe-9d9ecdc63982 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:52.993073 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50570259-281b-47d2-85fe-9d9ecdc63982 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:03:53.004454 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application [None req-50570259-281b-47d2-85fe-9d9ecdc63982 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 05 12:03:53.004454 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:03:53.004454 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:03:53.004454 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:03:53.004454 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:03:53.004454 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:03:53.004454 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:03:53.004454 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:03:53.004454 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:03:53.004454 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:03:53.004454 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:03:53.004454 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:03:53.004454 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:03:53.004454 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:03:53.004454 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:03:53.004454 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:03:53.006119 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:03:53.006119 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:03:53.006119 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:03:53.006119 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:03:53.006119 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:03:53.006119 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:03:53.006119 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:03:53.006119 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:03:53.006119 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:03:53.006119 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:03:53.006119 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:03:53.006119 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application with Lock( Sep 05 12:03:53.006119 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:03:53.006119 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:03:53.006119 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:03:53.006119 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:03:53.007544 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:03:53.007544 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:03:53.007544 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:03:53.007544 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:03:53.007544 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:03:53.007544 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:03:53.007544 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:03:53.007544 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:03:53.007544 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:03:53.007544 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:03:53.007544 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 05 12:03:53.007544 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:03:53.012116 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 283/560] 10.222.0.50 () {56 vars in 1102 bytes} [Mon Sep 5 12:03:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:03:53.013656 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50570259-281b-47d2-85fe-9d9ecdc63982 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:53.029890 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3260092f-dab9-4b57-a1e0-041182f95159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:53.031123 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3260092f-dab9-4b57-a1e0-041182f95159 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:53.031725 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3260092f-dab9-4b57-a1e0-041182f95159 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:53.032423 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3260092f-dab9-4b57-a1e0-041182f95159 None admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:53.034024 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3260092f-dab9-4b57-a1e0-041182f95159 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:03:53.034690 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3260092f-dab9-4b57-a1e0-041182f95159 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:53.037819 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3260092f-dab9-4b57-a1e0-041182f95159 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:53.067562 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 278/561] 10.222.0.50 () {56 vars in 1135 bytes} [Mon Sep 5 12:03:52 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:53.068540 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3260092f-dab9-4b57-a1e0-041182f95159 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:53.178165 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50570259-281b-47d2-85fe-9d9ecdc63982 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:53.217760 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3260092f-dab9-4b57-a1e0-041182f95159 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:53.224370 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c1e9b5-c122-4754-bf38-dbf045ebe3ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:53.225010 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c1e9b5-c122-4754-bf38-dbf045ebe3ed None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:53.225296 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c1e9b5-c122-4754-bf38-dbf045ebe3ed None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:53.225546 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c1e9b5-c122-4754-bf38-dbf045ebe3ed None admin] PATH_INFO: `/v3/domains` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:53.226195 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c1e9b5-c122-4754-bf38-dbf045ebe3ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:03:53.226497 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c1e9b5-c122-4754-bf38-dbf045ebe3ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:53.227871 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c1e9b5-c122-4754-bf38-dbf045ebe3ed None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:53.247151 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 284/562] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 5 12:03:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:53.247151 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6739715-4d2d-44c4-9d70-cfdac0768fbc None None] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:53.247151 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6739715-4d2d-44c4-9d70-cfdac0768fbc None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:53.247151 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6739715-4d2d-44c4-9d70-cfdac0768fbc None None] PATH_INFO: `/` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:53.247151 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 285/563] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:03:53 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:03:53.247151 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6739715-4d2d-44c4-9d70-cfdac0768fbc None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:53.271183 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef07f04-073c-4a95-832d-c513cf1cd89b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:53.272094 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef07f04-073c-4a95-832d-c513cf1cd89b None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:53.272563 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef07f04-073c-4a95-832d-c513cf1cd89b None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:53.273346 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef07f04-073c-4a95-832d-c513cf1cd89b None admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:53.274044 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef07f04-073c-4a95-832d-c513cf1cd89b None admin] RBAC: Adding query filter params (name=service) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:03:53.274345 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef07f04-073c-4a95-832d-c513cf1cd89b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:53.275846 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef07f04-073c-4a95-832d-c513cf1cd89b None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:53.290775 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 279/564] 10.222.0.50 () {56 vars in 1103 bytes} [Mon Sep 5 12:03:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:53.291704 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef07f04-073c-4a95-832d-c513cf1cd89b None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:53.304774 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:53.307941 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:53.364346 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6739715-4d2d-44c4-9d70-cfdac0768fbc None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:53.402612 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f62149d-4e11-4ddc-99ea-9569f9477f23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:53.403225 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f62149d-4e11-4ddc-99ea-9569f9477f23 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:53.403512 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f62149d-4e11-4ddc-99ea-9569f9477f23 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:53.403784 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f62149d-4e11-4ddc-99ea-9569f9477f23 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:53.406419 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef07f04-073c-4a95-832d-c513cf1cd89b None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:53.449956 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f85887-1603-4765-b6e6-d9a457faa188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:53.450764 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f85887-1603-4765-b6e6-d9a457faa188 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:53.451060 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f85887-1603-4765-b6e6-d9a457faa188 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:53.451325 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f85887-1603-4765-b6e6-d9a457faa188 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:53.459823 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f85887-1603-4765-b6e6-d9a457faa188 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:53.461433 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f85887-1603-4765-b6e6-d9a457faa188 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:53.480000 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f62149d-4e11-4ddc-99ea-9569f9477f23 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:53.481475 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f62149d-4e11-4ddc-99ea-9569f9477f23 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:53.484109 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-57f85887-1603-4765-b6e6-d9a457faa188 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:03:53.484109 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:03:53.484109 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:03:53.484109 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:03:53.484109 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:03:53.484109 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:03:53.484109 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:03:53.484109 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:03:53.484109 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:03:53.484109 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:03:53.484109 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:03:53.484109 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:03:53.484109 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 12:03:53.484109 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 12:03:53.484109 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 12:03:53.485016 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 12:03:53.485016 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:03:53.485016 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:03:53.485016 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:03:53.485016 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:03:53.485016 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:03:53.485016 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:03:53.485016 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:03:53.485016 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:03:53.485016 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:03:53.485016 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:03:53.485016 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:03:53.485016 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:03:53.485016 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:03:53.485016 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:03:53.485016 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:03:53.485016 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:03:53.485926 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 12:03:53.485926 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 12:03:53.485926 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 12:03:53.485926 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 12:03:53.485926 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 12:03:53.485926 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 12:03:53.485926 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:03:53.485926 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:03:53.486365 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 280/565] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Sep 5 12:03:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:03:53.488530 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0918b2a-d0a2-44f4-a189-304fe425c3ff None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:53.489125 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0918b2a-d0a2-44f4-a189-304fe425c3ff None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:53.489595 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0918b2a-d0a2-44f4-a189-304fe425c3ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:53.520034 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-c0918b2a-d0a2-44f4-a189-304fe425c3ff None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:03:53.522158 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-c0918b2a-d0a2-44f4-a189-304fe425c3ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:03:53.553176 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:53.624710 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:53.644926 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 281/566] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:03:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:03:53.644926 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0918b2a-d0a2-44f4-a189-304fe425c3ff None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:53.667857 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 286/567] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Sep 5 12:03:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 12:03:53.669704 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f62149d-4e11-4ddc-99ea-9569f9477f23 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:53.806364 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0918b2a-d0a2-44f4-a189-304fe425c3ff None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:53.846248 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f62149d-4e11-4ddc-99ea-9569f9477f23 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:53.855979 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5b894d-1a43-4897-ae12-7a1079a9566b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:53.856975 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5b894d-1a43-4897-ae12-7a1079a9566b None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:53.857442 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5b894d-1a43-4897-ae12-7a1079a9566b None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:53.857921 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5b894d-1a43-4897-ae12-7a1079a9566b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:53.877183 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5b894d-1a43-4897-ae12-7a1079a9566b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:53.879765 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5b894d-1a43-4897-ae12-7a1079a9566b None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:53.887807 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1b13fc-26e9-41c7-8657-3ebf36471b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:53.888734 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1b13fc-26e9-41c7-8657-3ebf36471b6f None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:53.889270 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1b13fc-26e9-41c7-8657-3ebf36471b6f None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:53.889688 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1b13fc-26e9-41c7-8657-3ebf36471b6f None admin] PATH_INFO: `/v3/projects` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:53.890614 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1b13fc-26e9-41c7-8657-3ebf36471b6f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:03:53.891126 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1b13fc-26e9-41c7-8657-3ebf36471b6f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:53.892850 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1b13fc-26e9-41c7-8657-3ebf36471b6f None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:53.902837 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-dc5b894d-1a43-4897-ae12-7a1079a9566b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:03:53.902837 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:03:53.902837 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:03:53.902837 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:03:53.902837 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:03:53.902837 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:03:53.902837 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:03:53.902837 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:03:53.902837 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:03:53.902837 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:03:53.902837 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:03:53.902837 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:03:53.902837 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:03:53.902837 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:03:53.902837 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:03:53.902837 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:03:53.904026 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:03:53.904026 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:03:53.904026 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:03:53.904026 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:03:53.904026 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:03:53.904026 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:03:53.904026 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:03:53.904026 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:03:53.904026 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:03:53.904026 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:03:53.904026 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:03:53.904026 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:03:53.904026 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:03:53.904026 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:03:53.904026 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:03:53.904026 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:03:53.904026 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:03:53.905145 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:03:53.905145 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:03:53.905145 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:03:53.906549 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 282/568] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 5 12:03:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:03:53.907497 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5b894d-1a43-4897-ae12-7a1079a9566b None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:53.914269 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 287/569] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Sep 5 12:03:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:53.916481 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab35f637-f594-436a-81a7-4081c8d68114 None None] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:53.917048 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab35f637-f594-436a-81a7-4081c8d68114 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:53.917536 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab35f637-f594-436a-81a7-4081c8d68114 None None] PATH_INFO: `/` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:53.920149 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 288/570] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:03:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:03:53.922055 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab35f637-f594-436a-81a7-4081c8d68114 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:53.936282 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:53.979131 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:54.039948 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5b894d-1a43-4897-ae12-7a1079a9566b None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:54.042356 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab35f637-f594-436a-81a7-4081c8d68114 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:54.077821 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10424d8b-bd81-4fce-ba85-b32a92908479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:54.078539 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10424d8b-bd81-4fce-ba85-b32a92908479 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:54.078924 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10424d8b-bd81-4fce-ba85-b32a92908479 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:54.079259 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10424d8b-bd81-4fce-ba85-b32a92908479 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:54.079353 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16826ff3-5770-41a8-b541-387c00a1c082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:54.079919 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16826ff3-5770-41a8-b541-387c00a1c082 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:54.080191 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16826ff3-5770-41a8-b541-387c00a1c082 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:54.080463 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16826ff3-5770-41a8-b541-387c00a1c082 None admin] PATH_INFO: `/v3/domains` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:54.081162 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16826ff3-5770-41a8-b541-387c00a1c082 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:03:54.081465 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16826ff3-5770-41a8-b541-387c00a1c082 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:54.082901 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16826ff3-5770-41a8-b541-387c00a1c082 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:54.092291 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10424d8b-bd81-4fce-ba85-b32a92908479 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:54.093885 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10424d8b-bd81-4fce-ba85-b32a92908479 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:54.097838 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 289/571] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 5 12:03:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:54.098767 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16826ff3-5770-41a8-b541-387c00a1c082 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:54.116635 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-10424d8b-bd81-4fce-ba85-b32a92908479 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:03:54.116635 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:03:54.116635 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:03:54.116635 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:03:54.116635 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:03:54.116635 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:03:54.116635 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:03:54.116635 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:03:54.116635 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:03:54.116635 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:03:54.116635 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:03:54.116635 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:03:54.116635 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:03:54.116635 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:03:54.116635 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:03:54.116635 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:03:54.117896 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:03:54.117896 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:03:54.117896 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:03:54.117896 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:03:54.117896 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:03:54.117896 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:03:54.117896 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:03:54.117896 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:03:54.117896 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:03:54.117896 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:03:54.117896 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:03:54.117896 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:03:54.117896 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:03:54.117896 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:03:54.117896 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:03:54.117896 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:03:54.117896 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:03:54.120954 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:03:54.120954 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:03:54.120954 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:03:54.120954 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 283/572] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 5 12:03:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:03:54.120954 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10424d8b-bd81-4fce-ba85-b32a92908479 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:54.177197 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:54.214458 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16826ff3-5770-41a8-b541-387c00a1c082 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:54.257755 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405fe8ec-c8ef-46d4-ac82-efbf760e8205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:54.257984 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10424d8b-bd81-4fce-ba85-b32a92908479 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:54.258446 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405fe8ec-c8ef-46d4-ac82-efbf760e8205 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:54.258665 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405fe8ec-c8ef-46d4-ac82-efbf760e8205 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:54.258937 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405fe8ec-c8ef-46d4-ac82-efbf760e8205 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:54.259731 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:54.271605 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405fe8ec-c8ef-46d4-ac82-efbf760e8205 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:03:54.277058 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application [None req-405fe8ec-c8ef-46d4-ac82-efbf760e8205 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 05 12:03:54.277058 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:03:54.277058 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:03:54.277058 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:03:54.277058 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:03:54.277058 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:03:54.277058 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:03:54.277058 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:03:54.277058 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:03:54.277058 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:03:54.277058 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:03:54.277058 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:03:54.277058 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:03:54.277058 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:03:54.277058 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:03:54.277058 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:03:54.278024 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:03:54.278024 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:03:54.278024 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:03:54.278024 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:03:54.278024 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:03:54.278024 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:03:54.278024 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:03:54.278024 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:03:54.278024 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:03:54.278024 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:03:54.278024 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:03:54.278024 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application with Lock( Sep 05 12:03:54.278024 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:03:54.278024 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:03:54.278024 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:03:54.278024 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:03:54.278858 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:03:54.278858 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:03:54.278858 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:03:54.278858 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:03:54.278858 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:03:54.278858 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:03:54.278858 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:03:54.278858 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:03:54.278858 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:03:54.278858 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:03:54.278858 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 05 12:03:54.278858 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:03:54.278858 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 290/573] 10.222.0.50 () {56 vars in 1102 bytes} [Mon Sep 5 12:03:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:03:54.279833 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1a13a0-fabc-4c83-9923-9406b0395f68 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:54.279833 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1a13a0-fabc-4c83-9923-9406b0395f68 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:54.279971 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1a13a0-fabc-4c83-9923-9406b0395f68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:54.298896 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-be1a13a0-fabc-4c83-9923-9406b0395f68 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:03:54.300148 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-be1a13a0-fabc-4c83-9923-9406b0395f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:03:54.301027 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa7babf-7fd0-4644-8bb6-14b5a4db28a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:54.301700 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa7babf-7fd0-4644-8bb6-14b5a4db28a1 None admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:54.301982 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa7babf-7fd0-4644-8bb6-14b5a4db28a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:54.302382 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa7babf-7fd0-4644-8bb6-14b5a4db28a1 None admin] PATH_INFO: `/v3/projects/ae4f8939fcc040bca99783a77e6ede4d/users/b2b08e831af84a658b0f5b28ad03e4f7/roles/fe10209913504171981606bfdf25a9bb` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:54.320066 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa7babf-7fd0-4644-8bb6-14b5a4db28a1 None admin] RBAC: Authorizing `identity:create_grant(project_id=ae4f8939fcc040bca99783a77e6ede4d, user_id=b2b08e831af84a658b0f5b28ad03e4f7, role_id=fe10209913504171981606bfdf25a9bb)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:54.321630 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa7babf-7fd0-4644-8bb6-14b5a4db28a1 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:54.335865 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 284/574] 10.222.0.50 () {58 vars in 1439 bytes} [Mon Sep 5 12:03:54 2022] PUT /identity/v3/projects/ae4f8939fcc040bca99783a77e6ede4d/users/b2b08e831af84a658b0f5b28ad03e4f7/roles/fe10209913504171981606bfdf25a9bb => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:03:54.336491 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa7babf-7fd0-4644-8bb6-14b5a4db28a1 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:54.391340 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 291/575] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:03:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:03:54.393019 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1a13a0-fabc-4c83-9923-9406b0395f68 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:54.491716 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa7babf-7fd0-4644-8bb6-14b5a4db28a1 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:54.536759 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:54.542767 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3b50ca-abe7-4e6b-ae62-2cb0d726d03c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:54.542767 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3b50ca-abe7-4e6b-ae62-2cb0d726d03c None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:54.542767 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3b50ca-abe7-4e6b-ae62-2cb0d726d03c None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:54.543305 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3b50ca-abe7-4e6b-ae62-2cb0d726d03c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:54.554377 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3b50ca-abe7-4e6b-ae62-2cb0d726d03c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:54.556340 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3b50ca-abe7-4e6b-ae62-2cb0d726d03c None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:54.576952 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-2f3b50ca-abe7-4e6b-ae62-2cb0d726d03c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 05 12:03:54.576952 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:03:54.576952 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:03:54.576952 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:03:54.576952 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:03:54.576952 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:03:54.576952 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:03:54.576952 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:03:54.576952 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:03:54.576952 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:03:54.576952 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:03:54.576952 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:03:54.576952 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 12:03:54.576952 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 12:03:54.576952 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 12:03:54.576952 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 12:03:54.578793 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:03:54.578793 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:03:54.578793 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 12:03:54.578793 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:03:54.578793 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 12:03:54.578793 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:03:54.578793 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:03:54.578793 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:03:54.578793 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:03:54.578793 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:03:54.578793 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:03:54.578793 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:03:54.578793 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:03:54.578793 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:03:54.578793 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:03:54.578793 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:03:54.578793 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:03:54.578793 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:03:54.580661 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:03:54.580661 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:03:54.580661 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 12:03:54.580661 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 12:03:54.580661 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 12:03:54.580661 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 12:03:54.580661 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 12:03:54.580661 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 12:03:54.580661 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 05 12:03:54.580661 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:03:54.580661 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 285/576] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Sep 5 12:03:54 2022] GET /identity/v3/users/cinder => generated 84 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:03:54.583819 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3b50ca-abe7-4e6b-ae62-2cb0d726d03c None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:54.588927 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1a13a0-fabc-4c83-9923-9406b0395f68 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:54.608359 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:54.625362 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b98788-0f3b-4ced-9b34-759a3a11ac7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:54.625978 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b98788-0f3b-4ced-9b34-759a3a11ac7c None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:54.626257 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b98788-0f3b-4ced-9b34-759a3a11ac7c None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:54.626520 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b98788-0f3b-4ced-9b34-759a3a11ac7c None admin] PATH_INFO: `/v3/domains` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:54.627172 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b98788-0f3b-4ced-9b34-759a3a11ac7c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:03:54.627473 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b98788-0f3b-4ced-9b34-759a3a11ac7c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:54.628951 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b98788-0f3b-4ced-9b34-759a3a11ac7c None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:54.642518 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 292/577] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 5 12:03:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:54.643455 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b98788-0f3b-4ced-9b34-759a3a11ac7c None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:54.738726 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3b50ca-abe7-4e6b-ae62-2cb0d726d03c None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:54.770281 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b98788-0f3b-4ced-9b34-759a3a11ac7c None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:54.788459 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bb18eb-d20b-47b5-8f5f-a42eda821e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:54.788459 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bb18eb-d20b-47b5-8f5f-a42eda821e78 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:54.788751 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bb18eb-d20b-47b5-8f5f-a42eda821e78 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:54.788957 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bb18eb-d20b-47b5-8f5f-a42eda821e78 None admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:54.789552 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bb18eb-d20b-47b5-8f5f-a42eda821e78 None admin] RBAC: Adding query filter params (name=service) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:03:54.789857 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bb18eb-d20b-47b5-8f5f-a42eda821e78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:54.791257 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bb18eb-d20b-47b5-8f5f-a42eda821e78 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:54.808993 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 286/578] 10.222.0.50 () {56 vars in 1103 bytes} [Mon Sep 5 12:03:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:54.810165 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bb18eb-d20b-47b5-8f5f-a42eda821e78 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:54.810370 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:54.836612 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43f7c1d-6ad1-445e-98b4-9ff62b9884a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:54.837446 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43f7c1d-6ad1-445e-98b4-9ff62b9884a4 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:54.837924 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43f7c1d-6ad1-445e-98b4-9ff62b9884a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:54.838364 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43f7c1d-6ad1-445e-98b4-9ff62b9884a4 None admin] PATH_INFO: `/v3/users` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:54.839272 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43f7c1d-6ad1-445e-98b4-9ff62b9884a4 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:03:54.839778 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43f7c1d-6ad1-445e-98b4-9ff62b9884a4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:54.841631 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43f7c1d-6ad1-445e-98b4-9ff62b9884a4 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:54.868995 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 293/579] 10.222.0.50 () {56 vars in 1137 bytes} [Mon Sep 5 12:03:54 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:54.869409 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43f7c1d-6ad1-445e-98b4-9ff62b9884a4 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:54.918391 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:54.951831 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bb18eb-d20b-47b5-8f5f-a42eda821e78 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:54.997720 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42241a52-ccc0-4365-b443-189551b48987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:54.998777 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42241a52-ccc0-4365-b443-189551b48987 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:54.999244 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42241a52-ccc0-4365-b443-189551b48987 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:54.999705 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42241a52-ccc0-4365-b443-189551b48987 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:55.005930 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43f7c1d-6ad1-445e-98b4-9ff62b9884a4 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:55.012000 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42241a52-ccc0-4365-b443-189551b48987 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:55.014640 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42241a52-ccc0-4365-b443-189551b48987 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:55.032627 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-42241a52-ccc0-4365-b443-189551b48987 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:03:55.032627 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:03:55.032627 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:03:55.032627 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:03:55.032627 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:03:55.032627 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:03:55.032627 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:03:55.032627 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:03:55.032627 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:03:55.032627 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:03:55.032627 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:03:55.032627 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:03:55.032627 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 12:03:55.032627 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 12:03:55.032627 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 12:03:55.034267 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 12:03:55.034267 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:03:55.034267 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:03:55.034267 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:03:55.034267 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:03:55.034267 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:03:55.034267 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:03:55.034267 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:03:55.034267 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:03:55.034267 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:03:55.034267 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:03:55.034267 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:03:55.034267 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:03:55.034267 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:03:55.034267 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:03:55.034267 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:03:55.034267 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:03:55.035830 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 12:03:55.035830 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 12:03:55.035830 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 12:03:55.035830 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 12:03:55.035830 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 12:03:55.035830 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 12:03:55.035830 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:03:55.035830 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:03:55.035830 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 287/580] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Sep 5 12:03:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:03:55.035830 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42241a52-ccc0-4365-b443-189551b48987 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:55.056603 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0391ad2b-968f-41b1-b0f8-391959068b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:55.057293 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0391ad2b-968f-41b1-b0f8-391959068b26 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:55.057633 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0391ad2b-968f-41b1-b0f8-391959068b26 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:55.058411 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0391ad2b-968f-41b1-b0f8-391959068b26 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:55.076819 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0391ad2b-968f-41b1-b0f8-391959068b26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:03:55.085146 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application [None req-0391ad2b-968f-41b1-b0f8-391959068b26 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 05 12:03:55.085146 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:03:55.085146 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:03:55.085146 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:03:55.085146 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:03:55.085146 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:03:55.085146 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:03:55.085146 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:03:55.085146 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:03:55.085146 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:03:55.085146 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:03:55.085146 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:03:55.085146 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:03:55.085146 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:03:55.085146 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:03:55.085146 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:03:55.086617 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:03:55.086617 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:03:55.086617 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:03:55.086617 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:03:55.086617 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:03:55.086617 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:03:55.086617 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:03:55.086617 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:03:55.086617 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:03:55.086617 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:03:55.086617 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:03:55.086617 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application with Lock( Sep 05 12:03:55.086617 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:03:55.086617 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:03:55.086617 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:03:55.086617 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:03:55.087811 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:03:55.087811 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:03:55.087811 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:03:55.087811 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:03:55.087811 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:03:55.087811 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:03:55.087811 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:03:55.087811 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:03:55.087811 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:03:55.087811 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:03:55.087811 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 05 12:03:55.087811 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:03:55.087811 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 294/581] 10.222.0.50 () {56 vars in 1102 bytes} [Mon Sep 5 12:03:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:03:55.089942 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0391ad2b-968f-41b1-b0f8-391959068b26 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:55.140625 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:55.195801 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42241a52-ccc0-4365-b443-189551b48987 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:55.230051 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0391ad2b-968f-41b1-b0f8-391959068b26 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:55.246675 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29a185c-e023-48ad-9901-f4129de57571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:55.247682 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29a185c-e023-48ad-9901-f4129de57571 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:55.248150 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29a185c-e023-48ad-9901-f4129de57571 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:55.248566 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29a185c-e023-48ad-9901-f4129de57571 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:55.251181 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:55.261615 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29a185c-e023-48ad-9901-f4129de57571 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:55.264416 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29a185c-e023-48ad-9901-f4129de57571 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:55.284022 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff4a370-5426-40a0-9f27-763a79877127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:55.284290 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-a29a185c-e023-48ad-9901-f4129de57571 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:03:55.284290 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:03:55.284290 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:03:55.284290 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:03:55.284290 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:03:55.284290 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:03:55.284290 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:03:55.284290 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:03:55.284290 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:03:55.284290 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:03:55.284290 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:03:55.284290 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:03:55.284290 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:03:55.284290 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:03:55.284290 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:03:55.284290 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:03:55.286126 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:03:55.286126 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:03:55.286126 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:03:55.286126 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:03:55.286126 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:03:55.286126 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:03:55.286126 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:03:55.286126 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:03:55.286126 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:03:55.286126 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:03:55.286126 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:03:55.286126 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:03:55.286126 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:03:55.286126 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:03:55.286126 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:03:55.286126 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:03:55.286126 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:03:55.287812 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:03:55.287812 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:03:55.287812 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:03:55.288142 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff4a370-5426-40a0-9f27-763a79877127 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:55.288142 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff4a370-5426-40a0-9f27-763a79877127 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:55.288142 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff4a370-5426-40a0-9f27-763a79877127 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:55.290017 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 288/582] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 5 12:03:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:03:55.290922 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29a185c-e023-48ad-9901-f4129de57571 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:55.303419 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff4a370-5426-40a0-9f27-763a79877127 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:55.305983 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff4a370-5426-40a0-9f27-763a79877127 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:55.322704 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application [None req-5ff4a370-5426-40a0-9f27-763a79877127 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:03:55.322704 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:03:55.322704 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:03:55.322704 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:03:55.322704 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:03:55.322704 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:03:55.322704 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:03:55.322704 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:03:55.322704 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:03:55.322704 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:03:55.322704 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:03:55.322704 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:03:55.322704 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:03:55.322704 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:03:55.322704 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:03:55.322704 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:03:55.323767 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:03:55.323767 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:03:55.323767 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:03:55.323767 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:03:55.323767 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:03:55.323767 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:03:55.323767 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:03:55.323767 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application with Lock( Sep 05 12:03:55.323767 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:03:55.323767 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:03:55.323767 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:03:55.323767 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:03:55.323767 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:03:55.323767 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:03:55.323767 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:03:55.323767 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:03:55.323767 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:03:55.324657 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:03:55.324657 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:03:55.324657 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:03:55.326525 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 295/583] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 5 12:03:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:03:55.327700 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff4a370-5426-40a0-9f27-763a79877127 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:55.435659 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29a185c-e023-48ad-9901-f4129de57571 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:55.473415 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:55.492198 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c23a58d-64d4-435b-a5f1-0336c70eda14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:55.493374 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c23a58d-64d4-435b-a5f1-0336c70eda14 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:55.493792 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c23a58d-64d4-435b-a5f1-0336c70eda14 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:55.494239 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c23a58d-64d4-435b-a5f1-0336c70eda14 None admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:55.495478 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c23a58d-64d4-435b-a5f1-0336c70eda14 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:03:55.495984 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c23a58d-64d4-435b-a5f1-0336c70eda14 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:55.497113 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff4a370-5426-40a0-9f27-763a79877127 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:55.498658 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c23a58d-64d4-435b-a5f1-0336c70eda14 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:55.522839 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 289/584] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Sep 5 12:03:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:55.522839 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c23a58d-64d4-435b-a5f1-0336c70eda14 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:55.552917 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900f84d5-c725-4397-a3eb-ca79f5ecebb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:55.553879 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900f84d5-c725-4397-a3eb-ca79f5ecebb1 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:55.554282 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900f84d5-c725-4397-a3eb-ca79f5ecebb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:55.554687 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900f84d5-c725-4397-a3eb-ca79f5ecebb1 None admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:55.555455 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900f84d5-c725-4397-a3eb-ca79f5ecebb1 None admin] RBAC: Adding query filter params (name=service) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:03:55.555765 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900f84d5-c725-4397-a3eb-ca79f5ecebb1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:55.557699 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900f84d5-c725-4397-a3eb-ca79f5ecebb1 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:55.567126 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 296/585] 10.222.0.50 () {56 vars in 1103 bytes} [Mon Sep 5 12:03:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:55.568016 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900f84d5-c725-4397-a3eb-ca79f5ecebb1 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:55.599889 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:55.680306 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c23a58d-64d4-435b-a5f1-0336c70eda14 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:55.717925 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900f84d5-c725-4397-a3eb-ca79f5ecebb1 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:55.727741 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a231640-2329-4dd6-820a-985e57b35d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:55.728718 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a231640-2329-4dd6-820a-985e57b35d71 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:55.729222 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a231640-2329-4dd6-820a-985e57b35d71 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:55.729677 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a231640-2329-4dd6-820a-985e57b35d71 None admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:55.730718 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a231640-2329-4dd6-820a-985e57b35d71 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:03:55.731036 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a231640-2329-4dd6-820a-985e57b35d71 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:55.733320 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a231640-2329-4dd6-820a-985e57b35d71 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:55.758371 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 290/586] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 5 12:03:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:55.758371 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a231640-2329-4dd6-820a-985e57b35d71 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:55.767423 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795fca08-35e8-4641-ad6e-88cad34649d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:55.768203 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795fca08-35e8-4641-ad6e-88cad34649d3 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:55.768581 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795fca08-35e8-4641-ad6e-88cad34649d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:55.768983 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795fca08-35e8-4641-ad6e-88cad34649d3 None admin] PATH_INFO: `/v3/domains` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:55.769743 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795fca08-35e8-4641-ad6e-88cad34649d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:03:55.770145 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795fca08-35e8-4641-ad6e-88cad34649d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:55.772240 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795fca08-35e8-4641-ad6e-88cad34649d3 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:55.794051 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 297/587] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 5 12:03:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:55.795199 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795fca08-35e8-4641-ad6e-88cad34649d3 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:55.814932 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:55.925076 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a231640-2329-4dd6-820a-985e57b35d71 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:55.937966 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:55.963282 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795fca08-35e8-4641-ad6e-88cad34649d3 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:55.978300 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb91acd-0e8e-45ae-b625-1aba92bdfd49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:55.979427 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb91acd-0e8e-45ae-b625-1aba92bdfd49 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:55.980170 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb91acd-0e8e-45ae-b625-1aba92bdfd49 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:55.980548 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb91acd-0e8e-45ae-b625-1aba92bdfd49 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:55.981609 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb91acd-0e8e-45ae-b625-1aba92bdfd49 None admin] RBAC: Adding query filter params (role.id=fe10209913504171981606bfdf25a9bb, scope.project.id=ae4f8939fcc040bca99783a77e6ede4d, user.id=ea2b32d58d964585a24e7c5784a8355f) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:03:55.982054 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb91acd-0e8e-45ae-b625-1aba92bdfd49 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:55.984092 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb91acd-0e8e-45ae-b625-1aba92bdfd49 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:55.997591 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 291/588] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Sep 5 12:03:55 2022] GET /identity/v3/role_assignments?user.id=ea2b32d58d964585a24e7c5784a8355f&scope.project.id=ae4f8939fcc040bca99783a77e6ede4d&role.id=fe10209913504171981606bfdf25a9bb => generated 259 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:55.998943 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb91acd-0e8e-45ae-b625-1aba92bdfd49 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:56.010076 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0148d3f-41e4-4b4c-b829-3b6bf54c88a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:56.012885 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0148d3f-41e4-4b4c-b829-3b6bf54c88a4 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:56.013668 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0148d3f-41e4-4b4c-b829-3b6bf54c88a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:56.014859 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0148d3f-41e4-4b4c-b829-3b6bf54c88a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:56.035454 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0148d3f-41e4-4b4c-b829-3b6bf54c88a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:56.038380 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0148d3f-41e4-4b4c-b829-3b6bf54c88a4 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:56.064292 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application [None req-c0148d3f-41e4-4b4c-b829-3b6bf54c88a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:03:56.064292 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:03:56.064292 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:03:56.064292 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:03:56.064292 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:03:56.064292 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:03:56.064292 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:03:56.064292 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:03:56.064292 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:03:56.064292 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:03:56.064292 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:03:56.064292 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:03:56.064292 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:03:56.064292 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:03:56.064292 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:03:56.064292 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:03:56.065992 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:03:56.065992 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:03:56.065992 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:03:56.065992 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:03:56.065992 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:03:56.065992 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:03:56.065992 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:03:56.065992 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application with Lock( Sep 05 12:03:56.065992 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:03:56.065992 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:03:56.065992 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:03:56.065992 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:03:56.065992 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:03:56.065992 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:03:56.065992 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:03:56.065992 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:03:56.065992 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:03:56.067571 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:03:56.067571 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:03:56.067571 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:03:56.071029 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 298/589] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 5 12:03:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:03:56.074542 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0148d3f-41e4-4b4c-b829-3b6bf54c88a4 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:56.134698 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb91acd-0e8e-45ae-b625-1aba92bdfd49 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:56.173959 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdab2fd-85cc-4cd9-8df1-754d51ba62ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:56.174617 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdab2fd-85cc-4cd9-8df1-754d51ba62ea None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:56.174896 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdab2fd-85cc-4cd9-8df1-754d51ba62ea None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:56.175232 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdab2fd-85cc-4cd9-8df1-754d51ba62ea None admin] PATH_INFO: `/v3/users/nova` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:56.184725 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdab2fd-85cc-4cd9-8df1-754d51ba62ea None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:56.186274 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdab2fd-85cc-4cd9-8df1-754d51ba62ea None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:56.197482 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:56.200126 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-afdab2fd-85cc-4cd9-8df1-754d51ba62ea None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 05 12:03:56.200126 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:03:56.200126 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:03:56.200126 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:03:56.200126 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:03:56.200126 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:03:56.200126 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:03:56.200126 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:03:56.200126 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:03:56.200126 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:03:56.200126 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:03:56.200126 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:03:56.200126 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 12:03:56.200126 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 12:03:56.200126 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 12:03:56.200126 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 12:03:56.201779 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:03:56.201779 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:03:56.201779 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 12:03:56.201779 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:03:56.201779 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 12:03:56.201779 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:03:56.201779 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:03:56.201779 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:03:56.201779 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:03:56.201779 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:03:56.201779 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:03:56.201779 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:03:56.201779 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:03:56.201779 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:03:56.201779 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:03:56.201779 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:03:56.201779 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:03:56.201779 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:03:56.203503 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:03:56.203503 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:03:56.203503 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 12:03:56.203503 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 12:03:56.203503 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 12:03:56.203503 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 12:03:56.203503 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 12:03:56.203503 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 12:03:56.203503 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 05 12:03:56.203503 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:03:56.203503 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 292/590] 10.222.0.50 () {56 vars in 1093 bytes} [Mon Sep 5 12:03:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:03:56.203503 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdab2fd-85cc-4cd9-8df1-754d51ba62ea None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:56.238024 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:56.282591 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0148d3f-41e4-4b4c-b829-3b6bf54c88a4 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:56.323924 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae722735-d76c-4ed5-83d7-d67b564b1ca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:56.324570 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae722735-d76c-4ed5-83d7-d67b564b1ca8 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:56.324844 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae722735-d76c-4ed5-83d7-d67b564b1ca8 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:56.325144 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae722735-d76c-4ed5-83d7-d67b564b1ca8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:56.333417 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae722735-d76c-4ed5-83d7-d67b564b1ca8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:56.334873 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae722735-d76c-4ed5-83d7-d67b564b1ca8 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:56.347533 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application [None req-ae722735-d76c-4ed5-83d7-d67b564b1ca8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:03:56.347533 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:03:56.347533 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:03:56.347533 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:03:56.347533 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:03:56.347533 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:03:56.347533 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:03:56.347533 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:03:56.347533 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:03:56.347533 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:03:56.347533 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:03:56.347533 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:03:56.347533 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 12:03:56.347533 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 12:03:56.347533 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 12:03:56.349220 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 12:03:56.349220 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:03:56.349220 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:03:56.349220 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:03:56.349220 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:03:56.349220 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:03:56.349220 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:03:56.349220 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:03:56.349220 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application with Lock( Sep 05 12:03:56.349220 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:03:56.349220 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:03:56.349220 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:03:56.349220 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:03:56.349220 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:03:56.349220 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:03:56.349220 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:03:56.349220 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:03:56.350930 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 12:03:56.350930 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 12:03:56.350930 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 12:03:56.350930 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 12:03:56.350930 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 12:03:56.350930 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 12:03:56.350930 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:03:56.350930 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:03:56.350930 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 299/591] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Sep 5 12:03:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:03:56.350930 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae722735-d76c-4ed5-83d7-d67b564b1ca8 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:56.369892 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdab2fd-85cc-4cd9-8df1-754d51ba62ea None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:56.431946 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dddb4e0-01e9-4400-a401-4e90e7208601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:56.433880 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dddb4e0-01e9-4400-a401-4e90e7208601 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:56.434266 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dddb4e0-01e9-4400-a401-4e90e7208601 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:56.434673 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dddb4e0-01e9-4400-a401-4e90e7208601 None admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:56.435484 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dddb4e0-01e9-4400-a401-4e90e7208601 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:03:56.435877 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dddb4e0-01e9-4400-a401-4e90e7208601 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:56.437470 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dddb4e0-01e9-4400-a401-4e90e7208601 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:56.451236 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 293/592] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 5 12:03:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:56.456685 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dddb4e0-01e9-4400-a401-4e90e7208601 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:56.481208 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae722735-d76c-4ed5-83d7-d67b564b1ca8 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:56.510838 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:56.525128 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb358f0e-0532-43d4-b5ff-2f6b3c98a8f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:56.525691 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb358f0e-0532-43d4-b5ff-2f6b3c98a8f4 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:56.525974 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb358f0e-0532-43d4-b5ff-2f6b3c98a8f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:56.526459 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb358f0e-0532-43d4-b5ff-2f6b3c98a8f4 None admin] PATH_INFO: `/v3/users` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:56.527038 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb358f0e-0532-43d4-b5ff-2f6b3c98a8f4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:03:56.527459 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb358f0e-0532-43d4-b5ff-2f6b3c98a8f4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:56.529011 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb358f0e-0532-43d4-b5ff-2f6b3c98a8f4 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:56.552826 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 300/593] 10.222.0.50 () {56 vars in 1133 bytes} [Mon Sep 5 12:03:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:56.552826 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb358f0e-0532-43d4-b5ff-2f6b3c98a8f4 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:56.566907 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:56.577799 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dddb4e0-01e9-4400-a401-4e90e7208601 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:56.615675 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d9bb5a-31bf-4ab0-a71b-dee338137987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:56.616285 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d9bb5a-31bf-4ab0-a71b-dee338137987 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:56.616594 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d9bb5a-31bf-4ab0-a71b-dee338137987 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:56.616864 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d9bb5a-31bf-4ab0-a71b-dee338137987 None admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:56.617583 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d9bb5a-31bf-4ab0-a71b-dee338137987 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:03:56.617886 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d9bb5a-31bf-4ab0-a71b-dee338137987 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:56.619327 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d9bb5a-31bf-4ab0-a71b-dee338137987 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:56.632478 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 294/594] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Sep 5 12:03:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:56.633775 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f034b25-fd71-4525-9a46-761de311dd92 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:56.634059 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f034b25-fd71-4525-9a46-761de311dd92 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:56.634324 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f034b25-fd71-4525-9a46-761de311dd92 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:56.635901 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 295/595] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:03:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:03:56.636632 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f034b25-fd71-4525-9a46-761de311dd92 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:56.669378 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb358f0e-0532-43d4-b5ff-2f6b3c98a8f4 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:56.709804 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ea509c-bc9d-4700-87db-8b35be286832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:56.710359 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ea509c-bc9d-4700-87db-8b35be286832 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:56.710638 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ea509c-bc9d-4700-87db-8b35be286832 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:56.710906 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ea509c-bc9d-4700-87db-8b35be286832 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:56.719479 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ea509c-bc9d-4700-87db-8b35be286832 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:56.720952 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ea509c-bc9d-4700-87db-8b35be286832 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:56.733678 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application [None req-a5ea509c-bc9d-4700-87db-8b35be286832 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 05 12:03:56.733678 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:03:56.733678 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:03:56.733678 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:03:56.733678 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:03:56.733678 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:03:56.733678 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:03:56.733678 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:03:56.733678 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:03:56.733678 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:03:56.733678 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:03:56.733678 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:03:56.733678 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 12:03:56.733678 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 12:03:56.733678 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 12:03:56.733678 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 12:03:56.734908 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:03:56.734908 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:03:56.734908 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 12:03:56.734908 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:03:56.734908 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 12:03:56.734908 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:03:56.734908 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:03:56.734908 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:03:56.734908 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:03:56.734908 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:03:56.734908 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:03:56.734908 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application with Lock( Sep 05 12:03:56.734908 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:03:56.734908 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:03:56.734908 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:03:56.734908 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:03:56.734908 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:03:56.734908 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:03:56.736087 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:03:56.736087 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:03:56.736087 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 12:03:56.736087 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 12:03:56.736087 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 12:03:56.736087 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 12:03:56.736087 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 12:03:56.736087 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 12:03:56.736087 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 05 12:03:56.736087 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:03:56.739576 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 301/596] 10.222.0.50 () {56 vars in 1102 bytes} [Mon Sep 5 12:03:56 2022] GET /identity/v3/users/neutron => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:03:56.740401 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ea509c-bc9d-4700-87db-8b35be286832 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:56.772136 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f034b25-fd71-4525-9a46-761de311dd92 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:56.799347 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:56.829400 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab76d9c0-372f-43eb-be9d-7c3dd70d89ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:56.830615 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab76d9c0-372f-43eb-be9d-7c3dd70d89ab None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:56.832015 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab76d9c0-372f-43eb-be9d-7c3dd70d89ab None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:56.832015 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab76d9c0-372f-43eb-be9d-7c3dd70d89ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:56.851883 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab76d9c0-372f-43eb-be9d-7c3dd70d89ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:56.855196 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab76d9c0-372f-43eb-be9d-7c3dd70d89ab None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:56.869135 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ea509c-bc9d-4700-87db-8b35be286832 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:56.882507 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-ab76d9c0-372f-43eb-be9d-7c3dd70d89ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:03:56.882507 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:03:56.882507 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:03:56.882507 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:03:56.882507 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:03:56.882507 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:03:56.882507 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:03:56.882507 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:03:56.882507 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:03:56.882507 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:03:56.882507 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:03:56.882507 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:03:56.882507 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:03:56.882507 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:03:56.882507 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:03:56.882507 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:03:56.884317 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:03:56.884317 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:03:56.884317 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:03:56.884317 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:03:56.884317 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:03:56.884317 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:03:56.884317 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:03:56.884317 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:03:56.884317 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:03:56.884317 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:03:56.884317 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:03:56.884317 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:03:56.884317 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:03:56.884317 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:03:56.884317 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:03:56.884317 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:03:56.884317 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:03:56.886074 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:03:56.886074 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:03:56.886074 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:03:56.893005 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 296/597] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 5 12:03:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:03:56.893005 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8af8c9-7de0-43d4-a38b-fbcbabe1bb5c None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:56.893005 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8af8c9-7de0-43d4-a38b-fbcbabe1bb5c None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:56.893005 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8af8c9-7de0-43d4-a38b-fbcbabe1bb5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:56.904547 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:56.923605 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-4f8af8c9-7de0-43d4-a38b-fbcbabe1bb5c None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:03:56.925600 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-4f8af8c9-7de0-43d4-a38b-fbcbabe1bb5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:03:56.928988 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f882be-afb2-4614-8b39-bd14ae9f617b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:56.930567 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f882be-afb2-4614-8b39-bd14ae9f617b None admin] REQUEST_METHOD: `PUT` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:56.930964 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f882be-afb2-4614-8b39-bd14ae9f617b None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:56.931326 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f882be-afb2-4614-8b39-bd14ae9f617b None admin] PATH_INFO: `/v3/projects/ae4f8939fcc040bca99783a77e6ede4d/users/37633bbae0c2423c81ccd61ac3a17ccf/roles/fe10209913504171981606bfdf25a9bb` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:56.955597 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f882be-afb2-4614-8b39-bd14ae9f617b None admin] RBAC: Authorizing `identity:create_grant(project_id=ae4f8939fcc040bca99783a77e6ede4d, user_id=37633bbae0c2423c81ccd61ac3a17ccf, role_id=fe10209913504171981606bfdf25a9bb)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:56.957346 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f882be-afb2-4614-8b39-bd14ae9f617b None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:56.989126 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 302/598] 10.222.0.50 () {58 vars in 1439 bytes} [Mon Sep 5 12:03:56 2022] PUT /identity/v3/projects/ae4f8939fcc040bca99783a77e6ede4d/users/37633bbae0c2423c81ccd61ac3a17ccf/roles/fe10209913504171981606bfdf25a9bb => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:03:56.990133 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f882be-afb2-4614-8b39-bd14ae9f617b None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:57.052685 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 297/599] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:03:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:03:57.054974 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8af8c9-7de0-43d4-a38b-fbcbabe1bb5c None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:57.228057 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8af8c9-7de0-43d4-a38b-fbcbabe1bb5c None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:57.262178 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:57.280843 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f882be-afb2-4614-8b39-bd14ae9f617b None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:57.286931 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:57.293988 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b494e58f-47ba-4f3b-bc4d-63af97b0eaef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:57.294988 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b494e58f-47ba-4f3b-bc4d-63af97b0eaef None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:57.295661 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b494e58f-47ba-4f3b-bc4d-63af97b0eaef None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:57.296437 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b494e58f-47ba-4f3b-bc4d-63af97b0eaef None admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:57.297777 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b494e58f-47ba-4f3b-bc4d-63af97b0eaef None admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:03:57.298381 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b494e58f-47ba-4f3b-bc4d-63af97b0eaef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:57.301253 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b494e58f-47ba-4f3b-bc4d-63af97b0eaef None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:57.328377 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6b0614-5bd8-481c-8f7b-27ccd8f81330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:57.329391 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6b0614-5bd8-481c-8f7b-27ccd8f81330 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:57.329815 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6b0614-5bd8-481c-8f7b-27ccd8f81330 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:57.330246 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6b0614-5bd8-481c-8f7b-27ccd8f81330 None admin] PATH_INFO: `/v3/users` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:57.331475 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6b0614-5bd8-481c-8f7b-27ccd8f81330 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:03:57.332001 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6b0614-5bd8-481c-8f7b-27ccd8f81330 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:57.333676 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6b0614-5bd8-481c-8f7b-27ccd8f81330 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:57.334765 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 298/600] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 5 12:03:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:57.344931 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b494e58f-47ba-4f3b-bc4d-63af97b0eaef None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:57.361609 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 303/601] 10.222.0.50 () {56 vars in 1139 bytes} [Mon Sep 5 12:03:56 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:57.363247 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6b0614-5bd8-481c-8f7b-27ccd8f81330 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:57.480963 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6b0614-5bd8-481c-8f7b-27ccd8f81330 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:57.522092 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a8b165-50a8-4c2e-a362-ab1dd69c1714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:57.523653 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a8b165-50a8-4c2e-a362-ab1dd69c1714 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:57.524292 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a8b165-50a8-4c2e-a362-ab1dd69c1714 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:57.524767 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a8b165-50a8-4c2e-a362-ab1dd69c1714 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:57.539394 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a8b165-50a8-4c2e-a362-ab1dd69c1714 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:57.541689 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a8b165-50a8-4c2e-a362-ab1dd69c1714 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:57.553556 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:57.563046 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application [None req-29a8b165-50a8-4c2e-a362-ab1dd69c1714 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:03:57.563046 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:03:57.563046 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:03:57.563046 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:03:57.563046 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:03:57.563046 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:03:57.563046 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:03:57.563046 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:03:57.563046 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:03:57.563046 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:03:57.563046 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:03:57.563046 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:03:57.563046 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:03:57.563046 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:03:57.563046 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:03:57.563046 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:03:57.564258 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:03:57.564258 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:03:57.564258 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:03:57.564258 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:03:57.564258 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:03:57.564258 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:03:57.564258 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:03:57.564258 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application with Lock( Sep 05 12:03:57.564258 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:03:57.564258 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:03:57.564258 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:03:57.564258 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:03:57.564258 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:03:57.564258 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:03:57.564258 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:03:57.564258 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:03:57.564258 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:03:57.565353 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:03:57.565353 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:03:57.565353 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:03:57.571265 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 304/602] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 5 12:03:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 12:03:57.574971 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a8b165-50a8-4c2e-a362-ab1dd69c1714 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:57.649185 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b494e58f-47ba-4f3b-bc4d-63af97b0eaef None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:57.696072 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cff69b9-8a1b-495f-a3f6-e0a39804ab5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:57.697463 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cff69b9-8a1b-495f-a3f6-e0a39804ab5c None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:57.698796 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cff69b9-8a1b-495f-a3f6-e0a39804ab5c None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:57.699352 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cff69b9-8a1b-495f-a3f6-e0a39804ab5c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:57.706484 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a8b165-50a8-4c2e-a362-ab1dd69c1714 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:57.711722 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cff69b9-8a1b-495f-a3f6-e0a39804ab5c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:57.713426 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cff69b9-8a1b-495f-a3f6-e0a39804ab5c None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:57.729759 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-6cff69b9-8a1b-495f-a3f6-e0a39804ab5c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:03:57.729759 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:03:57.729759 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:03:57.729759 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:03:57.729759 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:03:57.729759 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:03:57.729759 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:03:57.729759 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:03:57.729759 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:03:57.729759 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:03:57.729759 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:03:57.729759 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:03:57.729759 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 12:03:57.729759 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 12:03:57.729759 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 12:03:57.731620 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 12:03:57.731620 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:03:57.731620 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:03:57.731620 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:03:57.731620 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:03:57.731620 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:03:57.731620 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:03:57.731620 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:03:57.731620 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:03:57.731620 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:03:57.731620 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:03:57.731620 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:03:57.731620 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:03:57.731620 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:03:57.731620 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:03:57.731620 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:03:57.731620 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:03:57.733601 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 12:03:57.733601 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 12:03:57.733601 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 12:03:57.733601 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 12:03:57.733601 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 12:03:57.733601 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 12:03:57.733601 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:03:57.733601 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:03:57.737465 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 299/603] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Sep 5 12:03:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 388 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 12:03:57.738509 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cff69b9-8a1b-495f-a3f6-e0a39804ab5c None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:57.771968 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be290284-447e-4c74-987d-e3ef7636030a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:57.773957 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be290284-447e-4c74-987d-e3ef7636030a None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:57.774564 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be290284-447e-4c74-987d-e3ef7636030a None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:57.775616 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be290284-447e-4c74-987d-e3ef7636030a None admin] PATH_INFO: `/v3/domains` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:57.777868 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be290284-447e-4c74-987d-e3ef7636030a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:03:57.778351 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be290284-447e-4c74-987d-e3ef7636030a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:57.781194 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be290284-447e-4c74-987d-e3ef7636030a None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:57.803723 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 305/604] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 5 12:03:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:03:57.803723 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be290284-447e-4c74-987d-e3ef7636030a None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:57.828614 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:57.878665 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:57.890189 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cff69b9-8a1b-495f-a3f6-e0a39804ab5c None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:57.924425 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be290284-447e-4c74-987d-e3ef7636030a None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:57.932621 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4867d26-7d5c-461b-88e9-5890ee0e8c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:57.934313 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4867d26-7d5c-461b-88e9-5890ee0e8c3e None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:57.934829 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4867d26-7d5c-461b-88e9-5890ee0e8c3e None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:57.935673 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4867d26-7d5c-461b-88e9-5890ee0e8c3e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:57.956199 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4867d26-7d5c-461b-88e9-5890ee0e8c3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:03:57.962022 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fef4ec-2fd0-429c-b8fd-58d4cc240fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:57.962726 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fef4ec-2fd0-429c-b8fd-58d4cc240fea None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:57.963076 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fef4ec-2fd0-429c-b8fd-58d4cc240fea None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:57.963410 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fef4ec-2fd0-429c-b8fd-58d4cc240fea None admin] PATH_INFO: `/v3/projects` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:57.963711 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-b4867d26-7d5c-461b-88e9-5890ee0e8c3e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 05 12:03:57.963711 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:03:57.963711 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:03:57.963711 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:03:57.963711 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:03:57.963711 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:03:57.963711 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:03:57.963711 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:03:57.963711 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:03:57.963711 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:03:57.963711 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:03:57.963711 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:03:57.963711 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:03:57.963711 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:03:57.963711 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:03:57.963711 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:03:57.964852 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:03:57.964852 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:03:57.964852 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:03:57.964852 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:03:57.964852 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:03:57.964852 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:03:57.964852 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:03:57.964852 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:03:57.964852 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:03:57.964852 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:03:57.964852 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:03:57.964852 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:03:57.964852 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:03:57.964852 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:03:57.964852 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:03:57.964852 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:03:57.966578 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:03:57.966578 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:03:57.966578 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:03:57.966578 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:03:57.966578 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:03:57.966578 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:03:57.966578 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:03:57.966578 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:03:57.966578 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:03:57.966578 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:03:57.966578 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 05 12:03:57.966578 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:03:57.967516 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fef4ec-2fd0-429c-b8fd-58d4cc240fea None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:03:57.967516 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fef4ec-2fd0-429c-b8fd-58d4cc240fea None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:57.968324 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fef4ec-2fd0-429c-b8fd-58d4cc240fea None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:57.970230 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 300/605] 10.222.0.50 () {56 vars in 1102 bytes} [Mon Sep 5 12:03:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:03:57.971687 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4867d26-7d5c-461b-88e9-5890ee0e8c3e None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:57.987291 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 306/606] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Sep 5 12:03:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:57.988452 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fef4ec-2fd0-429c-b8fd-58d4cc240fea None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:58.099539 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fef4ec-2fd0-429c-b8fd-58d4cc240fea None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:58.122815 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:58.129509 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4867d26-7d5c-461b-88e9-5890ee0e8c3e None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:58.142560 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd579d1-3956-44ce-bb05-7a39ef615b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:58.143752 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd579d1-3956-44ce-bb05-7a39ef615b76 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:58.144134 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd579d1-3956-44ce-bb05-7a39ef615b76 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:58.144503 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd579d1-3956-44ce-bb05-7a39ef615b76 None admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:58.145359 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd579d1-3956-44ce-bb05-7a39ef615b76 None admin] RBAC: Adding query filter params (name=service) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:03:58.145750 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd579d1-3956-44ce-bb05-7a39ef615b76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:58.145994 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:58.147528 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd579d1-3956-44ce-bb05-7a39ef615b76 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:58.159207 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 307/607] 10.222.0.50 () {56 vars in 1103 bytes} [Mon Sep 5 12:03:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:58.160168 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd579d1-3956-44ce-bb05-7a39ef615b76 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:58.173286 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe9c518-86fb-445b-9aa9-d8d62282a787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:58.174217 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe9c518-86fb-445b-9aa9-d8d62282a787 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:58.174702 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe9c518-86fb-445b-9aa9-d8d62282a787 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:58.175186 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe9c518-86fb-445b-9aa9-d8d62282a787 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:58.184099 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe9c518-86fb-445b-9aa9-d8d62282a787 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:58.186066 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe9c518-86fb-445b-9aa9-d8d62282a787 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:58.198464 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-ebe9c518-86fb-445b-9aa9-d8d62282a787 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:03:58.198464 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:03:58.198464 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:03:58.198464 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:03:58.198464 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:03:58.198464 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:03:58.198464 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:03:58.198464 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:03:58.198464 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:03:58.198464 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:03:58.198464 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:03:58.198464 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:03:58.198464 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 12:03:58.198464 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 12:03:58.198464 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 12:03:58.199445 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 12:03:58.199445 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:03:58.199445 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:03:58.199445 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:03:58.199445 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:03:58.199445 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:03:58.199445 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:03:58.199445 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:03:58.199445 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:03:58.199445 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:03:58.199445 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:03:58.199445 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:03:58.199445 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:03:58.199445 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:03:58.199445 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:03:58.199445 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:03:58.199445 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:03:58.200438 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 12:03:58.200438 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 12:03:58.200438 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 12:03:58.200438 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 12:03:58.200438 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 12:03:58.200438 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 12:03:58.200438 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:03:58.200438 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:03:58.204251 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 301/608] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Sep 5 12:03:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:03:58.205521 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2455fe32-0304-47fb-af2d-35c6f003e40f None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:58.205821 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2455fe32-0304-47fb-af2d-35c6f003e40f None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:58.206102 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2455fe32-0304-47fb-af2d-35c6f003e40f None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:58.207547 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 302/609] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:03:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:03:58.208379 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2455fe32-0304-47fb-af2d-35c6f003e40f None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:58.311237 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd579d1-3956-44ce-bb05-7a39ef615b76 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:58.322762 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2455fe32-0304-47fb-af2d-35c6f003e40f None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:58.361046 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfb83f8-a79f-4a41-82eb-ee7bc15dfec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:58.361686 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfb83f8-a79f-4a41-82eb-ee7bc15dfec4 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:58.361968 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfb83f8-a79f-4a41-82eb-ee7bc15dfec4 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:58.362243 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfb83f8-a79f-4a41-82eb-ee7bc15dfec4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:58.366262 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467fdc4c-0512-4e7f-9e0b-216be71cc665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:58.366955 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467fdc4c-0512-4e7f-9e0b-216be71cc665 None admin] REQUEST_METHOD: `PUT` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:58.367236 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467fdc4c-0512-4e7f-9e0b-216be71cc665 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:58.367512 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467fdc4c-0512-4e7f-9e0b-216be71cc665 None admin] PATH_INFO: `/v3/projects/ae4f8939fcc040bca99783a77e6ede4d/users/cb060ff495bc4abb83ff88992fb7be09/roles/fe10209913504171981606bfdf25a9bb` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:58.376165 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfb83f8-a79f-4a41-82eb-ee7bc15dfec4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:58.377679 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfb83f8-a79f-4a41-82eb-ee7bc15dfec4 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:58.384537 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467fdc4c-0512-4e7f-9e0b-216be71cc665 None admin] RBAC: Authorizing `identity:create_grant(project_id=ae4f8939fcc040bca99783a77e6ede4d, user_id=cb060ff495bc4abb83ff88992fb7be09, role_id=fe10209913504171981606bfdf25a9bb)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:58.386089 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467fdc4c-0512-4e7f-9e0b-216be71cc665 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:58.393936 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-0bfb83f8-a79f-4a41-82eb-ee7bc15dfec4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:03:58.393936 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:03:58.393936 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:03:58.393936 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:03:58.393936 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:03:58.393936 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:03:58.393936 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:03:58.393936 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:03:58.393936 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:03:58.393936 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:03:58.393936 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:03:58.393936 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:03:58.393936 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:03:58.393936 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:03:58.393936 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:03:58.393936 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:03:58.394956 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:03:58.394956 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:03:58.394956 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:03:58.394956 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:03:58.394956 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:03:58.394956 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:03:58.394956 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:03:58.394956 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:03:58.394956 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:03:58.394956 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:03:58.394956 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:03:58.394956 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:03:58.394956 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:03:58.394956 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:03:58.394956 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:03:58.394956 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:03:58.394956 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:03:58.402208 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:03:58.402208 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:03:58.402208 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:03:58.402208 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 303/610] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 5 12:03:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:03:58.402208 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfb83f8-a79f-4a41-82eb-ee7bc15dfec4 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:58.408762 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 308/611] 10.222.0.50 () {58 vars in 1439 bytes} [Mon Sep 5 12:03:58 2022] PUT /identity/v3/projects/ae4f8939fcc040bca99783a77e6ede4d/users/cb060ff495bc4abb83ff88992fb7be09/roles/fe10209913504171981606bfdf25a9bb => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:03:58.410197 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d170422e-f9e2-4099-94ff-4ee7b9364304 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:58.410605 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d170422e-f9e2-4099-94ff-4ee7b9364304 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:58.410948 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d170422e-f9e2-4099-94ff-4ee7b9364304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:58.431989 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-d170422e-f9e2-4099-94ff-4ee7b9364304 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:03:58.433569 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-d170422e-f9e2-4099-94ff-4ee7b9364304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:03:58.442792 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:58.469660 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:58.532925 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 309/612] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:03:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:03:58.532925 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d170422e-f9e2-4099-94ff-4ee7b9364304 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:58.581709 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfb83f8-a79f-4a41-82eb-ee7bc15dfec4 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:58.629669 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddfe955-7dc1-47c6-81d3-51e5e018235e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:58.630366 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddfe955-7dc1-47c6-81d3-51e5e018235e None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:58.630824 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddfe955-7dc1-47c6-81d3-51e5e018235e None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:58.631274 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddfe955-7dc1-47c6-81d3-51e5e018235e None admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:58.632526 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddfe955-7dc1-47c6-81d3-51e5e018235e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:03:58.633091 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddfe955-7dc1-47c6-81d3-51e5e018235e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:58.637103 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddfe955-7dc1-47c6-81d3-51e5e018235e None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:58.671275 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 304/613] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Sep 5 12:03:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:58.679033 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddfe955-7dc1-47c6-81d3-51e5e018235e None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:58.680323 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d170422e-f9e2-4099-94ff-4ee7b9364304 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:58.762006 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda2efe8-3fe3-4799-8e70-e76bdfe48d40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:58.762680 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda2efe8-3fe3-4799-8e70-e76bdfe48d40 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:58.762968 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda2efe8-3fe3-4799-8e70-e76bdfe48d40 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:58.763245 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda2efe8-3fe3-4799-8e70-e76bdfe48d40 None admin] PATH_INFO: `/v3/domains` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:58.763920 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda2efe8-3fe3-4799-8e70-e76bdfe48d40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:03:58.764268 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda2efe8-3fe3-4799-8e70-e76bdfe48d40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:58.765727 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda2efe8-3fe3-4799-8e70-e76bdfe48d40 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:58.799534 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 310/614] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 5 12:03:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:58.811035 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda2efe8-3fe3-4799-8e70-e76bdfe48d40 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:58.893503 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:58.895994 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:58.938530 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddfe955-7dc1-47c6-81d3-51e5e018235e None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:59.003400 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b47770-7a49-40ba-811e-deec0c21d88c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:59.004242 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b47770-7a49-40ba-811e-deec0c21d88c None admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:59.004623 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b47770-7a49-40ba-811e-deec0c21d88c None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:59.005092 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b47770-7a49-40ba-811e-deec0c21d88c None admin] PATH_INFO: `/v3/projects/ae4f8939fcc040bca99783a77e6ede4d/users/4994b4faa4ec4aa088f3dc32c9c5614d/roles/fe10209913504171981606bfdf25a9bb` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:59.025164 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b47770-7a49-40ba-811e-deec0c21d88c None admin] RBAC: Authorizing `identity:create_grant(project_id=ae4f8939fcc040bca99783a77e6ede4d, user_id=4994b4faa4ec4aa088f3dc32c9c5614d, role_id=fe10209913504171981606bfdf25a9bb)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:59.027423 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b47770-7a49-40ba-811e-deec0c21d88c None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:59.051637 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 305/615] 10.222.0.50 () {58 vars in 1439 bytes} [Mon Sep 5 12:03:58 2022] PUT /identity/v3/projects/ae4f8939fcc040bca99783a77e6ede4d/users/4994b4faa4ec4aa088f3dc32c9c5614d/roles/fe10209913504171981606bfdf25a9bb => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:03:59.053645 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b47770-7a49-40ba-811e-deec0c21d88c None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:59.119708 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda2efe8-3fe3-4799-8e70-e76bdfe48d40 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:59.235068 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1098365-c70d-45fe-8e12-3c4639846cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:59.235968 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1098365-c70d-45fe-8e12-3c4639846cb9 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:59.236414 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1098365-c70d-45fe-8e12-3c4639846cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:59.236849 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1098365-c70d-45fe-8e12-3c4639846cb9 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:59.256580 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1098365-c70d-45fe-8e12-3c4639846cb9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:59.260009 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1098365-c70d-45fe-8e12-3c4639846cb9 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:59.286676 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application [None req-a1098365-c70d-45fe-8e12-3c4639846cb9 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 05 12:03:59.286676 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:03:59.286676 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:03:59.286676 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:03:59.286676 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:03:59.286676 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:03:59.286676 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:03:59.286676 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:03:59.286676 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:03:59.286676 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:03:59.286676 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:03:59.286676 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:03:59.286676 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 12:03:59.286676 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 12:03:59.286676 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 12:03:59.286676 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 12:03:59.287724 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:03:59.287724 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:03:59.287724 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 12:03:59.287724 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:03:59.287724 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 12:03:59.287724 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:03:59.287724 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:03:59.287724 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:03:59.287724 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:03:59.287724 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:03:59.287724 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:03:59.287724 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application with Lock( Sep 05 12:03:59.287724 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:03:59.287724 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:03:59.287724 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:03:59.287724 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:03:59.287724 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:03:59.287724 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:03:59.289240 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:03:59.289240 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:03:59.289240 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 12:03:59.289240 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 12:03:59.289240 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 12:03:59.289240 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 12:03:59.289240 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 12:03:59.289240 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 12:03:59.289240 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 05 12:03:59.289240 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:03:59.289240 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 311/616] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Sep 5 12:03:58 2022] GET /identity/v3/users/glance => generated 84 bytes in 479 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:03:59.297758 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1098365-c70d-45fe-8e12-3c4639846cb9 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:59.312462 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b47770-7a49-40ba-811e-deec0c21d88c None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:59.361221 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803f3e66-dd9f-44e3-8b26-42205d819f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:59.362643 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803f3e66-dd9f-44e3-8b26-42205d819f87 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:59.363154 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803f3e66-dd9f-44e3-8b26-42205d819f87 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:59.363635 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803f3e66-dd9f-44e3-8b26-42205d819f87 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:59.367289 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:59.383905 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803f3e66-dd9f-44e3-8b26-42205d819f87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:03:59.391531 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-803f3e66-dd9f-44e3-8b26-42205d819f87 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 05 12:03:59.391531 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:03:59.391531 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:03:59.391531 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:03:59.391531 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:03:59.391531 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:03:59.391531 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:03:59.391531 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:03:59.391531 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:03:59.391531 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:03:59.391531 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:03:59.391531 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:03:59.391531 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:03:59.391531 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:03:59.391531 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:03:59.391531 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:03:59.392539 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:03:59.392539 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:03:59.392539 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:03:59.392539 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:03:59.392539 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:03:59.392539 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:03:59.392539 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:03:59.392539 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:03:59.392539 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:03:59.392539 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:03:59.392539 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:03:59.392539 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:03:59.392539 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:03:59.392539 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:03:59.392539 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:03:59.392539 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:03:59.393431 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:03:59.393431 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:03:59.393431 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:03:59.393431 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:03:59.393431 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:03:59.393431 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:03:59.393431 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:03:59.393431 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:03:59.393431 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:03:59.393431 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:03:59.393431 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 05 12:03:59.393431 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:03:59.403761 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 306/617] 10.222.0.50 () {56 vars in 1102 bytes} [Mon Sep 5 12:03:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:03:59.410437 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803f3e66-dd9f-44e3-8b26-42205d819f87 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:59.507519 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:59.569193 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1098365-c70d-45fe-8e12-3c4639846cb9 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:59.635491 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803f3e66-dd9f-44e3-8b26-42205d819f87 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:59.683424 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0ba217-0f3c-4f4d-abdc-81d757fc8f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:59.684918 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0ba217-0f3c-4f4d-abdc-81d757fc8f37 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:59.685633 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0ba217-0f3c-4f4d-abdc-81d757fc8f37 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:59.686227 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0ba217-0f3c-4f4d-abdc-81d757fc8f37 None admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:59.687137 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0ba217-0f3c-4f4d-abdc-81d757fc8f37 None admin] RBAC: Adding query filter params (name=service) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:03:59.687972 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0ba217-0f3c-4f4d-abdc-81d757fc8f37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:59.689699 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0ba217-0f3c-4f4d-abdc-81d757fc8f37 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:59.701281 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 307/618] 10.222.0.50 () {56 vars in 1103 bytes} [Mon Sep 5 12:03:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:03:59.710967 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0ba217-0f3c-4f4d-abdc-81d757fc8f37 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:59.716130 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dae116-1c05-446d-969a-115b792e0fe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:59.717499 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dae116-1c05-446d-969a-115b792e0fe7 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:59.719160 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dae116-1c05-446d-969a-115b792e0fe7 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:59.725989 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dae116-1c05-446d-969a-115b792e0fe7 None admin] PATH_INFO: `/v3/users` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:59.727223 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dae116-1c05-446d-969a-115b792e0fe7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:03:59.727745 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dae116-1c05-446d-969a-115b792e0fe7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:03:59.730139 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dae116-1c05-446d-969a-115b792e0fe7 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:03:59.774846 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 312/619] 10.222.0.50 () {56 vars in 1137 bytes} [Mon Sep 5 12:03:59 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 478 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:03:59.782339 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dae116-1c05-446d-969a-115b792e0fe7 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:03:59.862282 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:03:59.924701 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dae116-1c05-446d-969a-115b792e0fe7 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:03:59.967822 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4188a009-daec-4926-8648-077ec68fcb2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:03:59.968807 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4188a009-daec-4926-8648-077ec68fcb2f None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:03:59.969332 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4188a009-daec-4926-8648-077ec68fcb2f None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:03:59.969835 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4188a009-daec-4926-8648-077ec68fcb2f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:03:59.984208 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:00.003661 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0ba217-0f3c-4f4d-abdc-81d757fc8f37 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:00.083908 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9eb47b-3495-4a8b-babd-edd556a73450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:00.086582 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9eb47b-3495-4a8b-babd-edd556a73450 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:00.087367 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9eb47b-3495-4a8b-babd-edd556a73450 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:00.090122 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9eb47b-3495-4a8b-babd-edd556a73450 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:00.115752 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9eb47b-3495-4a8b-babd-edd556a73450 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:00.119091 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9eb47b-3495-4a8b-babd-edd556a73450 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:00.142793 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-7d9eb47b-3495-4a8b-babd-edd556a73450 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:04:00.142793 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:00.142793 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:04:00.142793 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:04:00.142793 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:04:00.142793 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:04:00.142793 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:04:00.142793 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:04:00.142793 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:04:00.142793 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:04:00.142793 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:04:00.142793 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:04:00.142793 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:04:00.142793 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:04:00.142793 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:04:00.142793 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:04:00.143871 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:04:00.143871 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:04:00.143871 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:04:00.143871 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:04:00.143871 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:04:00.143871 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:04:00.143871 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:04:00.143871 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:04:00.143871 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:04:00.143871 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:04:00.143871 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:04:00.143871 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:04:00.143871 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:04:00.143871 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:04:00.143871 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:04:00.143871 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:04:00.143871 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:04:00.144888 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:04:00.144888 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:04:00.144888 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:04:00.145095 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4188a009-daec-4926-8648-077ec68fcb2f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:00.145866 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4188a009-daec-4926-8648-077ec68fcb2f None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:00.147564 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 308/620] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 5 12:03:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 437 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 12:04:00.154765 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9eb47b-3495-4a8b-babd-edd556a73450 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:00.289805 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 313/621] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Sep 5 12:03:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 508 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 05 12:04:00.291602 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8006a510-113c-489c-b5f7-05b38045154d None None] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:00.292081 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8006a510-113c-489c-b5f7-05b38045154d None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:00.292478 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8006a510-113c-489c-b5f7-05b38045154d None None] PATH_INFO: `/` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:00.298363 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 314/622] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:04:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:04:00.299446 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8006a510-113c-489c-b5f7-05b38045154d None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:00.304761 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9eb47b-3495-4a8b-babd-edd556a73450 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:00.317743 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:00.356316 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:00.357564 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c913db58-2e83-4c63-93a3-046e5bfb7c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:00.358282 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c913db58-2e83-4c63-93a3-046e5bfb7c4f None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:00.358912 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c913db58-2e83-4c63-93a3-046e5bfb7c4f None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:00.359035 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c913db58-2e83-4c63-93a3-046e5bfb7c4f None admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:00.359687 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c913db58-2e83-4c63-93a3-046e5bfb7c4f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:00.360068 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c913db58-2e83-4c63-93a3-046e5bfb7c4f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:00.361715 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c913db58-2e83-4c63-93a3-046e5bfb7c4f None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:00.389328 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 309/623] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 5 12:04:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:04:00.389328 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7684884-5852-4344-9733-869a985b33d0 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:00.389328 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7684884-5852-4344-9733-869a985b33d0 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:00.389328 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7684884-5852-4344-9733-869a985b33d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:00.419376 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-f7684884-5852-4344-9733-869a985b33d0 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:04:00.421900 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-f7684884-5852-4344-9733-869a985b33d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:04:00.437736 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8006a510-113c-489c-b5f7-05b38045154d None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:00.484450 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf6f74e-5d7a-4e31-9d11-97ab65c2bf7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:00.485802 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf6f74e-5d7a-4e31-9d11-97ab65c2bf7d None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:00.486552 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf6f74e-5d7a-4e31-9d11-97ab65c2bf7d None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:00.487308 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf6f74e-5d7a-4e31-9d11-97ab65c2bf7d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:00.510206 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf6f74e-5d7a-4e31-9d11-97ab65c2bf7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:00.512459 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf6f74e-5d7a-4e31-9d11-97ab65c2bf7d None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:00.528664 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 310/624] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:04:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:04:00.530053 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7684884-5852-4344-9733-869a985b33d0 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:00.539396 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application [None req-4bf6f74e-5d7a-4e31-9d11-97ab65c2bf7d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:04:00.539396 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:00.539396 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:04:00.539396 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:04:00.539396 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:04:00.539396 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:04:00.539396 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:04:00.539396 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:04:00.539396 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:04:00.539396 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:04:00.539396 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:04:00.539396 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:04:00.539396 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:04:00.539396 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:04:00.539396 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:04:00.539396 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:04:00.541419 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:04:00.541419 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:04:00.541419 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:04:00.541419 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:04:00.541419 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:04:00.541419 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:04:00.541419 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:04:00.541419 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application with Lock( Sep 05 12:04:00.541419 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:04:00.541419 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:04:00.541419 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:04:00.541419 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:04:00.541419 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:04:00.541419 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:04:00.541419 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:04:00.541419 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:04:00.541419 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:04:00.543383 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:04:00.543383 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:04:00.543383 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:04:00.543383 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 315/625] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 5 12:04:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:04:00.550377 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf6f74e-5d7a-4e31-9d11-97ab65c2bf7d None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:00.665388 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:00.673055 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7684884-5852-4344-9733-869a985b33d0 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:00.707414 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf6f74e-5d7a-4e31-9d11-97ab65c2bf7d None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:00.709305 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:00.722635 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115167eb-eb88-4e63-b8dd-e2afab22a057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:00.723749 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115167eb-eb88-4e63-b8dd-e2afab22a057 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:00.724108 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115167eb-eb88-4e63-b8dd-e2afab22a057 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:00.724603 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115167eb-eb88-4e63-b8dd-e2afab22a057 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:00.738231 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115167eb-eb88-4e63-b8dd-e2afab22a057 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:00.740659 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115167eb-eb88-4e63-b8dd-e2afab22a057 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:00.750743 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a62bfb2-2418-43ce-ae52-11606715ce95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:00.751444 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a62bfb2-2418-43ce-ae52-11606715ce95 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:00.751791 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a62bfb2-2418-43ce-ae52-11606715ce95 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:00.752131 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a62bfb2-2418-43ce-ae52-11606715ce95 None admin] PATH_INFO: `/v3/domains` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:00.752928 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a62bfb2-2418-43ce-ae52-11606715ce95 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:00.753322 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a62bfb2-2418-43ce-ae52-11606715ce95 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:00.754832 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a62bfb2-2418-43ce-ae52-11606715ce95 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:00.756138 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-115167eb-eb88-4e63-b8dd-e2afab22a057 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 05 12:04:00.756138 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:00.756138 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:04:00.756138 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:04:00.756138 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:04:00.756138 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:04:00.756138 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:04:00.756138 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:04:00.756138 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:04:00.756138 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:04:00.756138 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:04:00.756138 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:04:00.756138 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 12:04:00.756138 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 12:04:00.756138 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 12:04:00.756138 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 12:04:00.757317 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:04:00.757317 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:04:00.757317 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 12:04:00.757317 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:04:00.757317 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 12:04:00.757317 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:04:00.757317 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:04:00.757317 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:04:00.757317 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:04:00.757317 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:04:00.757317 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:04:00.757317 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:04:00.757317 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:04:00.757317 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:04:00.757317 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:04:00.757317 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:04:00.757317 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:04:00.757317 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:04:00.758477 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:04:00.758477 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:04:00.758477 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 12:04:00.758477 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 12:04:00.758477 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 12:04:00.758477 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 12:04:00.758477 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 12:04:00.758477 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 12:04:00.758477 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 05 12:04:00.758477 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:04:00.765127 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 311/626] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Sep 5 12:04:00 2022] GET /identity/v3/users/swift => generated 83 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:04:00.766760 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef22a38a-2265-4fad-bd7e-6eb55618c0da None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:00.767046 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef22a38a-2265-4fad-bd7e-6eb55618c0da None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:00.767322 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef22a38a-2265-4fad-bd7e-6eb55618c0da None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:00.771165 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 312/627] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:04:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:04:00.771165 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef22a38a-2265-4fad-bd7e-6eb55618c0da None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:00.785698 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 316/628] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 5 12:04:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:04:00.787455 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cc2c00-ecca-4180-bb11-1736927e7119 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:00.787904 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cc2c00-ecca-4180-bb11-1736927e7119 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:00.788334 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cc2c00-ecca-4180-bb11-1736927e7119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:00.813654 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-b3cc2c00-ecca-4180-bb11-1736927e7119 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:04:00.815519 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-b3cc2c00-ecca-4180-bb11-1736927e7119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:04:00.899363 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 317/629] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:04:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:04:00.900492 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cc2c00-ecca-4180-bb11-1736927e7119 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:00.933891 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef22a38a-2265-4fad-bd7e-6eb55618c0da None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:00.975057 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff7cf8c-5b1d-49b7-90fc-977a66401356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:00.975780 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff7cf8c-5b1d-49b7-90fc-977a66401356 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:00.976198 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff7cf8c-5b1d-49b7-90fc-977a66401356 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:00.976610 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff7cf8c-5b1d-49b7-90fc-977a66401356 None admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:00.977779 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff7cf8c-5b1d-49b7-90fc-977a66401356 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:00.978198 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff7cf8c-5b1d-49b7-90fc-977a66401356 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:00.979970 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff7cf8c-5b1d-49b7-90fc-977a66401356 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:01.009525 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:01.018049 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 313/630] 10.222.0.50 () {56 vars in 1135 bytes} [Mon Sep 5 12:04:00 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:04:01.018049 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff7cf8c-5b1d-49b7-90fc-977a66401356 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:01.041594 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cc2c00-ecca-4180-bb11-1736927e7119 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:01.052239 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:01.084259 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26fead9-e9f5-40fe-bec8-aabe5ad1f01f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:01.086231 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26fead9-e9f5-40fe-bec8-aabe5ad1f01f None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:01.086726 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26fead9-e9f5-40fe-bec8-aabe5ad1f01f None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:01.087242 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26fead9-e9f5-40fe-bec8-aabe5ad1f01f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:01.096132 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26fead9-e9f5-40fe-bec8-aabe5ad1f01f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:01.097880 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26fead9-e9f5-40fe-bec8-aabe5ad1f01f None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:01.112457 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application [None req-d26fead9-e9f5-40fe-bec8-aabe5ad1f01f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:04:01.112457 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:01.112457 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:04:01.112457 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:04:01.112457 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:04:01.112457 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:04:01.112457 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:04:01.112457 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:04:01.112457 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:04:01.112457 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:04:01.112457 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:04:01.112457 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:04:01.112457 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 12:04:01.112457 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 12:04:01.112457 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 12:04:01.113611 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 12:04:01.113611 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:04:01.113611 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:04:01.113611 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:04:01.113611 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:04:01.113611 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:04:01.113611 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:04:01.113611 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:04:01.113611 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application with Lock( Sep 05 12:04:01.113611 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:04:01.113611 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:04:01.113611 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:04:01.113611 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:04:01.113611 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:04:01.113611 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:04:01.113611 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:04:01.113611 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:04:01.114673 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 12:04:01.114673 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 12:04:01.114673 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 12:04:01.114673 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 12:04:01.114673 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 12:04:01.114673 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 12:04:01.114673 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:04:01.114673 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:04:01.117179 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 318/631] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Sep 5 12:04:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:04:01.118274 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26fead9-e9f5-40fe-bec8-aabe5ad1f01f None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:01.193884 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff7cf8c-5b1d-49b7-90fc-977a66401356 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:01.238290 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26fead9-e9f5-40fe-bec8-aabe5ad1f01f None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:01.240497 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267fe9d3-eb4a-4d6e-b0c6-42678604f469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:01.241312 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267fe9d3-eb4a-4d6e-b0c6-42678604f469 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:01.241600 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267fe9d3-eb4a-4d6e-b0c6-42678604f469 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:01.241884 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267fe9d3-eb4a-4d6e-b0c6-42678604f469 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:01.254700 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267fe9d3-eb4a-4d6e-b0c6-42678604f469 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:04:01.260172 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-267fe9d3-eb4a-4d6e-b0c6-42678604f469 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 05 12:04:01.260172 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:01.260172 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:04:01.260172 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:04:01.260172 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:04:01.260172 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:04:01.260172 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:04:01.260172 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:04:01.260172 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:04:01.260172 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:04:01.260172 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:04:01.260172 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:04:01.260172 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:04:01.260172 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:04:01.260172 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:04:01.260172 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:04:01.262355 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:04:01.262355 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:04:01.262355 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:04:01.262355 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:04:01.262355 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:04:01.262355 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:04:01.262355 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:04:01.262355 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:04:01.262355 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:04:01.262355 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:04:01.262355 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:04:01.262355 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:04:01.262355 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:04:01.262355 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:04:01.262355 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:04:01.262355 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:04:01.264343 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:04:01.264343 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:04:01.264343 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:04:01.264343 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:04:01.264343 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:04:01.264343 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:04:01.264343 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:04:01.264343 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:04:01.264343 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:04:01.264343 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:04:01.264343 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 05 12:04:01.264343 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:04:01.264343 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 314/632] 10.222.0.50 () {56 vars in 1102 bytes} [Mon Sep 5 12:04:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:04:01.264343 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267fe9d3-eb4a-4d6e-b0c6-42678604f469 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:01.283142 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16096847-d3a8-4f00-acdd-4f2ca209f9d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:01.283786 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16096847-d3a8-4f00-acdd-4f2ca209f9d1 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:01.284069 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16096847-d3a8-4f00-acdd-4f2ca209f9d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:01.284339 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16096847-d3a8-4f00-acdd-4f2ca209f9d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:01.296637 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16096847-d3a8-4f00-acdd-4f2ca209f9d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:01.298171 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16096847-d3a8-4f00-acdd-4f2ca209f9d1 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:01.300243 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:01.315371 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application [None req-16096847-d3a8-4f00-acdd-4f2ca209f9d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:04:01.315371 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:01.315371 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:04:01.315371 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:04:01.315371 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:04:01.315371 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:04:01.315371 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:04:01.315371 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:04:01.315371 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:04:01.315371 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:04:01.315371 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:04:01.315371 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:04:01.315371 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:04:01.315371 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:04:01.315371 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:04:01.315371 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:04:01.316429 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:04:01.316429 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:04:01.316429 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:04:01.316429 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:04:01.316429 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:04:01.316429 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:04:01.316429 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:04:01.316429 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application with Lock( Sep 05 12:04:01.316429 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:04:01.316429 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:04:01.316429 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:04:01.316429 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:04:01.316429 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:04:01.316429 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:04:01.316429 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:04:01.316429 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:04:01.316429 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:04:01.322344 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:04:01.322344 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:04:01.322344 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:04:01.322344 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 319/633] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 5 12:04:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:04:01.322344 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16096847-d3a8-4f00-acdd-4f2ca209f9d1 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:01.382869 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:01.410879 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267fe9d3-eb4a-4d6e-b0c6-42678604f469 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:01.442378 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16096847-d3a8-4f00-acdd-4f2ca209f9d1 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:01.446937 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b554ad8b-48b4-43c1-a178-78f159902af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:01.447479 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b554ad8b-48b4-43c1-a178-78f159902af1 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:01.447755 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b554ad8b-48b4-43c1-a178-78f159902af1 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:01.448022 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b554ad8b-48b4-43c1-a178-78f159902af1 None admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:01.449296 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b554ad8b-48b4-43c1-a178-78f159902af1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:01.449597 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b554ad8b-48b4-43c1-a178-78f159902af1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:01.451064 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b554ad8b-48b4-43c1-a178-78f159902af1 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:01.468548 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 315/634] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Sep 5 12:04:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:04:01.468548 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b554ad8b-48b4-43c1-a178-78f159902af1 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:01.484691 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc211b7-77b4-45fb-a1a4-46af9cd73b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:01.485368 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc211b7-77b4-45fb-a1a4-46af9cd73b7a None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:01.485646 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc211b7-77b4-45fb-a1a4-46af9cd73b7a None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:01.485914 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc211b7-77b4-45fb-a1a4-46af9cd73b7a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:01.500754 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc211b7-77b4-45fb-a1a4-46af9cd73b7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:04:01.506187 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application [None req-adc211b7-77b4-45fb-a1a4-46af9cd73b7a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 05 12:04:01.506187 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:01.506187 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:04:01.506187 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:04:01.506187 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:04:01.506187 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:04:01.506187 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:04:01.506187 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:04:01.506187 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:04:01.506187 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:04:01.506187 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:04:01.506187 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:04:01.506187 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:04:01.506187 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:04:01.506187 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:04:01.506187 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:04:01.507200 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:04:01.507200 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:04:01.507200 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:04:01.507200 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:04:01.507200 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:04:01.507200 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:04:01.507200 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:04:01.507200 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:04:01.507200 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:04:01.507200 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:04:01.507200 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:04:01.507200 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application with Lock( Sep 05 12:04:01.507200 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:04:01.507200 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:04:01.507200 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:04:01.507200 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:04:01.508074 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:04:01.508074 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:04:01.508074 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:04:01.508074 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:04:01.508074 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:04:01.508074 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:04:01.508074 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:04:01.508074 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:04:01.508074 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:04:01.508074 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:04:01.508074 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 05 12:04:01.508074 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:04:01.508074 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 320/635] 10.222.0.50 () {56 vars in 1102 bytes} [Mon Sep 5 12:04:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:04:01.508779 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc211b7-77b4-45fb-a1a4-46af9cd73b7a None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:01.571734 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:01.584072 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b554ad8b-48b4-43c1-a178-78f159902af1 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:01.620952 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6307be3-2454-4e03-bdcc-deee2a230f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:01.621723 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6307be3-2454-4e03-bdcc-deee2a230f6b None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:01.622123 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6307be3-2454-4e03-bdcc-deee2a230f6b None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:01.622522 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6307be3-2454-4e03-bdcc-deee2a230f6b None admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:01.623272 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6307be3-2454-4e03-bdcc-deee2a230f6b None admin] RBAC: Adding query filter params (name=service) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:01.623680 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6307be3-2454-4e03-bdcc-deee2a230f6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:01.625201 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6307be3-2454-4e03-bdcc-deee2a230f6b None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:01.625719 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc211b7-77b4-45fb-a1a4-46af9cd73b7a None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:01.629292 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:01.639031 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 316/636] 10.222.0.50 () {56 vars in 1103 bytes} [Mon Sep 5 12:04:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:04:01.640285 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6307be3-2454-4e03-bdcc-deee2a230f6b None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:01.666286 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445846b0-528d-45e7-988d-f816df2f9c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:01.667442 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445846b0-528d-45e7-988d-f816df2f9c64 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:01.667722 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445846b0-528d-45e7-988d-f816df2f9c64 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:01.667996 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445846b0-528d-45e7-988d-f816df2f9c64 None admin] PATH_INFO: `/v3/domains` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:01.668650 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445846b0-528d-45e7-988d-f816df2f9c64 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:01.668988 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445846b0-528d-45e7-988d-f816df2f9c64 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:01.670369 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445846b0-528d-45e7-988d-f816df2f9c64 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:01.683577 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 321/637] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 5 12:04:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:04:01.684722 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445846b0-528d-45e7-988d-f816df2f9c64 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:01.773423 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6307be3-2454-4e03-bdcc-deee2a230f6b None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:01.810077 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445846b0-528d-45e7-988d-f816df2f9c64 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:01.819831 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3038fa-9ea6-4d8c-b29d-c380670913ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:01.820460 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3038fa-9ea6-4d8c-b29d-c380670913ac None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:01.820726 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3038fa-9ea6-4d8c-b29d-c380670913ac None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:01.821404 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3038fa-9ea6-4d8c-b29d-c380670913ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:01.822147 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3038fa-9ea6-4d8c-b29d-c380670913ac None admin] RBAC: Adding query filter params (role.id=fe10209913504171981606bfdf25a9bb, scope.project.id=ae4f8939fcc040bca99783a77e6ede4d, user.id=b2b08e831af84a658b0f5b28ad03e4f7) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:01.822456 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3038fa-9ea6-4d8c-b29d-c380670913ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:01.823950 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3038fa-9ea6-4d8c-b29d-c380670913ac None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:01.827322 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:01.840931 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 317/638] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Sep 5 12:04:01 2022] GET /identity/v3/role_assignments?user.id=b2b08e831af84a658b0f5b28ad03e4f7&scope.project.id=ae4f8939fcc040bca99783a77e6ede4d&role.id=fe10209913504171981606bfdf25a9bb => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:04:01.840931 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3038fa-9ea6-4d8c-b29d-c380670913ac None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:01.864812 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a19209-ba6c-4a51-9fea-bb7198ecd8f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:01.865585 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a19209-ba6c-4a51-9fea-bb7198ecd8f6 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:01.865933 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a19209-ba6c-4a51-9fea-bb7198ecd8f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:01.866271 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a19209-ba6c-4a51-9fea-bb7198ecd8f6 None admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:01.867028 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a19209-ba6c-4a51-9fea-bb7198ecd8f6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:01.867512 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a19209-ba6c-4a51-9fea-bb7198ecd8f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:01.869196 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a19209-ba6c-4a51-9fea-bb7198ecd8f6 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:01.880431 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 322/639] 10.222.0.50 () {56 vars in 1103 bytes} [Mon Sep 5 12:04:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:04:01.881592 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a19209-ba6c-4a51-9fea-bb7198ecd8f6 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:01.927962 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:01.995015 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3038fa-9ea6-4d8c-b29d-c380670913ac None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:02.027853 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a19209-ba6c-4a51-9fea-bb7198ecd8f6 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:02.065346 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3009df05-9f99-4c26-8999-00e77feb5e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:02.066010 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3009df05-9f99-4c26-8999-00e77feb5e41 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:02.066450 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3009df05-9f99-4c26-8999-00e77feb5e41 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:02.066724 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3009df05-9f99-4c26-8999-00e77feb5e41 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:02.079347 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3009df05-9f99-4c26-8999-00e77feb5e41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:02.080845 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3009df05-9f99-4c26-8999-00e77feb5e41 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:02.084686 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7514b954-2dee-434a-81d5-dff6c56ab221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:02.085775 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7514b954-2dee-434a-81d5-dff6c56ab221 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:02.086216 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7514b954-2dee-434a-81d5-dff6c56ab221 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:02.086794 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7514b954-2dee-434a-81d5-dff6c56ab221 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:02.099302 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-3009df05-9f99-4c26-8999-00e77feb5e41 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:04:02.099302 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:02.099302 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:04:02.099302 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:04:02.099302 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:04:02.099302 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:04:02.099302 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:04:02.099302 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:04:02.099302 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:04:02.099302 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:04:02.099302 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:04:02.099302 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:04:02.099302 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:04:02.099302 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:04:02.099302 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:04:02.099302 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:04:02.100478 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:04:02.100478 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:04:02.100478 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:04:02.100478 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:04:02.100478 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:04:02.100478 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:04:02.100478 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:04:02.100478 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:04:02.100478 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:04:02.100478 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:04:02.100478 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:04:02.100478 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:04:02.100478 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:04:02.100478 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:04:02.100478 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:04:02.100478 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:04:02.100478 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:04:02.101437 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:04:02.101437 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:04:02.101437 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:04:02.102746 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7514b954-2dee-434a-81d5-dff6c56ab221 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:02.104216 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7514b954-2dee-434a-81d5-dff6c56ab221 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:02.106632 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 318/640] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 5 12:04:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:04:02.107336 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3009df05-9f99-4c26-8999-00e77feb5e41 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:02.120221 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application [None req-7514b954-2dee-434a-81d5-dff6c56ab221 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:04:02.120221 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:02.120221 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:04:02.120221 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:04:02.120221 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:04:02.120221 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:04:02.120221 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:04:02.120221 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:04:02.120221 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:04:02.120221 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:04:02.120221 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:04:02.120221 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:04:02.120221 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 12:04:02.120221 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 12:04:02.120221 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 12:04:02.121318 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 12:04:02.121318 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:04:02.121318 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:04:02.121318 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:04:02.121318 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:04:02.121318 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:04:02.121318 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:04:02.121318 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:04:02.121318 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application with Lock( Sep 05 12:04:02.121318 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:04:02.121318 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:04:02.121318 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:04:02.121318 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:04:02.121318 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:04:02.121318 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:04:02.121318 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:04:02.121318 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:04:02.122236 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 12:04:02.122236 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 12:04:02.122236 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 12:04:02.122236 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 12:04:02.122236 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 12:04:02.122236 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 12:04:02.122236 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:04:02.122236 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:04:02.122236 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 323/641] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Sep 5 12:04:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:04:02.122735 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7514b954-2dee-434a-81d5-dff6c56ab221 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:02.167371 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:02.257205 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7514b954-2dee-434a-81d5-dff6c56ab221 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:02.274794 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3009df05-9f99-4c26-8999-00e77feb5e41 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:02.297948 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:02.305760 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e88c7c-050a-4758-9b85-b7db739ffb7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:02.306483 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e88c7c-050a-4758-9b85-b7db739ffb7a None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:02.306838 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e88c7c-050a-4758-9b85-b7db739ffb7a None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:02.307180 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e88c7c-050a-4758-9b85-b7db739ffb7a None admin] PATH_INFO: `/v3/domains` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:02.307956 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e88c7c-050a-4758-9b85-b7db739ffb7a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:02.308331 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e88c7c-050a-4758-9b85-b7db739ffb7a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:02.309859 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e88c7c-050a-4758-9b85-b7db739ffb7a None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:02.327286 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f03b951-c094-4b03-9b35-d777426ce395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:02.328024 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f03b951-c094-4b03-9b35-d777426ce395 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:02.328373 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f03b951-c094-4b03-9b35-d777426ce395 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:02.328781 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f03b951-c094-4b03-9b35-d777426ce395 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:02.332965 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 324/642] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 5 12:04:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:04:02.334146 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e88c7c-050a-4758-9b85-b7db739ffb7a None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:02.348456 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f03b951-c094-4b03-9b35-d777426ce395 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:02.350790 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f03b951-c094-4b03-9b35-d777426ce395 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:02.371635 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-4f03b951-c094-4b03-9b35-d777426ce395 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:04:02.371635 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:02.371635 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:04:02.371635 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:04:02.371635 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:04:02.371635 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:04:02.371635 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:04:02.371635 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:04:02.371635 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:04:02.371635 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:04:02.371635 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:04:02.371635 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:04:02.371635 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:04:02.371635 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:04:02.371635 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:04:02.371635 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:04:02.372650 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:04:02.372650 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:04:02.372650 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:04:02.372650 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:04:02.372650 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:04:02.372650 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:04:02.372650 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:04:02.372650 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:04:02.372650 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:04:02.372650 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:04:02.372650 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:04:02.372650 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:04:02.372650 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:04:02.372650 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:04:02.372650 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:04:02.372650 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:04:02.372650 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:04:02.373746 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:04:02.373746 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:04:02.373746 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:04:02.373746 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 319/643] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 5 12:04:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:04:02.374359 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c311cb5-31ae-461f-8afa-c8ebcbfbe65d None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:02.374942 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c311cb5-31ae-461f-8afa-c8ebcbfbe65d None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:02.375300 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c311cb5-31ae-461f-8afa-c8ebcbfbe65d None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:02.376883 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 320/644] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:04:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:04:02.377512 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c311cb5-31ae-461f-8afa-c8ebcbfbe65d None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:02.477079 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:02.484379 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e88c7c-050a-4758-9b85-b7db739ffb7a None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:02.523514 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae0632f-42f9-4d19-8f92-84c63a5dbcc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:02.524165 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae0632f-42f9-4d19-8f92-84c63a5dbcc0 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:02.524453 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae0632f-42f9-4d19-8f92-84c63a5dbcc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:02.524759 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae0632f-42f9-4d19-8f92-84c63a5dbcc0 None admin] PATH_INFO: `/v3/projects` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:02.525585 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae0632f-42f9-4d19-8f92-84c63a5dbcc0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:02.525915 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae0632f-42f9-4d19-8f92-84c63a5dbcc0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:02.527977 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae0632f-42f9-4d19-8f92-84c63a5dbcc0 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:02.532677 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c311cb5-31ae-461f-8afa-c8ebcbfbe65d None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:02.542981 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 325/645] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Sep 5 12:04:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:04:02.544123 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae0632f-42f9-4d19-8f92-84c63a5dbcc0 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:02.592087 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1106de-419e-4524-993e-8645953cd10e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:02.593672 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1106de-419e-4524-993e-8645953cd10e None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:02.594216 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1106de-419e-4524-993e-8645953cd10e None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:02.594545 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1106de-419e-4524-993e-8645953cd10e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:02.608144 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1106de-419e-4524-993e-8645953cd10e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:02.610672 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1106de-419e-4524-993e-8645953cd10e None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:02.630855 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-3d1106de-419e-4524-993e-8645953cd10e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 05 12:04:02.630855 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:02.630855 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:04:02.630855 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:04:02.630855 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:04:02.630855 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:04:02.630855 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:04:02.630855 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:04:02.630855 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:04:02.630855 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:04:02.630855 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:04:02.630855 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:04:02.630855 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 12:04:02.630855 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 12:04:02.630855 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 12:04:02.630855 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 12:04:02.631892 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:04:02.631892 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:04:02.631892 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 12:04:02.631892 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:04:02.631892 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 12:04:02.631892 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:04:02.631892 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:04:02.631892 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:04:02.631892 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:04:02.631892 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:04:02.631892 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:04:02.631892 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:04:02.631892 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:04:02.631892 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:04:02.631892 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:04:02.631892 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:04:02.631892 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:04:02.631892 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:04:02.633914 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:04:02.633914 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:04:02.633914 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 12:04:02.633914 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 12:04:02.633914 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 12:04:02.633914 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 12:04:02.633914 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 12:04:02.633914 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 12:04:02.633914 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 05 12:04:02.633914 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:04:02.633914 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 321/646] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Sep 5 12:04:02 2022] GET /identity/v3/users/cinder => generated 84 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:04:02.634718 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5087e437-17ac-4580-952e-bb19ff454007 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:02.635128 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5087e437-17ac-4580-952e-bb19ff454007 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:02.636031 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5087e437-17ac-4580-952e-bb19ff454007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:02.659801 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-5087e437-17ac-4580-952e-bb19ff454007 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:04:02.661393 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-5087e437-17ac-4580-952e-bb19ff454007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:04:02.692217 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:02.705921 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae0632f-42f9-4d19-8f92-84c63a5dbcc0 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:02.757931 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f527d2f-c562-4582-b628-74676d66c2d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:02.759059 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f527d2f-c562-4582-b628-74676d66c2d3 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:02.759670 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f527d2f-c562-4582-b628-74676d66c2d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:02.760242 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f527d2f-c562-4582-b628-74676d66c2d3 None admin] PATH_INFO: `/v3/domains` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:02.761674 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f527d2f-c562-4582-b628-74676d66c2d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:02.762210 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f527d2f-c562-4582-b628-74676d66c2d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:02.770602 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 322/647] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:04:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:04:02.770602 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5087e437-17ac-4580-952e-bb19ff454007 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:02.770856 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f527d2f-c562-4582-b628-74676d66c2d3 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:02.800574 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 326/648] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 5 12:04:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:04:02.802093 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f527d2f-c562-4582-b628-74676d66c2d3 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:02.835072 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:02.958972 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5087e437-17ac-4580-952e-bb19ff454007 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:02.977654 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f527d2f-c562-4582-b628-74676d66c2d3 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:03.015174 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6d7aad-8aeb-42b6-8b09-eb5e570fad1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:03.016201 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6d7aad-8aeb-42b6-8b09-eb5e570fad1a None admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:03.016644 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6d7aad-8aeb-42b6-8b09-eb5e570fad1a None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:03.017153 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6d7aad-8aeb-42b6-8b09-eb5e570fad1a None admin] PATH_INFO: `/v3/projects/ae4f8939fcc040bca99783a77e6ede4d/users/ea2b32d58d964585a24e7c5784a8355f/roles/fe10209913504171981606bfdf25a9bb` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:03.041981 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a75065-3f18-4fb8-b53f-69aa053855f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:03.042744 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6d7aad-8aeb-42b6-8b09-eb5e570fad1a None admin] RBAC: Authorizing `identity:create_grant(project_id=ae4f8939fcc040bca99783a77e6ede4d, user_id=ea2b32d58d964585a24e7c5784a8355f, role_id=fe10209913504171981606bfdf25a9bb)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:03.043084 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a75065-3f18-4fb8-b53f-69aa053855f5 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:03.043612 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a75065-3f18-4fb8-b53f-69aa053855f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:03.044092 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a75065-3f18-4fb8-b53f-69aa053855f5 None admin] PATH_INFO: `/v3/users` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:03.045300 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6d7aad-8aeb-42b6-8b09-eb5e570fad1a None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:03.045494 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a75065-3f18-4fb8-b53f-69aa053855f5 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:03.046054 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a75065-3f18-4fb8-b53f-69aa053855f5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:03.048605 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a75065-3f18-4fb8-b53f-69aa053855f5 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:03.067523 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 323/649] 10.222.0.50 () {58 vars in 1439 bytes} [Mon Sep 5 12:04:02 2022] PUT /identity/v3/projects/ae4f8939fcc040bca99783a77e6ede4d/users/ea2b32d58d964585a24e7c5784a8355f/roles/fe10209913504171981606bfdf25a9bb => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:04:03.069196 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6d7aad-8aeb-42b6-8b09-eb5e570fad1a None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:03.093112 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 327/650] 10.222.0.50 () {56 vars in 1137 bytes} [Mon Sep 5 12:04:02 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:04:03.094821 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a75065-3f18-4fb8-b53f-69aa053855f5 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:03.101704 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:03.260601 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:03.276665 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6d7aad-8aeb-42b6-8b09-eb5e570fad1a None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:03.304393 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a75065-3f18-4fb8-b53f-69aa053855f5 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:03.319775 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38db0d24-9a13-4fd7-9755-4b1164d8efcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:03.320585 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38db0d24-9a13-4fd7-9755-4b1164d8efcd None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:03.320864 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38db0d24-9a13-4fd7-9755-4b1164d8efcd None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:03.321540 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38db0d24-9a13-4fd7-9755-4b1164d8efcd None admin] PATH_INFO: `/v3/users/nova` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:03.331629 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38db0d24-9a13-4fd7-9755-4b1164d8efcd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:03.333666 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38db0d24-9a13-4fd7-9755-4b1164d8efcd None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:03.341957 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0721d6d2-afa2-43fe-a8f9-2fe0a2ccd92d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:03.342704 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0721d6d2-afa2-43fe-a8f9-2fe0a2ccd92d None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:03.343052 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0721d6d2-afa2-43fe-a8f9-2fe0a2ccd92d None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:03.343391 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0721d6d2-afa2-43fe-a8f9-2fe0a2ccd92d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:03.349590 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-38db0d24-9a13-4fd7-9755-4b1164d8efcd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 05 12:04:03.349590 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:03.349590 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:04:03.349590 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:04:03.349590 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:04:03.349590 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:04:03.349590 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:04:03.349590 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:04:03.349590 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:04:03.349590 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:04:03.349590 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:04:03.349590 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:04:03.349590 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 12:04:03.349590 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 12:04:03.349590 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 12:04:03.349590 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 12:04:03.351860 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:04:03.351860 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:04:03.351860 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 12:04:03.351860 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:04:03.351860 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 12:04:03.351860 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:04:03.351860 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:04:03.351860 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:04:03.351860 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:04:03.351860 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:04:03.351860 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:04:03.351860 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:04:03.351860 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:04:03.351860 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:04:03.351860 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:04:03.351860 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:04:03.351860 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:04:03.351860 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:04:03.356025 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:04:03.356025 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:04:03.356025 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 12:04:03.356025 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 12:04:03.356025 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 12:04:03.356025 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 12:04:03.356025 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 12:04:03.356025 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 12:04:03.356025 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 05 12:04:03.356025 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:04:03.356025 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 324/651] 10.222.0.50 () {56 vars in 1093 bytes} [Mon Sep 5 12:04:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:04:03.356025 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38db0d24-9a13-4fd7-9755-4b1164d8efcd None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:03.357791 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0721d6d2-afa2-43fe-a8f9-2fe0a2ccd92d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:04:03.370981 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application [None req-0721d6d2-afa2-43fe-a8f9-2fe0a2ccd92d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 05 12:04:03.370981 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:03.370981 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:04:03.370981 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:04:03.370981 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:04:03.370981 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:04:03.370981 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:04:03.370981 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:04:03.370981 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:04:03.370981 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:04:03.370981 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:04:03.370981 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:04:03.370981 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:04:03.370981 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:04:03.370981 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:04:03.370981 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:04:03.371998 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:04:03.371998 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:04:03.371998 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:04:03.371998 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:04:03.371998 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:04:03.371998 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:04:03.371998 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:04:03.371998 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:04:03.371998 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:04:03.371998 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:04:03.371998 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:04:03.371998 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application with Lock( Sep 05 12:04:03.371998 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:04:03.371998 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:04:03.371998 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:04:03.371998 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:04:03.372856 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:04:03.372856 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:04:03.372856 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:04:03.372856 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:04:03.372856 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:04:03.372856 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:04:03.372856 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:04:03.372856 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:04:03.372856 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:04:03.372856 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:04:03.372856 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 05 12:04:03.372856 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:04:03.375214 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 328/652] 10.222.0.50 () {56 vars in 1102 bytes} [Mon Sep 5 12:04:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:04:03.376326 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0721d6d2-afa2-43fe-a8f9-2fe0a2ccd92d None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:03.446470 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:03.497490 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38db0d24-9a13-4fd7-9755-4b1164d8efcd None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:03.516233 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0721d6d2-afa2-43fe-a8f9-2fe0a2ccd92d None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:03.547806 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61c477d-0152-4b9c-9ce2-8bad15de0cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:03.548449 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61c477d-0152-4b9c-9ce2-8bad15de0cfd None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:03.548739 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61c477d-0152-4b9c-9ce2-8bad15de0cfd None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:03.549049 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61c477d-0152-4b9c-9ce2-8bad15de0cfd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:03.596740 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd53ea26-e39f-4811-8c30-3f8bdc411f13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:03.598332 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd53ea26-e39f-4811-8c30-3f8bdc411f13 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:03.599088 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd53ea26-e39f-4811-8c30-3f8bdc411f13 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:03.599914 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd53ea26-e39f-4811-8c30-3f8bdc411f13 None admin] PATH_INFO: `/v3/users` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:03.601610 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd53ea26-e39f-4811-8c30-3f8bdc411f13 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:03.602552 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd53ea26-e39f-4811-8c30-3f8bdc411f13 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:03.606469 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd53ea26-e39f-4811-8c30-3f8bdc411f13 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:03.610335 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:03.648976 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61c477d-0152-4b9c-9ce2-8bad15de0cfd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:03.649277 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61c477d-0152-4b9c-9ce2-8bad15de0cfd None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:03.650037 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 329/653] 10.222.0.50 () {56 vars in 1133 bytes} [Mon Sep 5 12:04:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:04:03.652487 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd53ea26-e39f-4811-8c30-3f8bdc411f13 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:03.751152 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:03.803475 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 325/654] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Sep 5 12:04:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 12:04:03.805017 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61c477d-0152-4b9c-9ce2-8bad15de0cfd None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:03.809750 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd53ea26-e39f-4811-8c30-3f8bdc411f13 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:03.851377 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ebecb2-3756-4675-bf18-dcca8381832f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:03.852021 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ebecb2-3756-4675-bf18-dcca8381832f None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:03.852293 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ebecb2-3756-4675-bf18-dcca8381832f None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:03.852534 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ebecb2-3756-4675-bf18-dcca8381832f None admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:03.853267 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ebecb2-3756-4675-bf18-dcca8381832f None admin] RBAC: Adding query filter params (name=service) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:03.853574 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ebecb2-3756-4675-bf18-dcca8381832f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:03.855540 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ebecb2-3756-4675-bf18-dcca8381832f None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:03.864796 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 330/655] 10.222.0.50 () {56 vars in 1103 bytes} [Mon Sep 5 12:04:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:04:03.865534 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ebecb2-3756-4675-bf18-dcca8381832f None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:03.927705 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:03.952285 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61c477d-0152-4b9c-9ce2-8bad15de0cfd None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:03.986540 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ebecb2-3756-4675-bf18-dcca8381832f None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:04.002922 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a906f3-2858-4f7a-ad66-66f9022ef068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:04.003600 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a906f3-2858-4f7a-ad66-66f9022ef068 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:04.003852 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a906f3-2858-4f7a-ad66-66f9022ef068 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:04.004381 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a906f3-2858-4f7a-ad66-66f9022ef068 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:04.027408 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9ff282-e86d-43e9-b418-12c0de5971c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:04.028485 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9ff282-e86d-43e9-b418-12c0de5971c7 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:04.029017 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9ff282-e86d-43e9-b418-12c0de5971c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:04.029514 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9ff282-e86d-43e9-b418-12c0de5971c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:04.042649 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9ff282-e86d-43e9-b418-12c0de5971c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:04.044574 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9ff282-e86d-43e9-b418-12c0de5971c7 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:04.048045 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:04.063509 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application [None req-4c9ff282-e86d-43e9-b418-12c0de5971c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:04:04.063509 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:04.063509 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:04:04.063509 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:04:04.063509 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:04:04.063509 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:04:04.063509 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:04:04.063509 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:04:04.063509 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:04:04.063509 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:04:04.063509 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:04:04.063509 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:04:04.063509 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:04:04.063509 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:04:04.063509 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:04:04.063509 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:04:04.064567 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:04:04.064567 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:04:04.064567 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:04:04.064567 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:04:04.064567 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:04:04.064567 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:04:04.064567 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:04:04.064567 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application with Lock( Sep 05 12:04:04.064567 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:04:04.064567 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:04:04.064567 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:04:04.064567 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:04:04.064567 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:04:04.064567 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:04:04.064567 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:04:04.064567 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:04:04.064567 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:04:04.065514 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:04:04.065514 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:04:04.065514 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:04:04.065514 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 331/656] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 5 12:04:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:04:04.066222 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9ff282-e86d-43e9-b418-12c0de5971c7 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:04.096307 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a906f3-2858-4f7a-ad66-66f9022ef068 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:04.098239 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a906f3-2858-4f7a-ad66-66f9022ef068 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:04.182580 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9ff282-e86d-43e9-b418-12c0de5971c7 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:04.191076 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:04.218904 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 326/657] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Sep 5 12:04:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 12:04:04.220103 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a906f3-2858-4f7a-ad66-66f9022ef068 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:04.228039 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22ec493-c198-42b2-9bd2-27bf30801ebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:04.228741 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22ec493-c198-42b2-9bd2-27bf30801ebe None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:04.229063 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22ec493-c198-42b2-9bd2-27bf30801ebe None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:04.229543 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22ec493-c198-42b2-9bd2-27bf30801ebe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:04.241253 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22ec493-c198-42b2-9bd2-27bf30801ebe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:04.242725 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22ec493-c198-42b2-9bd2-27bf30801ebe None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:04.259166 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application [None req-e22ec493-c198-42b2-9bd2-27bf30801ebe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:04:04.259166 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:04.259166 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:04:04.259166 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:04:04.259166 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:04:04.259166 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:04:04.259166 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:04:04.259166 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:04:04.259166 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:04:04.259166 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:04:04.259166 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:04:04.259166 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:04:04.259166 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:04:04.259166 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:04:04.259166 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:04:04.259166 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:04:04.260187 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:04:04.260187 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:04:04.260187 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:04:04.260187 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:04:04.260187 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:04:04.260187 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:04:04.260187 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:04:04.260187 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application with Lock( Sep 05 12:04:04.260187 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:04:04.260187 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:04:04.260187 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:04:04.260187 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:04:04.260187 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:04:04.260187 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:04:04.260187 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:04:04.260187 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:04:04.260187 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:04:04.261682 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:04:04.261682 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:04:04.261682 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:04:04.261682 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 332/658] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 5 12:04:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:04:04.262336 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22ec493-c198-42b2-9bd2-27bf30801ebe None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:04.303856 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:04.347480 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a906f3-2858-4f7a-ad66-66f9022ef068 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:04.376404 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22ec493-c198-42b2-9bd2-27bf30801ebe None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:04.391119 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba437d7a-684c-4b0e-9c17-04e0ea93a4cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:04.392206 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba437d7a-684c-4b0e-9c17-04e0ea93a4cd None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:04.392834 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba437d7a-684c-4b0e-9c17-04e0ea93a4cd None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:04.393344 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba437d7a-684c-4b0e-9c17-04e0ea93a4cd None admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:04.394208 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba437d7a-684c-4b0e-9c17-04e0ea93a4cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:04.394736 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba437d7a-684c-4b0e-9c17-04e0ea93a4cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:04.396641 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba437d7a-684c-4b0e-9c17-04e0ea93a4cd None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:04.411171 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 327/659] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 5 12:04:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:04:04.412726 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba437d7a-684c-4b0e-9c17-04e0ea93a4cd None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:04.415333 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c41d6b-dee6-48f9-9242-2aa3d77a003a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:04.416179 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c41d6b-dee6-48f9-9242-2aa3d77a003a None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:04.416358 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c41d6b-dee6-48f9-9242-2aa3d77a003a None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:04.416782 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c41d6b-dee6-48f9-9242-2aa3d77a003a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:04.429428 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c41d6b-dee6-48f9-9242-2aa3d77a003a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:04.430916 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c41d6b-dee6-48f9-9242-2aa3d77a003a None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:04.447230 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application [None req-c6c41d6b-dee6-48f9-9242-2aa3d77a003a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:04:04.447230 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:04.447230 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:04:04.447230 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:04:04.447230 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:04:04.447230 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:04:04.447230 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:04:04.447230 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:04:04.447230 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:04:04.447230 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:04:04.447230 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:04:04.447230 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:04:04.447230 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:04:04.447230 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:04:04.447230 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:04:04.447230 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:04:04.449114 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:04:04.449114 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:04:04.449114 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:04:04.449114 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:04:04.449114 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:04:04.449114 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:04:04.449114 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:04:04.449114 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application with Lock( Sep 05 12:04:04.449114 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:04:04.449114 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:04:04.449114 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:04:04.449114 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:04:04.449114 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:04:04.449114 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:04:04.449114 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:04:04.449114 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:04:04.449114 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:04:04.450141 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:04:04.450141 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:04:04.450141 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:04:04.453071 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 333/660] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 5 12:04:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:04:04.455006 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c41d6b-dee6-48f9-9242-2aa3d77a003a None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:04.469339 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:04.532567 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba437d7a-684c-4b0e-9c17-04e0ea93a4cd None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:04.563551 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:04.564449 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c41d6b-dee6-48f9-9242-2aa3d77a003a None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:04.576184 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33525301-a127-4f1f-8d5e-e1f37be60501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:04.576812 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33525301-a127-4f1f-8d5e-e1f37be60501 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:04.577124 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33525301-a127-4f1f-8d5e-e1f37be60501 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:04.577403 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33525301-a127-4f1f-8d5e-e1f37be60501 None admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:04.578056 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33525301-a127-4f1f-8d5e-e1f37be60501 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:04.578366 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33525301-a127-4f1f-8d5e-e1f37be60501 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:04.579895 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33525301-a127-4f1f-8d5e-e1f37be60501 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:04.592514 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 328/661] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 5 12:04:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:04:04.593846 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4345353f-3072-4819-9656-a08ef0824541 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:04.594137 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4345353f-3072-4819-9656-a08ef0824541 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:04.594407 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4345353f-3072-4819-9656-a08ef0824541 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:04.595858 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 329/662] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:04:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:04:04.596424 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4345353f-3072-4819-9656-a08ef0824541 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:04.614425 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b91259-a540-47f8-89e6-ac1f31152341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:04.615579 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b91259-a540-47f8-89e6-ac1f31152341 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:04.616066 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b91259-a540-47f8-89e6-ac1f31152341 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:04.616783 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b91259-a540-47f8-89e6-ac1f31152341 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:04.625589 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b91259-a540-47f8-89e6-ac1f31152341 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:04.627949 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b91259-a540-47f8-89e6-ac1f31152341 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:04.643139 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application [None req-f3b91259-a540-47f8-89e6-ac1f31152341 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:04:04.643139 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:04.643139 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:04:04.643139 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:04:04.643139 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:04:04.643139 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:04:04.643139 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:04:04.643139 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:04:04.643139 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:04:04.643139 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:04:04.643139 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:04:04.643139 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:04:04.643139 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 12:04:04.643139 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 12:04:04.643139 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 12:04:04.644194 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 12:04:04.644194 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:04:04.644194 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:04:04.644194 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:04:04.644194 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:04:04.644194 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:04:04.644194 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:04:04.644194 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:04:04.644194 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application with Lock( Sep 05 12:04:04.644194 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:04:04.644194 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:04:04.644194 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:04:04.644194 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:04:04.644194 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:04:04.644194 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:04:04.644194 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:04:04.644194 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:04:04.645275 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 12:04:04.645275 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 12:04:04.645275 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 12:04:04.645275 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 12:04:04.645275 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 12:04:04.645275 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 12:04:04.645275 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:04:04.645275 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:04:04.646409 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 334/663] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Sep 5 12:04:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:04:04.647275 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b91259-a540-47f8-89e6-ac1f31152341 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:04.721789 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4345353f-3072-4819-9656-a08ef0824541 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:04.722384 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:04.757025 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b91259-a540-47f8-89e6-ac1f31152341 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:04.767958 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e228eb75-7d6c-4d54-98cf-53eca782d071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:04.769000 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e228eb75-7d6c-4d54-98cf-53eca782d071 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:04.769477 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e228eb75-7d6c-4d54-98cf-53eca782d071 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:04.770005 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e228eb75-7d6c-4d54-98cf-53eca782d071 None admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:04.770973 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e228eb75-7d6c-4d54-98cf-53eca782d071 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:04.771455 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e228eb75-7d6c-4d54-98cf-53eca782d071 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:04.773528 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e228eb75-7d6c-4d54-98cf-53eca782d071 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:04.795258 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 330/664] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 5 12:04:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:04:04.795258 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cc16db-6b46-4093-a88d-0baef5035841 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:04.795258 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cc16db-6b46-4093-a88d-0baef5035841 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:04.795258 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cc16db-6b46-4093-a88d-0baef5035841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:04.807383 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb08aa4-57e1-493d-80eb-7bf03b8f2227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:04.808091 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb08aa4-57e1-493d-80eb-7bf03b8f2227 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:04.808378 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb08aa4-57e1-493d-80eb-7bf03b8f2227 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:04.808654 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb08aa4-57e1-493d-80eb-7bf03b8f2227 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:04.810662 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-06cc16db-6b46-4093-a88d-0baef5035841 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:04:04.811871 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-06cc16db-6b46-4093-a88d-0baef5035841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:04:04.818602 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb08aa4-57e1-493d-80eb-7bf03b8f2227 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:04.820928 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb08aa4-57e1-493d-80eb-7bf03b8f2227 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:04.838261 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application [None req-4fb08aa4-57e1-493d-80eb-7bf03b8f2227 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 05 12:04:04.838261 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:04.838261 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:04:04.838261 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:04:04.838261 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:04:04.838261 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:04:04.838261 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:04:04.838261 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:04:04.838261 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:04:04.838261 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:04:04.838261 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:04:04.838261 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:04:04.838261 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 12:04:04.838261 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 12:04:04.838261 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 12:04:04.838261 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 12:04:04.839867 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:04:04.839867 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:04:04.839867 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 12:04:04.839867 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:04:04.839867 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 12:04:04.839867 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:04:04.839867 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:04:04.839867 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:04:04.839867 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:04:04.839867 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:04:04.839867 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:04:04.839867 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application with Lock( Sep 05 12:04:04.839867 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:04:04.839867 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:04:04.839867 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:04:04.839867 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:04:04.839867 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:04:04.839867 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:04:04.840831 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:04:04.840831 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:04:04.840831 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 12:04:04.840831 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 12:04:04.840831 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 12:04:04.840831 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 12:04:04.840831 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 12:04:04.840831 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 12:04:04.840831 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 05 12:04:04.840831 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:04:04.847441 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 335/665] 10.222.0.50 () {56 vars in 1102 bytes} [Mon Sep 5 12:04:04 2022] GET /identity/v3/users/neutron => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:04:04.847441 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb08aa4-57e1-493d-80eb-7bf03b8f2227 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:04.866766 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:04.902029 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 331/666] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:04:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:04:04.902029 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cc16db-6b46-4093-a88d-0baef5035841 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:04.958148 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb08aa4-57e1-493d-80eb-7bf03b8f2227 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:04.992839 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:05.000284 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5b835d-0ad5-44db-92b0-09e8577b4d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:05.000959 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5b835d-0ad5-44db-92b0-09e8577b4d73 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:05.001251 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5b835d-0ad5-44db-92b0-09e8577b4d73 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:05.001525 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5b835d-0ad5-44db-92b0-09e8577b4d73 None admin] PATH_INFO: `/v3/projects` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:05.002235 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5b835d-0ad5-44db-92b0-09e8577b4d73 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:05.002542 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5b835d-0ad5-44db-92b0-09e8577b4d73 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:05.003981 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5b835d-0ad5-44db-92b0-09e8577b4d73 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:05.029335 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 336/667] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Sep 5 12:04:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:04:05.030675 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5b835d-0ad5-44db-92b0-09e8577b4d73 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:05.053288 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cc16db-6b46-4093-a88d-0baef5035841 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:05.100140 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dc760d-f671-47f0-b0c5-bfe2d4073caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:05.100821 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dc760d-f671-47f0-b0c5-bfe2d4073caf None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:05.101162 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dc760d-f671-47f0-b0c5-bfe2d4073caf None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:05.101390 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dc760d-f671-47f0-b0c5-bfe2d4073caf None admin] PATH_INFO: `/v3/projects/service` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:05.112989 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dc760d-f671-47f0-b0c5-bfe2d4073caf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:05.115451 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dc760d-f671-47f0-b0c5-bfe2d4073caf None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:05.135341 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-29dc760d-f671-47f0-b0c5-bfe2d4073caf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:04:05.135341 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:05.135341 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:04:05.135341 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:04:05.135341 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:04:05.135341 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:04:05.135341 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:04:05.135341 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:04:05.135341 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:04:05.135341 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:04:05.135341 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:04:05.135341 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:04:05.135341 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 12:04:05.135341 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 12:04:05.135341 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 12:04:05.136870 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 12:04:05.136870 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:04:05.136870 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:04:05.136870 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:04:05.136870 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:04:05.136870 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:04:05.136870 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:04:05.136870 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:04:05.136870 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:04:05.136870 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:04:05.136870 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:04:05.136870 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:04:05.136870 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:04:05.136870 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:04:05.136870 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:04:05.136870 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:04:05.136870 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:04:05.137811 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 12:04:05.137811 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 12:04:05.137811 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 12:04:05.137811 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 12:04:05.137811 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 12:04:05.137811 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 12:04:05.137811 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:04:05.137811 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:04:05.141329 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 332/668] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Sep 5 12:04:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:04:05.142346 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dc760d-f671-47f0-b0c5-bfe2d4073caf None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:05.170254 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5b835d-0ad5-44db-92b0-09e8577b4d73 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:05.189258 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:05.209441 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef0fe10-edcd-4e2e-80d0-e9f3823d9b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:05.210451 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef0fe10-edcd-4e2e-80d0-e9f3823d9b94 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:05.211062 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef0fe10-edcd-4e2e-80d0-e9f3823d9b94 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:05.211401 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef0fe10-edcd-4e2e-80d0-e9f3823d9b94 None admin] PATH_INFO: `/v3/users` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:05.212145 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef0fe10-edcd-4e2e-80d0-e9f3823d9b94 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:05.212449 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef0fe10-edcd-4e2e-80d0-e9f3823d9b94 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:05.214049 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef0fe10-edcd-4e2e-80d0-e9f3823d9b94 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:05.240003 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 337/669] 10.222.0.50 () {56 vars in 1139 bytes} [Mon Sep 5 12:04:05 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:04:05.240003 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef0fe10-edcd-4e2e-80d0-e9f3823d9b94 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:05.267917 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dc760d-f671-47f0-b0c5-bfe2d4073caf None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:05.294736 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:05.305630 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505db7ed-2299-4ce5-a891-45203300a8e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:05.306239 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505db7ed-2299-4ce5-a891-45203300a8e4 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:05.306554 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505db7ed-2299-4ce5-a891-45203300a8e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:05.306831 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505db7ed-2299-4ce5-a891-45203300a8e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:05.308076 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505db7ed-2299-4ce5-a891-45203300a8e4 None admin] RBAC: Adding query filter params (role.id=fe10209913504171981606bfdf25a9bb, scope.project.id=ae4f8939fcc040bca99783a77e6ede4d, user.id=37633bbae0c2423c81ccd61ac3a17ccf) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:05.308382 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505db7ed-2299-4ce5-a891-45203300a8e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:05.309911 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505db7ed-2299-4ce5-a891-45203300a8e4 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:05.320963 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 333/670] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Sep 5 12:04:05 2022] GET /identity/v3/role_assignments?user.id=37633bbae0c2423c81ccd61ac3a17ccf&scope.project.id=ae4f8939fcc040bca99783a77e6ede4d&role.id=fe10209913504171981606bfdf25a9bb => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:04:05.320963 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505db7ed-2299-4ce5-a891-45203300a8e4 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:05.371109 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef0fe10-edcd-4e2e-80d0-e9f3823d9b94 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:05.413405 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f860fb3-bebf-4b4f-b905-c56a0973c2ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:05.414035 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f860fb3-bebf-4b4f-b905-c56a0973c2ee None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:05.414319 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f860fb3-bebf-4b4f-b905-c56a0973c2ee None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:05.414592 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f860fb3-bebf-4b4f-b905-c56a0973c2ee None admin] PATH_INFO: `/v3/projects` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:05.415310 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f860fb3-bebf-4b4f-b905-c56a0973c2ee None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:05.415619 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f860fb3-bebf-4b4f-b905-c56a0973c2ee None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:05.417785 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f860fb3-bebf-4b4f-b905-c56a0973c2ee None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:05.436808 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 338/671] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Sep 5 12:04:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:04:05.437834 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f860fb3-bebf-4b4f-b905-c56a0973c2ee None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:05.445748 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:05.451446 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505db7ed-2299-4ce5-a891-45203300a8e4 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:05.500358 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5b7d4d-4a3d-4458-b491-a83e1423a74a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:05.501082 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5b7d4d-4a3d-4458-b491-a83e1423a74a None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:05.501369 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5b7d4d-4a3d-4458-b491-a83e1423a74a None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:05.501644 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5b7d4d-4a3d-4458-b491-a83e1423a74a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:05.516961 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5b7d4d-4a3d-4458-b491-a83e1423a74a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:05.519873 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5b7d4d-4a3d-4458-b491-a83e1423a74a None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:05.539840 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-0b5b7d4d-4a3d-4458-b491-a83e1423a74a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:04:05.539840 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:05.539840 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:04:05.539840 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:04:05.539840 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:04:05.539840 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:04:05.539840 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:04:05.539840 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:04:05.539840 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:04:05.539840 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:04:05.539840 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:04:05.539840 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:04:05.539840 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:04:05.539840 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:04:05.539840 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:04:05.539840 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:04:05.540917 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:04:05.540917 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:04:05.540917 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:04:05.540917 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:04:05.540917 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:04:05.540917 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:04:05.540917 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:04:05.540917 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:04:05.540917 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:04:05.540917 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:04:05.540917 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:04:05.540917 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:04:05.540917 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:04:05.540917 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:04:05.540917 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:04:05.540917 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:04:05.540917 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:04:05.542472 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:04:05.542472 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:04:05.542472 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:04:05.547310 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 334/672] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 5 12:04:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:04:05.548309 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5b7d4d-4a3d-4458-b491-a83e1423a74a None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:05.568502 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f860fb3-bebf-4b4f-b905-c56a0973c2ee None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:05.579601 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:05.607833 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad96dab-745c-4c0c-bd90-b025323807f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:05.608456 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad96dab-745c-4c0c-bd90-b025323807f9 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:05.608749 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad96dab-745c-4c0c-bd90-b025323807f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:05.609085 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad96dab-745c-4c0c-bd90-b025323807f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:05.661609 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5b7d4d-4a3d-4458-b491-a83e1423a74a None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:05.685520 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad96dab-745c-4c0c-bd90-b025323807f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:05.686987 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad96dab-745c-4c0c-bd90-b025323807f9 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:05.700925 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbefed6-bc0c-4d33-af56-6bf9f9b25ec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:05.701533 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbefed6-bc0c-4d33-af56-6bf9f9b25ec9 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:05.701816 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbefed6-bc0c-4d33-af56-6bf9f9b25ec9 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:05.702090 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbefed6-bc0c-4d33-af56-6bf9f9b25ec9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:05.702822 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbefed6-bc0c-4d33-af56-6bf9f9b25ec9 None admin] RBAC: Adding query filter params (role.id=fe10209913504171981606bfdf25a9bb, scope.project.id=ae4f8939fcc040bca99783a77e6ede4d, user.id=cb060ff495bc4abb83ff88992fb7be09) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:05.703132 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbefed6-bc0c-4d33-af56-6bf9f9b25ec9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:05.704606 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbefed6-bc0c-4d33-af56-6bf9f9b25ec9 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:05.720925 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 335/673] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Sep 5 12:04:05 2022] GET /identity/v3/role_assignments?user.id=cb060ff495bc4abb83ff88992fb7be09&scope.project.id=ae4f8939fcc040bca99783a77e6ede4d&role.id=fe10209913504171981606bfdf25a9bb => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:04:05.720925 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbefed6-bc0c-4d33-af56-6bf9f9b25ec9 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:05.744589 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:05.845365 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 339/674] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Sep 5 12:04:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 12:04:05.847209 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9180a2a7-db5b-4492-aeb5-8978d36e42aa None None] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:05.847913 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9180a2a7-db5b-4492-aeb5-8978d36e42aa None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:05.849024 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9180a2a7-db5b-4492-aeb5-8978d36e42aa None None] PATH_INFO: `/` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:05.852188 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 340/675] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:04:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:04:05.853409 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9180a2a7-db5b-4492-aeb5-8978d36e42aa None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:05.869517 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:05.880464 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbefed6-bc0c-4d33-af56-6bf9f9b25ec9 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:05.925688 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0192343c-99d3-4fae-a953-3a23b925b2d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:05.926271 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0192343c-99d3-4fae-a953-3a23b925b2d0 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:05.926499 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0192343c-99d3-4fae-a953-3a23b925b2d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:05.926765 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0192343c-99d3-4fae-a953-3a23b925b2d0 None admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:05.927498 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0192343c-99d3-4fae-a953-3a23b925b2d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:05.927868 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0192343c-99d3-4fae-a953-3a23b925b2d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:05.930633 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0192343c-99d3-4fae-a953-3a23b925b2d0 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:05.943469 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 336/676] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 5 12:04:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:04:05.944767 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bead27-cdf7-4b8e-97cd-a5b36f9a0596 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:05.945078 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bead27-cdf7-4b8e-97cd-a5b36f9a0596 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:05.945349 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bead27-cdf7-4b8e-97cd-a5b36f9a0596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:05.967462 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-28bead27-cdf7-4b8e-97cd-a5b36f9a0596 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:04:05.968711 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-28bead27-cdf7-4b8e-97cd-a5b36f9a0596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:04:05.995930 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9180a2a7-db5b-4492-aeb5-8978d36e42aa None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:06.038649 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e677b06-bb9c-41fe-9736-3b1db389928e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:06.039615 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e677b06-bb9c-41fe-9736-3b1db389928e None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:06.039766 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e677b06-bb9c-41fe-9736-3b1db389928e None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:06.039970 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e677b06-bb9c-41fe-9736-3b1db389928e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:06.053780 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e677b06-bb9c-41fe-9736-3b1db389928e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:06.055188 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e677b06-bb9c-41fe-9736-3b1db389928e None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:06.062947 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 337/677] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:04:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:04:06.065054 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bead27-cdf7-4b8e-97cd-a5b36f9a0596 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:06.073115 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application [None req-6e677b06-bb9c-41fe-9736-3b1db389928e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:04:06.073115 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:06.073115 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:04:06.073115 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:04:06.073115 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:04:06.073115 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:04:06.073115 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:04:06.073115 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:04:06.073115 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:04:06.073115 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:04:06.073115 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:04:06.073115 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:04:06.073115 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:04:06.073115 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:04:06.073115 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:04:06.073115 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:04:06.074307 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:04:06.074307 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:04:06.074307 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:04:06.074307 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:04:06.074307 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:04:06.074307 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:04:06.074307 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:04:06.074307 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application with Lock( Sep 05 12:04:06.074307 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:04:06.074307 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:04:06.074307 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:04:06.074307 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:04:06.074307 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:04:06.074307 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:04:06.074307 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:04:06.074307 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:04:06.074307 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:04:06.075398 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:04:06.075398 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:04:06.075398 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:04:06.076838 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 341/678] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 5 12:04:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:04:06.077661 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:06.082569 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e677b06-bb9c-41fe-9736-3b1db389928e None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:06.164620 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:06.259690 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e677b06-bb9c-41fe-9736-3b1db389928e None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:06.307858 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bead27-cdf7-4b8e-97cd-a5b36f9a0596 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:06.352324 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6338ffa1-a248-4398-aa85-03104e7ceff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:06.353528 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6338ffa1-a248-4398-aa85-03104e7ceff0 None admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:06.354041 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6338ffa1-a248-4398-aa85-03104e7ceff0 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:06.354596 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6338ffa1-a248-4398-aa85-03104e7ceff0 None admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:06.355717 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6338ffa1-a248-4398-aa85-03104e7ceff0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:06.357607 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6338ffa1-a248-4398-aa85-03104e7ceff0 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:06.371636 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f78c31-b713-4679-bb95-170aba460672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:06.372291 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f78c31-b713-4679-bb95-170aba460672 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:06.372608 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f78c31-b713-4679-bb95-170aba460672 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:06.377067 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f78c31-b713-4679-bb95-170aba460672 None admin] PATH_INFO: `/v3/domains` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:06.377067 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f78c31-b713-4679-bb95-170aba460672 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:06.377067 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f78c31-b713-4679-bb95-170aba460672 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:06.377067 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f78c31-b713-4679-bb95-170aba460672 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:06.393279 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 338/679] 10.222.0.50 () {60 vars in 1132 bytes} [Mon Sep 5 12:04:06 2022] POST /identity/v3/users => generated 254 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:04:06.396373 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6338ffa1-a248-4398-aa85-03104e7ceff0 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:06.396692 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 342/680] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 5 12:04:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:04:06.403526 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f78c31-b713-4679-bb95-170aba460672 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:06.545428 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:06.624943 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6338ffa1-a248-4398-aa85-03104e7ceff0 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:06.631115 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f78c31-b713-4679-bb95-170aba460672 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:06.665888 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:06.675673 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e41a9e5-bc00-4199-b1c6-00402a69170b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:06.676605 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e41a9e5-bc00-4199-b1c6-00402a69170b None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:06.676910 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e41a9e5-bc00-4199-b1c6-00402a69170b None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:06.677185 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e41a9e5-bc00-4199-b1c6-00402a69170b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:06.685450 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c306840b-79fc-409a-929e-3911a2ebc624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:06.686121 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c306840b-79fc-409a-929e-3911a2ebc624 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:06.686486 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c306840b-79fc-409a-929e-3911a2ebc624 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:06.686765 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c306840b-79fc-409a-929e-3911a2ebc624 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:06.691271 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e41a9e5-bc00-4199-b1c6-00402a69170b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:04:06.695434 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c306840b-79fc-409a-929e-3911a2ebc624 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:06.696920 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-4e41a9e5-bc00-4199-b1c6-00402a69170b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 05 12:04:06.696920 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:06.696920 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:04:06.696920 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:04:06.696920 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:04:06.696920 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:04:06.696920 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:04:06.696920 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:04:06.696920 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:04:06.696920 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:04:06.696920 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:04:06.696920 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:04:06.696920 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:04:06.696920 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:04:06.696920 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:04:06.696920 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:04:06.698163 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:04:06.698163 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:04:06.698163 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:04:06.698163 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:04:06.698163 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:04:06.698163 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:04:06.698163 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:04:06.698163 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:04:06.698163 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:04:06.698163 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:04:06.698163 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:04:06.698163 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:04:06.698163 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:04:06.698163 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:04:06.698163 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:04:06.698163 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:04:06.699309 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:04:06.699309 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:04:06.699309 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:04:06.699309 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:04:06.699309 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:04:06.699309 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:04:06.699309 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:04:06.699309 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:04:06.699309 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:04:06.699309 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:04:06.699309 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 05 12:04:06.699309 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:04:06.699959 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c306840b-79fc-409a-929e-3911a2ebc624 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:06.700032 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 339/681] 10.222.0.50 () {56 vars in 1102 bytes} [Mon Sep 5 12:04:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 12:04:06.706573 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e41a9e5-bc00-4199-b1c6-00402a69170b None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:06.712076 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application [None req-c306840b-79fc-409a-929e-3911a2ebc624 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:04:06.712076 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:06.712076 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:04:06.712076 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:04:06.712076 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:04:06.712076 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:04:06.712076 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:04:06.712076 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:04:06.712076 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:04:06.712076 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:04:06.712076 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:04:06.712076 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:04:06.712076 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 12:04:06.712076 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 12:04:06.712076 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 12:04:06.715816 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 12:04:06.715816 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:04:06.715816 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:04:06.715816 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:04:06.715816 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:04:06.715816 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:04:06.715816 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:04:06.715816 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:04:06.715816 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application with Lock( Sep 05 12:04:06.715816 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:04:06.715816 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:04:06.715816 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:04:06.715816 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:04:06.715816 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:04:06.715816 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:04:06.715816 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:04:06.715816 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:04:06.719034 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 12:04:06.719034 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 12:04:06.719034 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 12:04:06.719034 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 12:04:06.719034 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 12:04:06.719034 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 12:04:06.719034 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:04:06.719034 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:04:06.719034 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 343/682] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Sep 5 12:04:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 12:04:06.720464 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c306840b-79fc-409a-929e-3911a2ebc624 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:06.846062 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e41a9e5-bc00-4199-b1c6-00402a69170b None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:06.879005 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:06.886057 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755b89a6-292f-4453-bdfe-7f3a81acaa15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:06.886686 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755b89a6-292f-4453-bdfe-7f3a81acaa15 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:06.886970 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755b89a6-292f-4453-bdfe-7f3a81acaa15 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:06.887244 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755b89a6-292f-4453-bdfe-7f3a81acaa15 None admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:06.887920 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755b89a6-292f-4453-bdfe-7f3a81acaa15 None admin] RBAC: Adding query filter params (name=service) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:06.888222 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755b89a6-292f-4453-bdfe-7f3a81acaa15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:06.892988 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755b89a6-292f-4453-bdfe-7f3a81acaa15 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:06.908923 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 340/683] 10.222.0.50 () {56 vars in 1103 bytes} [Mon Sep 5 12:04:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:04:06.915683 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c306840b-79fc-409a-929e-3911a2ebc624 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:06.917254 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755b89a6-292f-4453-bdfe-7f3a81acaa15 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:06.994708 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b780b68d-8015-4f74-b33c-9b09abb4269c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:06.995369 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b780b68d-8015-4f74-b33c-9b09abb4269c None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:06.995651 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b780b68d-8015-4f74-b33c-9b09abb4269c None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:06.995928 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b780b68d-8015-4f74-b33c-9b09abb4269c None admin] PATH_INFO: `/v3/projects` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:06.996641 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b780b68d-8015-4f74-b33c-9b09abb4269c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:06.997208 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b780b68d-8015-4f74-b33c-9b09abb4269c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:06.998412 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b780b68d-8015-4f74-b33c-9b09abb4269c None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:07.029383 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 344/684] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Sep 5 12:04:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:04:07.037758 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b780b68d-8015-4f74-b33c-9b09abb4269c None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:07.052023 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755b89a6-292f-4453-bdfe-7f3a81acaa15 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:07.120544 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:07.121937 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6693a273-b051-4476-8ac9-838e7c3c6387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:07.122602 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6693a273-b051-4476-8ac9-838e7c3c6387 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:07.122890 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6693a273-b051-4476-8ac9-838e7c3c6387 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:07.123165 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6693a273-b051-4476-8ac9-838e7c3c6387 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:07.156083 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6693a273-b051-4476-8ac9-838e7c3c6387 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:07.158863 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6693a273-b051-4476-8ac9-838e7c3c6387 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:07.204432 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-6693a273-b051-4476-8ac9-838e7c3c6387 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:04:07.204432 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:07.204432 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:04:07.204432 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:04:07.204432 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:04:07.204432 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:04:07.204432 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:04:07.204432 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:04:07.204432 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:04:07.204432 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:04:07.204432 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:04:07.204432 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:04:07.204432 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:04:07.204432 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:04:07.204432 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:04:07.204432 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:04:07.205598 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:04:07.205598 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:04:07.205598 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:04:07.205598 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:04:07.205598 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:04:07.205598 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:04:07.205598 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:04:07.205598 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:04:07.205598 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:04:07.205598 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:04:07.205598 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:04:07.205598 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:04:07.205598 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:04:07.205598 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:04:07.205598 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:04:07.205598 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:04:07.205598 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:04:07.206560 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:04:07.206560 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:04:07.206560 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:04:07.206560 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 341/685] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 5 12:04:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:04:07.212182 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6693a273-b051-4476-8ac9-838e7c3c6387 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:07.309718 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b780b68d-8015-4f74-b33c-9b09abb4269c None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:07.341632 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:07.412086 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6693a273-b051-4476-8ac9-838e7c3c6387 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:07.433748 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5e9a08-08d7-4c4f-9132-641761d29bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:07.434386 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5e9a08-08d7-4c4f-9132-641761d29bcd None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:07.434674 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5e9a08-08d7-4c4f-9132-641761d29bcd None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:07.434950 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5e9a08-08d7-4c4f-9132-641761d29bcd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:07.435703 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5e9a08-08d7-4c4f-9132-641761d29bcd None admin] RBAC: Adding query filter params (role.id=fe10209913504171981606bfdf25a9bb, scope.project.id=ae4f8939fcc040bca99783a77e6ede4d, user.id=4994b4faa4ec4aa088f3dc32c9c5614d) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:07.436017 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5e9a08-08d7-4c4f-9132-641761d29bcd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:07.437514 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5e9a08-08d7-4c4f-9132-641761d29bcd None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:07.450246 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c63131e-dfd8-4964-9699-102e4dc93215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:07.450863 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c63131e-dfd8-4964-9699-102e4dc93215 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:07.451141 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c63131e-dfd8-4964-9699-102e4dc93215 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:07.451422 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c63131e-dfd8-4964-9699-102e4dc93215 None admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:07.452139 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c63131e-dfd8-4964-9699-102e4dc93215 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:07.452444 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c63131e-dfd8-4964-9699-102e4dc93215 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:07.453911 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c63131e-dfd8-4964-9699-102e4dc93215 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:07.455557 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 345/686] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Sep 5 12:04:07 2022] GET /identity/v3/role_assignments?user.id=4994b4faa4ec4aa088f3dc32c9c5614d&scope.project.id=ae4f8939fcc040bca99783a77e6ede4d&role.id=fe10209913504171981606bfdf25a9bb => generated 608 bytes in 418 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:04:07.469359 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 342/687] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 5 12:04:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:04:07.475843 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5e9a08-08d7-4c4f-9132-641761d29bcd None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:07.675714 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5e9a08-08d7-4c4f-9132-641761d29bcd None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:07.678927 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:07.727353 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3219fc8a-d1c0-479b-a009-c839f4042a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:07.728011 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3219fc8a-d1c0-479b-a009-c839f4042a09 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:07.728297 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3219fc8a-d1c0-479b-a009-c839f4042a09 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:07.728597 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3219fc8a-d1c0-479b-a009-c839f4042a09 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:07.740262 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3219fc8a-d1c0-479b-a009-c839f4042a09 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:07.742094 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3219fc8a-d1c0-479b-a009-c839f4042a09 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:07.757204 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application [None req-3219fc8a-d1c0-479b-a009-c839f4042a09 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 05 12:04:07.757204 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:07.757204 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:04:07.757204 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:04:07.757204 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:04:07.757204 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:04:07.757204 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:04:07.757204 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:04:07.757204 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:04:07.757204 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:04:07.757204 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:04:07.757204 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:04:07.757204 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 12:04:07.757204 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 12:04:07.757204 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 12:04:07.757204 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 12:04:07.758201 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:04:07.758201 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:04:07.758201 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 12:04:07.758201 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:04:07.758201 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 12:04:07.758201 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:04:07.758201 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:04:07.758201 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:04:07.758201 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:04:07.758201 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:04:07.758201 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:04:07.758201 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application with Lock( Sep 05 12:04:07.758201 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:04:07.758201 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:04:07.758201 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:04:07.758201 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:04:07.758201 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:04:07.758201 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:04:07.759140 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:04:07.759140 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:04:07.759140 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 12:04:07.759140 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 12:04:07.759140 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 12:04:07.759140 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 12:04:07.759140 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 12:04:07.759140 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 12:04:07.759140 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 05 12:04:07.759140 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:04:07.759140 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 346/688] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Sep 5 12:04:07 2022] GET /identity/v3/users/swift => generated 83 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:04:07.770063 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c63131e-dfd8-4964-9699-102e4dc93215 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:07.788324 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a676ad8e-9d54-4591-bf97-7ea867477d32 None None] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:07.790873 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a676ad8e-9d54-4591-bf97-7ea867477d32 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:07.790873 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a676ad8e-9d54-4591-bf97-7ea867477d32 None None] PATH_INFO: `/` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:07.790873 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 347/689] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:04:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:04:07.796912 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e243966-b7ef-4509-a235-88da8a29ea50 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:07.796912 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e243966-b7ef-4509-a235-88da8a29ea50 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:07.796912 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e243966-b7ef-4509-a235-88da8a29ea50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:07.818091 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-5e243966-b7ef-4509-a235-88da8a29ea50 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:04:07.819301 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-5e243966-b7ef-4509-a235-88da8a29ea50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:04:07.893535 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 348/690] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:04:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 05 12:04:07.927062 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:07.939294 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c63131e-dfd8-4964-9699-102e4dc93215 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:07.998672 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1755d935-b558-4a01-b153-746c59eed734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:07.999310 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1755d935-b558-4a01-b153-746c59eed734 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:07.999591 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1755d935-b558-4a01-b153-746c59eed734 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:07.999861 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1755d935-b558-4a01-b153-746c59eed734 None admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:08.000615 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1755d935-b558-4a01-b153-746c59eed734 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:08.000941 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1755d935-b558-4a01-b153-746c59eed734 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:08.002444 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1755d935-b558-4a01-b153-746c59eed734 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:08.032344 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 343/691] 10.222.0.50 () {56 vars in 1135 bytes} [Mon Sep 5 12:04:07 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:04:08.039795 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e243966-b7ef-4509-a235-88da8a29ea50 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:08.133871 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa2d8f0-5b7d-4f7a-a740-b71ebea7b58c None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:08.134448 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa2d8f0-5b7d-4f7a-a740-b71ebea7b58c None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:08.134448 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa2d8f0-5b7d-4f7a-a740-b71ebea7b58c None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:08.136207 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 344/692] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:04:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:04:08.142722 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb861a7-2e31-4dc8-b542-c40173d8a9b2 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:08.143086 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb861a7-2e31-4dc8-b542-c40173d8a9b2 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:08.144003 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb861a7-2e31-4dc8-b542-c40173d8a9b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:08.171674 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-fdb861a7-2e31-4dc8-b542-c40173d8a9b2 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:04:08.173228 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-fdb861a7-2e31-4dc8-b542-c40173d8a9b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:04:08.187567 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:08.201415 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e243966-b7ef-4509-a235-88da8a29ea50 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:08.288626 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 345/693] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:04:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 05 12:04:08.288880 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3037b3dc-9cb8-46b9-a9c9-d8d85f8eb92e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:08.289437 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3037b3dc-9cb8-46b9-a9c9-d8d85f8eb92e None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:08.289724 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3037b3dc-9cb8-46b9-a9c9-d8d85f8eb92e None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:08.290104 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3037b3dc-9cb8-46b9-a9c9-d8d85f8eb92e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:08.291585 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb861a7-2e31-4dc8-b542-c40173d8a9b2 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:08.455818 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3037b3dc-9cb8-46b9-a9c9-d8d85f8eb92e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:08.459608 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3037b3dc-9cb8-46b9-a9c9-d8d85f8eb92e None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:08.477808 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:08.504004 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb861a7-2e31-4dc8-b542-c40173d8a9b2 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:08.581703 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f26633d-87b6-4703-b7a7-295d2b1facb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:08.582375 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f26633d-87b6-4703-b7a7-295d2b1facb0 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:08.582653 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f26633d-87b6-4703-b7a7-295d2b1facb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:08.583130 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f26633d-87b6-4703-b7a7-295d2b1facb0 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:08.583902 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f26633d-87b6-4703-b7a7-295d2b1facb0 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:08.586725 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f26633d-87b6-4703-b7a7-295d2b1facb0 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:08.607427 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-6f26633d-87b6-4703-b7a7-295d2b1facb0 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 05 12:04:08.607427 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:08.607427 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 05 12:04:08.607427 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 05 12:04:08.607427 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 05 12:04:08.607427 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 05 12:04:08.607427 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 05 12:04:08.607427 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 12:04:08.607427 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 05 12:04:08.607427 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:04:08.607427 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 12:04:08.607427 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:04:08.607427 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:08.607427 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:04:08.607427 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:04:08.607427 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:04:08.607427 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:04:08.608527 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:04:08.608527 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:04:08.608527 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:04:08.608527 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:04:08.608527 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:04:08.608527 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:04:08.608527 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 05 12:04:08.608527 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 05 12:04:08.608527 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 05 12:04:08.608527 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 05 12:04:08.608527 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:04:08.608527 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:04:08.608527 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:04:08.608527 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:04:08.608527 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:04:08.608527 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:04:08.609533 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:04:08.609533 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:04:08.609533 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:04:08.609533 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:04:08.609533 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:04:08.609533 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:04:08.609533 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:04:08.609533 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:04:08.609533 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:04:08.609533 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:04:08.609533 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 05 12:04:08.609533 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 12:04:08.609533 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 05 12:04:08.609533 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:04:08.609533 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 346/694] 10.222.0.50 () {56 vars in 1129 bytes} [Mon Sep 5 12:04:08 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:04:08.621166 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f26633d-87b6-4703-b7a7-295d2b1facb0 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:08.669203 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:08.681534 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 349/695] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Sep 5 12:04:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 642 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 12:04:08.689434 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3037b3dc-9cb8-46b9-a9c9-d8d85f8eb92e None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:08.786655 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f26633d-87b6-4703-b7a7-295d2b1facb0 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:08.816908 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3037b3dc-9cb8-46b9-a9c9-d8d85f8eb92e None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:08.826824 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8336fd70-ea0f-401e-8d93-1b3b11050b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:08.827669 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8336fd70-ea0f-401e-8d93-1b3b11050b97 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:08.827792 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8336fd70-ea0f-401e-8d93-1b3b11050b97 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:08.827973 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8336fd70-ea0f-401e-8d93-1b3b11050b97 None admin] PATH_INFO: `/v3/services` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:08.828621 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8336fd70-ea0f-401e-8d93-1b3b11050b97 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:08.829064 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8336fd70-ea0f-401e-8d93-1b3b11050b97 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:08.830793 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8336fd70-ea0f-401e-8d93-1b3b11050b97 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:08.840873 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 347/696] 10.222.0.50 () {56 vars in 1124 bytes} [Mon Sep 5 12:04:08 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:04:08.840873 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8336fd70-ea0f-401e-8d93-1b3b11050b97 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:08.864124 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:08.874332 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3364793d-7977-4f8c-b54f-cab33db96f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:08.874994 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3364793d-7977-4f8c-b54f-cab33db96f6d None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:08.875275 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3364793d-7977-4f8c-b54f-cab33db96f6d None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:08.875550 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3364793d-7977-4f8c-b54f-cab33db96f6d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:08.891845 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3364793d-7977-4f8c-b54f-cab33db96f6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:08.893420 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3364793d-7977-4f8c-b54f-cab33db96f6d None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:08.916330 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application [None req-3364793d-7977-4f8c-b54f-cab33db96f6d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:04:08.916330 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:08.916330 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:04:08.916330 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:04:08.916330 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:04:08.916330 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:04:08.916330 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:04:08.916330 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:04:08.916330 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:04:08.916330 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:04:08.916330 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:04:08.916330 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:04:08.916330 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:04:08.916330 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:04:08.916330 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:04:08.916330 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:04:08.917979 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:04:08.917979 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:04:08.917979 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:04:08.917979 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:04:08.917979 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:04:08.917979 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:04:08.917979 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:04:08.917979 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application with Lock( Sep 05 12:04:08.917979 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:04:08.917979 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:04:08.917979 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:04:08.917979 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:04:08.917979 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:04:08.917979 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:04:08.917979 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:04:08.917979 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:04:08.917979 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:04:08.918912 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:04:08.918912 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:04:08.918912 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:04:08.918912 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 350/697] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 5 12:04:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:04:08.924492 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3364793d-7977-4f8c-b54f-cab33db96f6d None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:08.990855 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:08.993986 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8336fd70-ea0f-401e-8d93-1b3b11050b97 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:09.034125 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac81d650-3186-4084-a3e2-f5a38286761d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:09.034972 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac81d650-3186-4084-a3e2-f5a38286761d None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:09.035338 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac81d650-3186-4084-a3e2-f5a38286761d None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:09.035549 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac81d650-3186-4084-a3e2-f5a38286761d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:09.048427 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac81d650-3186-4084-a3e2-f5a38286761d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:04:09.054874 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-ac81d650-3186-4084-a3e2-f5a38286761d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 12:04:09.054874 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:09.054874 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:04:09.054874 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:04:09.054874 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:04:09.054874 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:04:09.054874 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:04:09.054874 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:04:09.054874 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:04:09.054874 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:04:09.054874 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:04:09.054874 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:04:09.054874 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:04:09.054874 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:04:09.054874 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:04:09.054874 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:04:09.055918 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:04:09.055918 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:04:09.055918 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:04:09.055918 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:04:09.055918 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:04:09.055918 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:04:09.055918 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:04:09.055918 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:04:09.055918 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:04:09.055918 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:04:09.055918 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:04:09.055918 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:04:09.055918 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:04:09.055918 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:04:09.055918 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:04:09.055918 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:04:09.056806 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:04:09.056806 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:04:09.056806 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:04:09.056806 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:04:09.056806 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:04:09.056806 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:04:09.056806 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:04:09.056806 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:04:09.056806 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:04:09.056806 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:04:09.056806 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 12:04:09.056806 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:04:09.061115 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 348/698] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Sep 5 12:04:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:04:09.062092 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac81d650-3186-4084-a3e2-f5a38286761d None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:09.064625 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3364793d-7977-4f8c-b54f-cab33db96f6d None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:09.106955 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0391dc8d-f9e3-4c6d-b339-585404f45cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:09.107964 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0391dc8d-f9e3-4c6d-b339-585404f45cd7 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:09.108482 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0391dc8d-f9e3-4c6d-b339-585404f45cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:09.109014 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0391dc8d-f9e3-4c6d-b339-585404f45cd7 None admin] PATH_INFO: `/v3/services` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:09.109887 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0391dc8d-f9e3-4c6d-b339-585404f45cd7 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:09.110405 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0391dc8d-f9e3-4c6d-b339-585404f45cd7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:09.112326 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0391dc8d-f9e3-4c6d-b339-585404f45cd7 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:09.129211 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 351/699] 10.222.0.50 () {56 vars in 1124 bytes} [Mon Sep 5 12:04:08 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:04:09.130571 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0391dc8d-f9e3-4c6d-b339-585404f45cd7 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:09.149147 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:09.188514 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac81d650-3186-4084-a3e2-f5a38286761d None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:09.235877 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7177b07-779c-42f1-ac0c-9750afb20081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:09.236789 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7177b07-779c-42f1-ac0c-9750afb20081 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:09.237292 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7177b07-779c-42f1-ac0c-9750afb20081 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:09.237744 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7177b07-779c-42f1-ac0c-9750afb20081 None admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:09.238520 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7177b07-779c-42f1-ac0c-9750afb20081 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:09.238830 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7177b07-779c-42f1-ac0c-9750afb20081 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:09.240294 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7177b07-779c-42f1-ac0c-9750afb20081 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:09.275096 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 349/700] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 5 12:04:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:04:09.283078 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7177b07-779c-42f1-ac0c-9750afb20081 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:09.329781 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0391dc8d-f9e3-4c6d-b339-585404f45cd7 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:09.343043 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:09.376394 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed37cf06-142c-4e68-8568-2094f3757cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:09.377455 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed37cf06-142c-4e68-8568-2094f3757cf2 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:09.377812 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed37cf06-142c-4e68-8568-2094f3757cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:09.378160 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed37cf06-142c-4e68-8568-2094f3757cf2 None admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:09.378921 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed37cf06-142c-4e68-8568-2094f3757cf2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:09.379285 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed37cf06-142c-4e68-8568-2094f3757cf2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:09.380805 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed37cf06-142c-4e68-8568-2094f3757cf2 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:09.391696 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 352/701] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Sep 5 12:04:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:04:09.393105 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30502a9-dcc3-4b0e-beca-69ce88d6ba92 None None] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:09.393397 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30502a9-dcc3-4b0e-beca-69ce88d6ba92 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:09.393677 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30502a9-dcc3-4b0e-beca-69ce88d6ba92 None None] PATH_INFO: `/` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:09.395082 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 353/702] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:04:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:04:09.400696 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79770c0e-250e-4c4a-93f4-c603614e732f None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:09.401191 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79770c0e-250e-4c4a-93f4-c603614e732f None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:09.401349 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79770c0e-250e-4c4a-93f4-c603614e732f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:09.424333 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-79770c0e-250e-4c4a-93f4-c603614e732f None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:04:09.425308 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7177b07-779c-42f1-ac0c-9750afb20081 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:09.426133 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-79770c0e-250e-4c4a-93f4-c603614e732f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:04:09.460450 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:09.467386 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad833f2d-7e59-4f24-8cd4-4a644db7517a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:09.468257 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad833f2d-7e59-4f24-8cd4-4a644db7517a None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:09.468701 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad833f2d-7e59-4f24-8cd4-4a644db7517a None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:09.469024 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad833f2d-7e59-4f24-8cd4-4a644db7517a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:09.476874 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad833f2d-7e59-4f24-8cd4-4a644db7517a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:09.478620 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad833f2d-7e59-4f24-8cd4-4a644db7517a None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:09.492094 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-ad833f2d-7e59-4f24-8cd4-4a644db7517a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:04:09.492094 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:09.492094 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:04:09.492094 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:04:09.492094 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:04:09.492094 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:04:09.492094 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:04:09.492094 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:04:09.492094 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:04:09.492094 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:04:09.492094 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:04:09.492094 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:04:09.492094 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 12:04:09.492094 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 12:04:09.492094 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 12:04:09.493151 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 12:04:09.493151 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:04:09.493151 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:04:09.493151 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:04:09.493151 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:04:09.493151 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:04:09.493151 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:04:09.493151 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:04:09.493151 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:04:09.493151 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:04:09.493151 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:04:09.493151 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:04:09.493151 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:04:09.493151 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:04:09.493151 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:04:09.493151 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:04:09.493151 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:04:09.494070 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 12:04:09.494070 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 12:04:09.494070 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 12:04:09.494070 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 12:04:09.494070 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 12:04:09.494070 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 12:04:09.494070 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:04:09.494070 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:04:09.494070 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 350/703] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Sep 5 12:04:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 12:04:09.495479 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad833f2d-7e59-4f24-8cd4-4a644db7517a None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:09.521026 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 354/704] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:04:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 05 12:04:09.522451 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79770c0e-250e-4c4a-93f4-c603614e732f None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:09.609767 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad833f2d-7e59-4f24-8cd4-4a644db7517a None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:09.645457 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b388137-a4d5-4f2f-b6f3-84cdba7547cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:09.646344 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b388137-a4d5-4f2f-b6f3-84cdba7547cb None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:09.646880 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b388137-a4d5-4f2f-b6f3-84cdba7547cb None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:09.647317 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b388137-a4d5-4f2f-b6f3-84cdba7547cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:09.659842 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b388137-a4d5-4f2f-b6f3-84cdba7547cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:09.661607 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b388137-a4d5-4f2f-b6f3-84cdba7547cb None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:09.678055 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-5b388137-a4d5-4f2f-b6f3-84cdba7547cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:04:09.678055 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:09.678055 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:04:09.678055 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:04:09.678055 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:04:09.678055 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:04:09.678055 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:04:09.678055 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:04:09.678055 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:04:09.678055 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:04:09.678055 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:04:09.678055 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:04:09.678055 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:04:09.678055 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:04:09.678055 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:04:09.678055 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:04:09.679293 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:04:09.679293 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:04:09.679293 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:04:09.679293 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:04:09.679293 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:04:09.679293 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:04:09.679293 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:04:09.679293 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:04:09.679293 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:04:09.679293 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:04:09.679293 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:04:09.679293 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:04:09.679293 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:04:09.679293 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:04:09.679293 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:04:09.679293 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:04:09.679293 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:04:09.680403 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:04:09.680403 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:04:09.680403 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:04:09.682300 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 351/705] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 5 12:04:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:04:09.692373 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b388137-a4d5-4f2f-b6f3-84cdba7547cb None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:09.710516 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79770c0e-250e-4c4a-93f4-c603614e732f None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:09.713298 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:09.766820 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:09.781241 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17131d03-e4c1-4e66-89f1-beab0f77dda4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:09.781873 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17131d03-e4c1-4e66-89f1-beab0f77dda4 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:09.782156 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17131d03-e4c1-4e66-89f1-beab0f77dda4 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:09.782429 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17131d03-e4c1-4e66-89f1-beab0f77dda4 None admin] PATH_INFO: `/v3/projects` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:09.783141 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17131d03-e4c1-4e66-89f1-beab0f77dda4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:09.783448 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17131d03-e4c1-4e66-89f1-beab0f77dda4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:09.784927 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17131d03-e4c1-4e66-89f1-beab0f77dda4 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:09.803750 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 355/706] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Sep 5 12:04:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:04:09.806530 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17131d03-e4c1-4e66-89f1-beab0f77dda4 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:09.867070 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b388137-a4d5-4f2f-b6f3-84cdba7547cb None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:09.905288 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d3bb74-efaf-494a-9800-13f9d06ce396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:09.906158 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d3bb74-efaf-494a-9800-13f9d06ce396 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:09.906591 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d3bb74-efaf-494a-9800-13f9d06ce396 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:09.907039 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d3bb74-efaf-494a-9800-13f9d06ce396 None admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:09.907837 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d3bb74-efaf-494a-9800-13f9d06ce396 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:09.908286 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d3bb74-efaf-494a-9800-13f9d06ce396 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:09.909882 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d3bb74-efaf-494a-9800-13f9d06ce396 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:09.924606 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 352/707] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 5 12:04:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:04:09.925758 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d3bb74-efaf-494a-9800-13f9d06ce396 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:09.935621 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17131d03-e4c1-4e66-89f1-beab0f77dda4 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:09.975760 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3129a26-5b5f-451f-9bcb-9089a093fe89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:09.976476 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3129a26-5b5f-451f-9bcb-9089a093fe89 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:09.976879 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3129a26-5b5f-451f-9bcb-9089a093fe89 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:09.977290 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3129a26-5b5f-451f-9bcb-9089a093fe89 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:09.978129 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3129a26-5b5f-451f-9bcb-9089a093fe89 None admin] RBAC: Adding query filter params (role.id=fe10209913504171981606bfdf25a9bb, scope.project.id=ae4f8939fcc040bca99783a77e6ede4d, user.id=ea2b32d58d964585a24e7c5784a8355f) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:09.978542 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3129a26-5b5f-451f-9bcb-9089a093fe89 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:09.980139 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3129a26-5b5f-451f-9bcb-9089a093fe89 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:09.987083 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 356/708] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Sep 5 12:04:09 2022] GET /identity/v3/role_assignments?user.id=ea2b32d58d964585a24e7c5784a8355f&scope.project.id=ae4f8939fcc040bca99783a77e6ede4d&role.id=fe10209913504171981606bfdf25a9bb => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:04:09.988113 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3129a26-5b5f-451f-9bcb-9089a093fe89 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:10.021283 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:10.047042 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d3bb74-efaf-494a-9800-13f9d06ce396 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:10.050016 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:10.091709 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5134b4-4e5c-4ac8-88b1-a6f5a921d97a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:10.092667 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5134b4-4e5c-4ac8-88b1-a6f5a921d97a None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:10.093136 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5134b4-4e5c-4ac8-88b1-a6f5a921d97a None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:10.093552 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5134b4-4e5c-4ac8-88b1-a6f5a921d97a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:10.106346 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5134b4-4e5c-4ac8-88b1-a6f5a921d97a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:04:10.109851 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3129a26-5b5f-451f-9bcb-9089a093fe89 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:10.112178 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-4c5134b4-4e5c-4ac8-88b1-a6f5a921d97a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 05 12:04:10.112178 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:10.112178 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:04:10.112178 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:04:10.112178 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:04:10.112178 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:04:10.112178 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:04:10.112178 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:04:10.112178 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:04:10.112178 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:04:10.112178 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:04:10.112178 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:04:10.112178 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:04:10.112178 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:04:10.112178 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:04:10.112178 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:04:10.113264 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:04:10.113264 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:04:10.113264 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:04:10.113264 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:04:10.113264 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:04:10.113264 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:04:10.113264 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:04:10.113264 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:04:10.113264 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:04:10.113264 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:04:10.113264 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:04:10.113264 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:04:10.113264 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:04:10.113264 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:04:10.113264 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:04:10.113264 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:04:10.114153 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:04:10.114153 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:04:10.114153 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:04:10.114153 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:04:10.114153 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:04:10.114153 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:04:10.114153 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:04:10.114153 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:04:10.114153 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:04:10.114153 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:04:10.114153 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 05 12:04:10.114153 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:04:10.116987 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 353/709] 10.222.0.50 () {56 vars in 1102 bytes} [Mon Sep 5 12:04:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:04:10.118643 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5708434-6554-4e42-a706-a66d1976701a None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:10.119122 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5708434-6554-4e42-a706-a66d1976701a None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:10.119619 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5708434-6554-4e42-a706-a66d1976701a None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:10.121591 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 354/710] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:04:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:04:10.129044 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5708434-6554-4e42-a706-a66d1976701a None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:10.153912 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564d2036-e764-45d9-80af-5e4a7adbd128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:10.153912 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564d2036-e764-45d9-80af-5e4a7adbd128 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:10.154243 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564d2036-e764-45d9-80af-5e4a7adbd128 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:10.154567 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564d2036-e764-45d9-80af-5e4a7adbd128 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:10.163015 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564d2036-e764-45d9-80af-5e4a7adbd128 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:10.164575 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564d2036-e764-45d9-80af-5e4a7adbd128 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:10.179742 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application [None req-564d2036-e764-45d9-80af-5e4a7adbd128 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 05 12:04:10.179742 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:10.179742 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:04:10.179742 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:04:10.179742 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:04:10.179742 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:04:10.179742 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:04:10.179742 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:04:10.179742 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:04:10.179742 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:04:10.179742 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:04:10.179742 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:04:10.179742 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 12:04:10.179742 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 12:04:10.179742 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 12:04:10.179742 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 12:04:10.181063 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:04:10.181063 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:04:10.181063 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 12:04:10.181063 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:04:10.181063 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 12:04:10.181063 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:04:10.181063 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:04:10.181063 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:04:10.181063 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:04:10.181063 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:04:10.181063 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:04:10.181063 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application with Lock( Sep 05 12:04:10.181063 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:04:10.181063 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:04:10.181063 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:04:10.181063 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:04:10.181063 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:04:10.181063 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:04:10.182025 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:04:10.182025 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:04:10.182025 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 12:04:10.182025 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 12:04:10.182025 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 12:04:10.182025 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 12:04:10.182025 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 12:04:10.182025 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 12:04:10.182025 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 05 12:04:10.182025 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:04:10.182614 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 357/711] 10.222.0.50 () {56 vars in 1093 bytes} [Mon Sep 5 12:04:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:04:10.187568 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d96b83-326e-4911-9b81-8638e63965e8 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:10.187568 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d96b83-326e-4911-9b81-8638e63965e8 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:10.187568 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d96b83-326e-4911-9b81-8638e63965e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:10.208249 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-50d96b83-326e-4911-9b81-8638e63965e8 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:04:10.210129 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-50d96b83-326e-4911-9b81-8638e63965e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:04:10.297368 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5708434-6554-4e42-a706-a66d1976701a None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:10.303932 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 358/712] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:04:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:04:10.304806 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d96b83-326e-4911-9b81-8638e63965e8 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:10.327864 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:10.345091 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdba19ba-e45b-4986-a2f0-dd811d4abd68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:10.345883 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdba19ba-e45b-4986-a2f0-dd811d4abd68 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:10.346169 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdba19ba-e45b-4986-a2f0-dd811d4abd68 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:10.346448 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdba19ba-e45b-4986-a2f0-dd811d4abd68 None admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:10.347127 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdba19ba-e45b-4986-a2f0-dd811d4abd68 None admin] RBAC: Adding query filter params (name=service) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:10.347433 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdba19ba-e45b-4986-a2f0-dd811d4abd68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:10.349674 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdba19ba-e45b-4986-a2f0-dd811d4abd68 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:10.361817 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 355/713] 10.222.0.50 () {56 vars in 1103 bytes} [Mon Sep 5 12:04:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:04:10.374493 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdba19ba-e45b-4986-a2f0-dd811d4abd68 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:10.441792 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:10.467923 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d96b83-326e-4911-9b81-8638e63965e8 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:10.515808 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1058d5e4-e66e-40b4-b4b3-21918a7552b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:10.516436 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1058d5e4-e66e-40b4-b4b3-21918a7552b2 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:10.516718 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1058d5e4-e66e-40b4-b4b3-21918a7552b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:10.517016 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1058d5e4-e66e-40b4-b4b3-21918a7552b2 None admin] PATH_INFO: `/v3/users` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:10.517769 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1058d5e4-e66e-40b4-b4b3-21918a7552b2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:10.518077 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1058d5e4-e66e-40b4-b4b3-21918a7552b2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:10.519524 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1058d5e4-e66e-40b4-b4b3-21918a7552b2 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:10.555471 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 359/714] 10.222.0.50 () {56 vars in 1133 bytes} [Mon Sep 5 12:04:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:04:10.562596 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1058d5e4-e66e-40b4-b4b3-21918a7552b2 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:10.586820 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdba19ba-e45b-4986-a2f0-dd811d4abd68 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:10.642933 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9061802-fd91-47ac-ad85-91094dfe7452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:10.643501 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9061802-fd91-47ac-ad85-91094dfe7452 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:10.643779 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9061802-fd91-47ac-ad85-91094dfe7452 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:10.644052 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9061802-fd91-47ac-ad85-91094dfe7452 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:10.656851 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9061802-fd91-47ac-ad85-91094dfe7452 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:10.659265 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9061802-fd91-47ac-ad85-91094dfe7452 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:10.676625 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:10.683499 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-c9061802-fd91-47ac-ad85-91094dfe7452 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:04:10.683499 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:10.683499 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:04:10.683499 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:04:10.683499 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:04:10.683499 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:04:10.683499 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:04:10.683499 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:04:10.683499 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:04:10.683499 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:04:10.683499 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:04:10.683499 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:04:10.683499 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:04:10.683499 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:04:10.683499 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:04:10.683499 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:04:10.684577 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:04:10.684577 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:04:10.684577 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:04:10.684577 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:04:10.684577 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:04:10.684577 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:04:10.684577 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:04:10.684577 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:04:10.684577 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:04:10.684577 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:04:10.684577 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:04:10.684577 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:04:10.684577 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:04:10.684577 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:04:10.684577 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:04:10.684577 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:04:10.684577 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:04:10.685533 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:04:10.685533 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:04:10.685533 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:04:10.685533 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 356/715] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 5 12:04:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:04:10.686483 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9061802-fd91-47ac-ad85-91094dfe7452 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:10.711388 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1058d5e4-e66e-40b4-b4b3-21918a7552b2 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:10.751280 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a80d737-c950-4ac1-b6ca-90efd822ef85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:10.752333 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a80d737-c950-4ac1-b6ca-90efd822ef85 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:10.752799 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a80d737-c950-4ac1-b6ca-90efd822ef85 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:10.753276 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a80d737-c950-4ac1-b6ca-90efd822ef85 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:10.793850 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:10.826646 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9061802-fd91-47ac-ad85-91094dfe7452 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:10.843795 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a80d737-c950-4ac1-b6ca-90efd822ef85 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:10.846242 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a80d737-c950-4ac1-b6ca-90efd822ef85 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:10.868232 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f4fa8a-a8cd-4976-af36-dd3eae68986e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:10.869307 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f4fa8a-a8cd-4976-af36-dd3eae68986e None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:10.870401 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f4fa8a-a8cd-4976-af36-dd3eae68986e None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:10.871063 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f4fa8a-a8cd-4976-af36-dd3eae68986e None admin] PATH_INFO: `/v3/services/network` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:10.871880 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f4fa8a-a8cd-4976-af36-dd3eae68986e None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:10.873539 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f4fa8a-a8cd-4976-af36-dd3eae68986e None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:10.883401 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-75f4fa8a-a8cd-4976-af36-dd3eae68986e None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 05 12:04:10.883401 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:10.883401 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 05 12:04:10.883401 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 05 12:04:10.883401 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 05 12:04:10.883401 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 05 12:04:10.883401 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 05 12:04:10.883401 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 12:04:10.883401 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 05 12:04:10.883401 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:04:10.883401 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 12:04:10.883401 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:04:10.883401 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:10.883401 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:04:10.883401 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:04:10.883401 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:04:10.883401 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:04:10.884463 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:04:10.884463 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:04:10.884463 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:04:10.884463 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:04:10.884463 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:04:10.884463 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:04:10.884463 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 05 12:04:10.884463 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 05 12:04:10.884463 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 05 12:04:10.884463 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 05 12:04:10.884463 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:04:10.884463 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:04:10.884463 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:04:10.884463 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:04:10.884463 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:04:10.884463 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:04:10.885553 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:04:10.885553 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:04:10.885553 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:04:10.885553 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:04:10.885553 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:04:10.885553 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:04:10.885553 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:04:10.885553 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:04:10.885553 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:04:10.885553 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:04:10.885553 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 05 12:04:10.885553 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 12:04:10.885553 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 05 12:04:10.885553 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:04:10.893170 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 357/716] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Sep 5 12:04:10 2022] GET /identity/v3/services/network => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:04:10.894355 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f4fa8a-a8cd-4976-af36-dd3eae68986e None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:10.944044 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:10.974335 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 360/717] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Sep 5 12:04:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 12:04:10.975699 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a80d737-c950-4ac1-b6ca-90efd822ef85 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:11.052535 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f4fa8a-a8cd-4976-af36-dd3eae68986e None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:11.107896 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569a78af-4567-46b5-882b-2f98f04f6890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:11.108917 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569a78af-4567-46b5-882b-2f98f04f6890 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:11.109296 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569a78af-4567-46b5-882b-2f98f04f6890 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:11.109663 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569a78af-4567-46b5-882b-2f98f04f6890 None admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:11.110778 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569a78af-4567-46b5-882b-2f98f04f6890 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:11.111240 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569a78af-4567-46b5-882b-2f98f04f6890 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:11.113408 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569a78af-4567-46b5-882b-2f98f04f6890 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:11.116151 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a80d737-c950-4ac1-b6ca-90efd822ef85 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:11.137920 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 358/718] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 5 12:04:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:04:11.139345 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569a78af-4567-46b5-882b-2f98f04f6890 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:11.143454 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:11.173201 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b1c66a-aae4-49d5-8b73-2179505c7790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:11.174365 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b1c66a-aae4-49d5-8b73-2179505c7790 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:11.174960 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b1c66a-aae4-49d5-8b73-2179505c7790 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:11.175491 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b1c66a-aae4-49d5-8b73-2179505c7790 None admin] PATH_INFO: `/v3/services` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:11.176392 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b1c66a-aae4-49d5-8b73-2179505c7790 None admin] RBAC: Adding query filter params (name=network) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:11.176924 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b1c66a-aae4-49d5-8b73-2179505c7790 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:11.178768 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b1c66a-aae4-49d5-8b73-2179505c7790 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:11.189160 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 361/719] 10.222.0.50 () {56 vars in 1112 bytes} [Mon Sep 5 12:04:10 2022] GET /identity/v3/services?name=network => generated 124 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:04:11.190693 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b1c66a-aae4-49d5-8b73-2179505c7790 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:11.241945 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:11.263766 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569a78af-4567-46b5-882b-2f98f04f6890 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:11.310673 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e27055-fed4-48c4-ba31-bdb900948d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:11.312311 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e27055-fed4-48c4-ba31-bdb900948d30 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:11.312773 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e27055-fed4-48c4-ba31-bdb900948d30 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:11.313267 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e27055-fed4-48c4-ba31-bdb900948d30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:11.318281 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b1c66a-aae4-49d5-8b73-2179505c7790 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:11.325704 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e27055-fed4-48c4-ba31-bdb900948d30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:11.327544 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e27055-fed4-48c4-ba31-bdb900948d30 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:11.344699 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-50e27055-fed4-48c4-ba31-bdb900948d30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:04:11.344699 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:11.344699 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:04:11.344699 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:04:11.344699 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:04:11.344699 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:04:11.344699 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:04:11.344699 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:04:11.344699 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:04:11.344699 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:04:11.344699 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:04:11.344699 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:04:11.344699 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:04:11.344699 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:04:11.344699 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:04:11.344699 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:04:11.345825 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:04:11.345825 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:04:11.345825 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:04:11.345825 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:04:11.345825 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:04:11.345825 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:04:11.345825 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:04:11.345825 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:04:11.345825 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:04:11.345825 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:04:11.345825 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:04:11.345825 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:04:11.345825 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:04:11.345825 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:04:11.345825 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:04:11.345825 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:04:11.345825 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:04:11.346768 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:04:11.346768 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:04:11.346768 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:04:11.349068 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 359/720] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 5 12:04:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:04:11.350135 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e27055-fed4-48c4-ba31-bdb900948d30 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:11.358439 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32715ea4-8a92-4c6f-9da6-6a55832381af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:11.359176 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32715ea4-8a92-4c6f-9da6-6a55832381af None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:11.359530 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32715ea4-8a92-4c6f-9da6-6a55832381af None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:11.359898 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32715ea4-8a92-4c6f-9da6-6a55832381af None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:11.374102 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32715ea4-8a92-4c6f-9da6-6a55832381af None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:11.375673 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32715ea4-8a92-4c6f-9da6-6a55832381af None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:11.390207 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application [None req-32715ea4-8a92-4c6f-9da6-6a55832381af None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 05 12:04:11.390207 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:11.390207 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:04:11.390207 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:04:11.390207 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:04:11.390207 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:04:11.390207 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:04:11.390207 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:04:11.390207 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:04:11.390207 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:04:11.390207 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:04:11.390207 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:04:11.390207 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 12:04:11.390207 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 12:04:11.390207 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 12:04:11.390207 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 12:04:11.391249 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:04:11.391249 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:04:11.391249 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 12:04:11.391249 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:04:11.391249 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 12:04:11.391249 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:04:11.391249 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:04:11.391249 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:04:11.391249 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:04:11.391249 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:04:11.391249 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:04:11.391249 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application with Lock( Sep 05 12:04:11.391249 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:04:11.391249 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:04:11.391249 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:04:11.391249 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:04:11.391249 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:04:11.391249 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:04:11.392202 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:04:11.392202 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:04:11.392202 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 12:04:11.392202 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 12:04:11.392202 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 12:04:11.392202 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 12:04:11.392202 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 12:04:11.392202 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 12:04:11.392202 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 05 12:04:11.392202 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:04:11.392202 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 362/721] 10.222.0.50 () {56 vars in 1117 bytes} [Mon Sep 5 12:04:11 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:04:11.392202 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32715ea4-8a92-4c6f-9da6-6a55832381af None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:11.424193 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:11.474142 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e27055-fed4-48c4-ba31-bdb900948d30 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:11.503608 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:11.508906 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32715ea4-8a92-4c6f-9da6-6a55832381af None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:11.511200 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24836e24-97fa-452e-a153-70a25ae7b18e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:11.512531 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24836e24-97fa-452e-a153-70a25ae7b18e None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:11.512531 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24836e24-97fa-452e-a153-70a25ae7b18e None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:11.512531 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24836e24-97fa-452e-a153-70a25ae7b18e None admin] PATH_INFO: `/v3/services` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:11.513013 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24836e24-97fa-452e-a153-70a25ae7b18e None admin] RBAC: Adding query filter params (type=network) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:11.513319 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24836e24-97fa-452e-a153-70a25ae7b18e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:11.514737 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24836e24-97fa-452e-a153-70a25ae7b18e None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:11.520926 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 360/722] 10.222.0.50 () {56 vars in 1112 bytes} [Mon Sep 5 12:04:11 2022] GET /identity/v3/services?type=network => generated 124 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:04:11.530501 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24836e24-97fa-452e-a153-70a25ae7b18e None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:11.550967 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ae95cd-0529-4246-891b-54a477e0a94d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:11.551827 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ae95cd-0529-4246-891b-54a477e0a94d None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:11.552212 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ae95cd-0529-4246-891b-54a477e0a94d None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:11.552589 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ae95cd-0529-4246-891b-54a477e0a94d None admin] PATH_INFO: `/v3/domains` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:11.553504 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ae95cd-0529-4246-891b-54a477e0a94d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:11.553912 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ae95cd-0529-4246-891b-54a477e0a94d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:11.555669 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ae95cd-0529-4246-891b-54a477e0a94d None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:11.575447 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 363/723] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 5 12:04:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:04:11.577184 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8125a964-8414-449a-9767-3587d150f733 None None] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:11.577595 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8125a964-8414-449a-9767-3587d150f733 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:11.578120 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8125a964-8414-449a-9767-3587d150f733 None None] PATH_INFO: `/` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:11.579977 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 364/724] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:04:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:04:11.586051 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8125a964-8414-449a-9767-3587d150f733 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:11.693035 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24836e24-97fa-452e-a153-70a25ae7b18e None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:11.724245 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:11.731307 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8125a964-8414-449a-9767-3587d150f733 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:11.743373 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41018340-ece3-42ca-939f-1ed90fed1aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:11.744017 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41018340-ece3-42ca-939f-1ed90fed1aa7 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:11.744304 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41018340-ece3-42ca-939f-1ed90fed1aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:11.744581 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41018340-ece3-42ca-939f-1ed90fed1aa7 None admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:11.746078 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41018340-ece3-42ca-939f-1ed90fed1aa7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:11.746394 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41018340-ece3-42ca-939f-1ed90fed1aa7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:11.748565 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41018340-ece3-42ca-939f-1ed90fed1aa7 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:11.779781 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceb959b-6b88-4493-91e5-104fdf151ec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:11.780477 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceb959b-6b88-4493-91e5-104fdf151ec9 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:11.780764 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceb959b-6b88-4493-91e5-104fdf151ec9 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:11.781120 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceb959b-6b88-4493-91e5-104fdf151ec9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:11.781630 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 361/725] 10.222.0.50 () {56 vars in 1149 bytes} [Mon Sep 5 12:04:11 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:04:11.786014 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecca126-7059-4466-a06e-876474419377 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:11.786244 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecca126-7059-4466-a06e-876474419377 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:11.786870 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecca126-7059-4466-a06e-876474419377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:11.794546 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceb959b-6b88-4493-91e5-104fdf151ec9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:11.796083 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceb959b-6b88-4493-91e5-104fdf151ec9 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:11.809001 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-9ecca126-7059-4466-a06e-876474419377 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:04:11.809691 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application [None req-6ceb959b-6b88-4493-91e5-104fdf151ec9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:04:11.809691 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:11.809691 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:04:11.809691 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:04:11.809691 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:04:11.809691 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:04:11.809691 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:04:11.809691 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:04:11.809691 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:04:11.809691 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:04:11.809691 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:04:11.809691 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:04:11.809691 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 12:04:11.809691 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 12:04:11.809691 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 12:04:11.810582 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 12:04:11.810582 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:04:11.810582 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:04:11.810582 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:04:11.810582 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:04:11.810582 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:04:11.810582 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:04:11.810582 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:04:11.810582 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application with Lock( Sep 05 12:04:11.810582 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:04:11.810582 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:04:11.810582 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:04:11.810582 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:04:11.810582 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:04:11.810582 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:04:11.810582 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:04:11.810582 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:04:11.811471 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 12:04:11.811471 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 12:04:11.811471 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 12:04:11.811471 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 12:04:11.811471 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 12:04:11.811471 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 12:04:11.811471 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:04:11.811471 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:04:11.811906 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-9ecca126-7059-4466-a06e-876474419377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:04:11.811980 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 365/726] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Sep 5 12:04:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:04:11.812585 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceb959b-6b88-4493-91e5-104fdf151ec9 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:11.836368 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:11.906546 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 362/727] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:04:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:04:11.907589 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecca126-7059-4466-a06e-876474419377 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:11.949775 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceb959b-6b88-4493-91e5-104fdf151ec9 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:11.994174 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bacff5-351f-4c78-9dd9-893f54083b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:11.995530 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bacff5-351f-4c78-9dd9-893f54083b66 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:11.995790 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bacff5-351f-4c78-9dd9-893f54083b66 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:11.996137 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bacff5-351f-4c78-9dd9-893f54083b66 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:12.034770 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecca126-7059-4466-a06e-876474419377 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:12.045444 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:12.097874 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85cd8fb-3ca5-4a6e-8979-6ed569ebed52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:12.098812 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85cd8fb-3ca5-4a6e-8979-6ed569ebed52 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:12.099243 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85cd8fb-3ca5-4a6e-8979-6ed569ebed52 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:12.099746 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85cd8fb-3ca5-4a6e-8979-6ed569ebed52 None admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:12.102305 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85cd8fb-3ca5-4a6e-8979-6ed569ebed52 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:12.104467 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85cd8fb-3ca5-4a6e-8979-6ed569ebed52 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:12.107312 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85cd8fb-3ca5-4a6e-8979-6ed569ebed52 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:12.113769 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bacff5-351f-4c78-9dd9-893f54083b66 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:12.115279 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bacff5-351f-4c78-9dd9-893f54083b66 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:12.140227 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:12.142025 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 363/728] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Sep 5 12:04:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:04:12.151160 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85cd8fb-3ca5-4a6e-8979-6ed569ebed52 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:12.241426 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 366/729] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Sep 5 12:04:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 05 12:04:12.248107 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bacff5-351f-4c78-9dd9-893f54083b66 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:12.343933 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85cd8fb-3ca5-4a6e-8979-6ed569ebed52 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:12.385499 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1180276-e560-449a-8533-c1c641e8bb1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:12.386115 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1180276-e560-449a-8533-c1c641e8bb1f None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:12.386397 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1180276-e560-449a-8533-c1c641e8bb1f None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:12.386672 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1180276-e560-449a-8533-c1c641e8bb1f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:12.387397 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1180276-e560-449a-8533-c1c641e8bb1f None admin] RBAC: Adding query filter params (role.id=16e2ccc8bd1b497d8cee780c1c7df0d2, scope.project.id=ae4f8939fcc040bca99783a77e6ede4d, user.id=cb060ff495bc4abb83ff88992fb7be09) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:12.387706 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1180276-e560-449a-8533-c1c641e8bb1f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:12.389178 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1180276-e560-449a-8533-c1c641e8bb1f None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:12.390728 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bacff5-351f-4c78-9dd9-893f54083b66 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:12.395964 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 364/730] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Sep 5 12:04:12 2022] GET /identity/v3/role_assignments?user.id=cb060ff495bc4abb83ff88992fb7be09&scope.project.id=ae4f8939fcc040bca99783a77e6ede4d&role.id=16e2ccc8bd1b497d8cee780c1c7df0d2 => generated 259 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:04:12.396911 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1180276-e560-449a-8533-c1c641e8bb1f None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:12.412457 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:12.440323 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7227365a-131b-4887-bcce-c3a22a89d865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:12.441184 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7227365a-131b-4887-bcce-c3a22a89d865 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:12.441712 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7227365a-131b-4887-bcce-c3a22a89d865 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:12.442103 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7227365a-131b-4887-bcce-c3a22a89d865 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:12.458772 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7227365a-131b-4887-bcce-c3a22a89d865 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:12.460840 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7227365a-131b-4887-bcce-c3a22a89d865 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:12.471825 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:12.483460 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application [None req-7227365a-131b-4887-bcce-c3a22a89d865 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:04:12.483460 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:12.483460 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:04:12.483460 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:04:12.483460 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:04:12.483460 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:04:12.483460 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:04:12.483460 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:04:12.483460 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:04:12.483460 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:04:12.483460 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:04:12.483460 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:04:12.483460 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:04:12.483460 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:04:12.483460 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:04:12.483460 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:04:12.484530 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:04:12.484530 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:04:12.484530 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:04:12.484530 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:04:12.484530 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:04:12.484530 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:04:12.484530 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:04:12.484530 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application with Lock( Sep 05 12:04:12.484530 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:04:12.484530 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:04:12.484530 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:04:12.484530 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:04:12.484530 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:04:12.484530 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:04:12.484530 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:04:12.484530 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:04:12.484530 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:04:12.485542 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:04:12.485542 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:04:12.485542 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:04:12.485542 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 367/731] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 5 12:04:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:04:12.487136 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810dbbe4-bcd2-48dd-80e2-ac30a8c42693 None None] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:12.487491 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810dbbe4-bcd2-48dd-80e2-ac30a8c42693 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:12.487862 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810dbbe4-bcd2-48dd-80e2-ac30a8c42693 None None] PATH_INFO: `/` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:12.494332 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 368/732] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:04:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:04:12.494332 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810dbbe4-bcd2-48dd-80e2-ac30a8c42693 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:12.549653 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1180276-e560-449a-8533-c1c641e8bb1f None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:12.591523 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01387273-0317-42fb-ad8f-2894ecff69ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:12.592175 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01387273-0317-42fb-ad8f-2894ecff69ba None admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:12.592456 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01387273-0317-42fb-ad8f-2894ecff69ba None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:12.592731 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01387273-0317-42fb-ad8f-2894ecff69ba None admin] PATH_INFO: `/v3/services` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:12.593456 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01387273-0317-42fb-ad8f-2894ecff69ba None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:12.594854 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01387273-0317-42fb-ad8f-2894ecff69ba None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:12.633141 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 365/733] 10.222.0.50 () {60 vars in 1141 bytes} [Mon Sep 5 12:04:12 2022] POST /identity/v3/services => generated 251 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:04:12.634936 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036a1dfd-9b0c-4c06-af30-239cfbadfc48 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:12.635219 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036a1dfd-9b0c-4c06-af30-239cfbadfc48 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:12.635647 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036a1dfd-9b0c-4c06-af30-239cfbadfc48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:12.653705 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810dbbe4-bcd2-48dd-80e2-ac30a8c42693 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:12.677837 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-036a1dfd-9b0c-4c06-af30-239cfbadfc48 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:04:12.679198 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-036a1dfd-9b0c-4c06-af30-239cfbadfc48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:04:12.697996 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b57079-ed03-4e3f-8b23-7198104feb1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:12.701015 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b57079-ed03-4e3f-8b23-7198104feb1c None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:12.701655 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b57079-ed03-4e3f-8b23-7198104feb1c None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:12.702145 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b57079-ed03-4e3f-8b23-7198104feb1c None admin] PATH_INFO: `/v3/domains` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:12.704029 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b57079-ed03-4e3f-8b23-7198104feb1c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:12.704788 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b57079-ed03-4e3f-8b23-7198104feb1c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:12.708178 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b57079-ed03-4e3f-8b23-7198104feb1c None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:12.735568 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 369/734] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 5 12:04:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:04:12.741679 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b57079-ed03-4e3f-8b23-7198104feb1c None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:12.779653 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:12.873537 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b57079-ed03-4e3f-8b23-7198104feb1c None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:12.874435 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 366/735] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:04:12 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 05 12:04:12.918800 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ca2076-31db-4f9e-88af-17dcb6c12501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:12.919465 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ca2076-31db-4f9e-88af-17dcb6c12501 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:12.919747 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ca2076-31db-4f9e-88af-17dcb6c12501 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:12.920084 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ca2076-31db-4f9e-88af-17dcb6c12501 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:12.928302 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ca2076-31db-4f9e-88af-17dcb6c12501 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:12.929918 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ca2076-31db-4f9e-88af-17dcb6c12501 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:12.943563 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application [None req-a2ca2076-31db-4f9e-88af-17dcb6c12501 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:04:12.943563 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:12.943563 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:04:12.943563 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:04:12.943563 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:04:12.943563 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:04:12.943563 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:04:12.943563 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:04:12.943563 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:04:12.943563 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:04:12.943563 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:04:12.943563 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:04:12.943563 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 12:04:12.943563 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 12:04:12.943563 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 12:04:12.944605 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 12:04:12.944605 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:04:12.944605 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:04:12.944605 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:04:12.944605 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:04:12.944605 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:04:12.944605 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:04:12.944605 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:04:12.944605 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application with Lock( Sep 05 12:04:12.944605 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:04:12.944605 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:04:12.944605 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:04:12.944605 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:04:12.944605 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:04:12.944605 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:04:12.944605 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:04:12.944605 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:04:12.945533 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 12:04:12.945533 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 12:04:12.945533 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 12:04:12.945533 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 12:04:12.945533 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 12:04:12.945533 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 12:04:12.945533 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:04:12.945533 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:04:12.945533 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 370/736] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Sep 5 12:04:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 12:04:12.958077 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036a1dfd-9b0c-4c06-af30-239cfbadfc48 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:12.984852 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:13.113877 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036a1dfd-9b0c-4c06-af30-239cfbadfc48 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:13.158593 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532232c5-c763-41e2-a7ec-563462c31159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:13.159770 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532232c5-c763-41e2-a7ec-563462c31159 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:13.160400 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532232c5-c763-41e2-a7ec-563462c31159 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:13.161075 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532232c5-c763-41e2-a7ec-563462c31159 None admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:13.162127 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532232c5-c763-41e2-a7ec-563462c31159 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:13.162659 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532232c5-c763-41e2-a7ec-563462c31159 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:13.164533 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532232c5-c763-41e2-a7ec-563462c31159 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:13.178764 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 367/737] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Sep 5 12:04:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:04:13.187717 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ca2076-31db-4f9e-88af-17dcb6c12501 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:13.221767 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532232c5-c763-41e2-a7ec-563462c31159 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:13.339346 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:13.361585 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:13.376117 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532232c5-c763-41e2-a7ec-563462c31159 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:13.406508 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ca2076-31db-4f9e-88af-17dcb6c12501 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:13.413425 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dbeef5-c048-434d-9819-036fe57368aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:13.414066 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dbeef5-c048-434d-9819-036fe57368aa None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:13.414351 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dbeef5-c048-434d-9819-036fe57368aa None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:13.414629 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dbeef5-c048-434d-9819-036fe57368aa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:13.426682 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dbeef5-c048-434d-9819-036fe57368aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:04:13.432922 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-23dbeef5-c048-434d-9819-036fe57368aa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 12:04:13.432922 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:13.432922 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:04:13.432922 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:04:13.432922 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:04:13.432922 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:04:13.432922 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:04:13.432922 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:04:13.432922 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:04:13.432922 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:04:13.432922 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:04:13.432922 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:04:13.432922 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:04:13.432922 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:04:13.432922 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:04:13.432922 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:04:13.433930 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:04:13.433930 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:04:13.433930 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:04:13.433930 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:04:13.433930 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:04:13.433930 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:04:13.433930 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:04:13.433930 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:04:13.433930 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:04:13.433930 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:04:13.433930 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:04:13.433930 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:04:13.433930 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:04:13.433930 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:04:13.433930 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:04:13.433930 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:04:13.434783 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:04:13.434783 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:04:13.434783 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:04:13.434783 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:04:13.434783 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:04:13.434783 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:04:13.434783 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:04:13.434783 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:04:13.434783 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:04:13.434783 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:04:13.434783 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 12:04:13.434783 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:04:13.434783 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 368/738] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Sep 5 12:04:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:04:13.439962 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dbeef5-c048-434d-9819-036fe57368aa None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:13.482332 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a051f10-4cfe-4fd2-929f-a8b6e599f50c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:13.482959 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a051f10-4cfe-4fd2-929f-a8b6e599f50c None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:13.485677 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a051f10-4cfe-4fd2-929f-a8b6e599f50c None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:13.485979 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a051f10-4cfe-4fd2-929f-a8b6e599f50c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:13.486742 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a051f10-4cfe-4fd2-929f-a8b6e599f50c None admin] RBAC: Adding query filter params (role.id=fe10209913504171981606bfdf25a9bb, scope.project.id=ae4f8939fcc040bca99783a77e6ede4d, user.id=bacc8ece8df24bf498c1d55ca2918224) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:13.487062 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a051f10-4cfe-4fd2-929f-a8b6e599f50c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:13.488536 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a051f10-4cfe-4fd2-929f-a8b6e599f50c None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:13.506704 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 371/739] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Sep 5 12:04:13 2022] GET /identity/v3/role_assignments?user.id=bacc8ece8df24bf498c1d55ca2918224&scope.project.id=ae4f8939fcc040bca99783a77e6ede4d&role.id=fe10209913504171981606bfdf25a9bb => generated 259 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:04:13.586365 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dbeef5-c048-434d-9819-036fe57368aa None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:13.632797 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ac18e3-495c-4c25-98f4-83a715d3a976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:13.633386 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ac18e3-495c-4c25-98f4-83a715d3a976 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:13.633675 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ac18e3-495c-4c25-98f4-83a715d3a976 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:13.633957 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ac18e3-495c-4c25-98f4-83a715d3a976 None admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:13.634669 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ac18e3-495c-4c25-98f4-83a715d3a976 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:13.634980 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ac18e3-495c-4c25-98f4-83a715d3a976 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:13.637041 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ac18e3-495c-4c25-98f4-83a715d3a976 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:13.648245 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 369/740] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Sep 5 12:04:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:04:13.655104 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a051f10-4cfe-4fd2-929f-a8b6e599f50c None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:13.762352 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba901cee-723d-4a06-ae4e-bddbb1dc2761 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:13.762673 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba901cee-723d-4a06-ae4e-bddbb1dc2761 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:13.762905 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba901cee-723d-4a06-ae4e-bddbb1dc2761 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:13.768937 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 370/741] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:04:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:04:13.769983 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cb904b-90e0-45cd-8fd8-835fe7a8a5a9 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:13.770272 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cb904b-90e0-45cd-8fd8-835fe7a8a5a9 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:13.770716 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cb904b-90e0-45cd-8fd8-835fe7a8a5a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:13.775043 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a051f10-4cfe-4fd2-929f-a8b6e599f50c None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:13.778272 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:13.795905 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-71cb904b-90e0-45cd-8fd8-835fe7a8a5a9 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:04:13.797541 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-71cb904b-90e0-45cd-8fd8-835fe7a8a5a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:04:13.827691 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068876b6-f63c-477b-9a40-a7650ab180a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:13.828342 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068876b6-f63c-477b-9a40-a7650ab180a8 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:13.828627 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068876b6-f63c-477b-9a40-a7650ab180a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:13.828932 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068876b6-f63c-477b-9a40-a7650ab180a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:13.850037 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068876b6-f63c-477b-9a40-a7650ab180a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:13.851500 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068876b6-f63c-477b-9a40-a7650ab180a8 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:13.880417 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application [None req-068876b6-f63c-477b-9a40-a7650ab180a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:04:13.880417 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:13.880417 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:04:13.880417 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:04:13.880417 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:04:13.880417 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:04:13.880417 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:04:13.880417 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:04:13.880417 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:04:13.880417 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:04:13.880417 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:04:13.880417 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:04:13.880417 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:04:13.880417 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:04:13.880417 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:04:13.880417 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:04:13.881507 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:04:13.881507 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:04:13.881507 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:04:13.881507 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:04:13.881507 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:04:13.881507 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:04:13.881507 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:04:13.881507 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application with Lock( Sep 05 12:04:13.881507 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:04:13.881507 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:04:13.881507 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:04:13.881507 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:04:13.881507 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:04:13.881507 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:04:13.881507 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:04:13.881507 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:04:13.881507 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:04:13.882437 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:04:13.882437 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:04:13.882437 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:04:13.883172 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 372/742] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 5 12:04:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:04:13.894241 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068876b6-f63c-477b-9a40-a7650ab180a8 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:13.899548 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:13.921885 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 371/743] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:04:13 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 05 12:04:14.019626 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068876b6-f63c-477b-9a40-a7650ab180a8 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:14.073716 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a80097a-8d0c-49b9-a9a3-6528bf554d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:14.074485 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a80097a-8d0c-49b9-a9a3-6528bf554d2b None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:14.074827 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a80097a-8d0c-49b9-a9a3-6528bf554d2b None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:14.075111 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a80097a-8d0c-49b9-a9a3-6528bf554d2b None admin] PATH_INFO: `/v3/domains` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:14.075883 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a80097a-8d0c-49b9-a9a3-6528bf554d2b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:14.076275 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a80097a-8d0c-49b9-a9a3-6528bf554d2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:14.077954 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a80097a-8d0c-49b9-a9a3-6528bf554d2b None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:14.095848 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 373/744] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 5 12:04:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:04:14.102050 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cb904b-90e0-45cd-8fd8-835fe7a8a5a9 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:14.285400 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cb904b-90e0-45cd-8fd8-835fe7a8a5a9 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:14.315001 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a80097a-8d0c-49b9-a9a3-6528bf554d2b None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:14.345218 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:14.351760 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ffda25-9050-4267-a97e-5ed9c8486280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:14.352458 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ffda25-9050-4267-a97e-5ed9c8486280 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:14.352742 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ffda25-9050-4267-a97e-5ed9c8486280 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:14.353040 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ffda25-9050-4267-a97e-5ed9c8486280 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:14.374173 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ffda25-9050-4267-a97e-5ed9c8486280 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:14.375850 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ffda25-9050-4267-a97e-5ed9c8486280 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:14.399143 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-98ffda25-9050-4267-a97e-5ed9c8486280 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 05 12:04:14.399143 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:14.399143 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:04:14.399143 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:04:14.399143 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:04:14.399143 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:04:14.399143 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:04:14.399143 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:04:14.399143 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:04:14.399143 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:04:14.399143 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:04:14.399143 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:04:14.399143 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 12:04:14.399143 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 12:04:14.399143 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 12:04:14.399143 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 12:04:14.401026 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:04:14.401026 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:04:14.401026 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 12:04:14.401026 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:04:14.401026 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 12:04:14.401026 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:04:14.401026 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:04:14.401026 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:04:14.401026 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:04:14.401026 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:04:14.401026 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:04:14.401026 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:04:14.401026 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:04:14.401026 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:04:14.401026 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:04:14.401026 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:04:14.401026 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:04:14.401026 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:04:14.402277 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:04:14.402277 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:04:14.402277 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 12:04:14.402277 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 12:04:14.402277 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 12:04:14.402277 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 12:04:14.402277 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 12:04:14.402277 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 12:04:14.402277 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 05 12:04:14.402277 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:04:14.402277 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 372/745] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Sep 5 12:04:14 2022] GET /identity/v3/users/swift => generated 83 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 12:04:14.406773 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ffda25-9050-4267-a97e-5ed9c8486280 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:14.417400 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:14.491173 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a80097a-8d0c-49b9-a9a3-6528bf554d2b None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:14.538384 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caee4738-bbf0-4a7d-9280-ed2a2200bf94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:14.540876 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caee4738-bbf0-4a7d-9280-ed2a2200bf94 None admin] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:14.541419 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caee4738-bbf0-4a7d-9280-ed2a2200bf94 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:14.542469 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caee4738-bbf0-4a7d-9280-ed2a2200bf94 None admin] PATH_INFO: `/v3/services` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:14.544449 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caee4738-bbf0-4a7d-9280-ed2a2200bf94 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:14.546891 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caee4738-bbf0-4a7d-9280-ed2a2200bf94 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:14.596231 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 374/746] 10.222.0.50 () {60 vars in 1141 bytes} [Mon Sep 5 12:04:14 2022] POST /identity/v3/services => generated 240 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:04:14.601772 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ffda25-9050-4267-a97e-5ed9c8486280 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:14.649271 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f4e423-337a-43f3-8300-708c8a6c4db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:14.650239 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f4e423-337a-43f3-8300-708c8a6c4db9 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:14.650753 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f4e423-337a-43f3-8300-708c8a6c4db9 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:14.651285 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f4e423-337a-43f3-8300-708c8a6c4db9 None admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:14.652262 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f4e423-337a-43f3-8300-708c8a6c4db9 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:14.652879 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f4e423-337a-43f3-8300-708c8a6c4db9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:14.654636 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f4e423-337a-43f3-8300-708c8a6c4db9 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:14.676223 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 373/747] 10.222.0.50 () {56 vars in 1135 bytes} [Mon Sep 5 12:04:14 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:04:14.680920 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eba1fc-4a52-406e-b330-180293eabbf9 None None] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:14.680920 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eba1fc-4a52-406e-b330-180293eabbf9 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:14.680920 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eba1fc-4a52-406e-b330-180293eabbf9 None None] PATH_INFO: `/` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:14.680920 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 375/748] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:04:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:04:14.683542 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f4e423-337a-43f3-8300-708c8a6c4db9 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:14.687244 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b3e15b-84be-4784-bda5-1d93d1086e94 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:14.687575 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b3e15b-84be-4784-bda5-1d93d1086e94 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:14.687814 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b3e15b-84be-4784-bda5-1d93d1086e94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:14.714536 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-a9b3e15b-84be-4784-bda5-1d93d1086e94 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:04:14.715825 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-a9b3e15b-84be-4784-bda5-1d93d1086e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:04:14.793046 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:14.843066 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 376/749] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:04:14 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 05 12:04:14.864710 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f4e423-337a-43f3-8300-708c8a6c4db9 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:14.906269 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5d77c3-4de9-42cd-a3c3-25ed9dcfe732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:14.906993 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5d77c3-4de9-42cd-a3c3-25ed9dcfe732 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:14.907276 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5d77c3-4de9-42cd-a3c3-25ed9dcfe732 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:14.907545 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5d77c3-4de9-42cd-a3c3-25ed9dcfe732 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:14.991824 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5d77c3-4de9-42cd-a3c3-25ed9dcfe732 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:14.993447 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5d77c3-4de9-42cd-a3c3-25ed9dcfe732 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:15.058667 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:15.134500 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b3e15b-84be-4784-bda5-1d93d1086e94 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:15.140655 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 374/750] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Sep 5 12:04:14 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 05 12:04:15.146076 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5d77c3-4de9-42cd-a3c3-25ed9dcfe732 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:15.201383 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:15.260750 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b3e15b-84be-4784-bda5-1d93d1086e94 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:15.268886 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5d77c3-4de9-42cd-a3c3-25ed9dcfe732 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:15.300527 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77681cb-7863-4a44-bad5-1d5540c0158a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:15.301457 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77681cb-7863-4a44-bad5-1d5540c0158a None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:15.301890 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77681cb-7863-4a44-bad5-1d5540c0158a None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:15.302384 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77681cb-7863-4a44-bad5-1d5540c0158a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:15.307236 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968ae1eb-0129-431e-b683-27bc4fed0ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:15.307885 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968ae1eb-0129-431e-b683-27bc4fed0ebc None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:15.308170 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968ae1eb-0129-431e-b683-27bc4fed0ebc None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:15.308446 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968ae1eb-0129-431e-b683-27bc4fed0ebc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:15.315976 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77681cb-7863-4a44-bad5-1d5540c0158a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:04:15.319612 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968ae1eb-0129-431e-b683-27bc4fed0ebc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:15.321109 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968ae1eb-0129-431e-b683-27bc4fed0ebc None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:15.322089 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application [None req-f77681cb-7863-4a44-bad5-1d5540c0158a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 12:04:15.322089 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:15.322089 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:04:15.322089 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:04:15.322089 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:04:15.322089 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:04:15.322089 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:04:15.322089 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:04:15.322089 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:04:15.322089 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:04:15.322089 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:04:15.322089 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:04:15.322089 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:04:15.322089 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:04:15.322089 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:04:15.322089 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:04:15.323572 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:04:15.323572 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:04:15.323572 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:04:15.323572 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:04:15.323572 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:04:15.323572 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:04:15.323572 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:04:15.323572 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:04:15.323572 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:04:15.323572 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:04:15.323572 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:04:15.323572 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application with Lock( Sep 05 12:04:15.323572 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:04:15.323572 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:04:15.323572 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:04:15.323572 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:04:15.324412 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:04:15.324412 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:04:15.324412 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:04:15.324412 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:04:15.324412 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:04:15.324412 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:04:15.324412 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:04:15.324412 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:04:15.324412 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:04:15.324412 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:04:15.324412 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 12:04:15.324412 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:04:15.331984 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:15.332428 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 377/751] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Sep 5 12:04:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 12:04:15.334267 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15965008-971c-456d-82c4-25a12903bae5 None None] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:15.334783 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15965008-971c-456d-82c4-25a12903bae5 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:15.335261 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15965008-971c-456d-82c4-25a12903bae5 None None] PATH_INFO: `/` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:15.337414 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 378/752] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:04:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:04:15.339027 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15965008-971c-456d-82c4-25a12903bae5 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:15.340795 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-968ae1eb-0129-431e-b683-27bc4fed0ebc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:04:15.340795 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:15.340795 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:04:15.340795 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:04:15.340795 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:04:15.340795 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:04:15.340795 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:04:15.340795 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:04:15.340795 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:04:15.340795 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:04:15.340795 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:04:15.340795 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:04:15.340795 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:04:15.340795 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:04:15.340795 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:04:15.340795 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:04:15.341754 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:04:15.341754 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:04:15.341754 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:04:15.341754 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:04:15.341754 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:04:15.341754 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:04:15.341754 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:04:15.341754 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:04:15.341754 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:04:15.341754 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:04:15.341754 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:04:15.341754 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:04:15.341754 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:04:15.341754 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:04:15.341754 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:04:15.341754 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:04:15.341754 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:04:15.342657 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:04:15.342657 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:04:15.342657 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:04:15.342657 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 375/753] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 5 12:04:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 12:04:15.348142 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3023b13-b13e-44a8-9c98-207b1f19bcb2 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:15.348430 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3023b13-b13e-44a8-9c98-207b1f19bcb2 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:15.348708 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3023b13-b13e-44a8-9c98-207b1f19bcb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:15.369564 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-d3023b13-b13e-44a8-9c98-207b1f19bcb2 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:04:15.370844 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-d3023b13-b13e-44a8-9c98-207b1f19bcb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:04:15.446231 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 376/754] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:04:15 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 12:04:15.447271 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3023b13-b13e-44a8-9c98-207b1f19bcb2 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:15.458318 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15965008-971c-456d-82c4-25a12903bae5 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:15.487955 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:15.505635 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b062afeb-5d16-4e51-b994-de1a2d19fa6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:15.507001 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b062afeb-5d16-4e51-b994-de1a2d19fa6c None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:15.507537 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b062afeb-5d16-4e51-b994-de1a2d19fa6c None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:15.508026 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b062afeb-5d16-4e51-b994-de1a2d19fa6c None admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:15.513261 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b062afeb-5d16-4e51-b994-de1a2d19fa6c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:15.513993 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b062afeb-5d16-4e51-b994-de1a2d19fa6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:15.515922 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b062afeb-5d16-4e51-b994-de1a2d19fa6c None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:15.535400 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 379/755] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Sep 5 12:04:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:04:15.541584 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b062afeb-5d16-4e51-b994-de1a2d19fa6c None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:15.569525 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3023b13-b13e-44a8-9c98-207b1f19bcb2 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:15.629196 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:15.646675 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383c559d-5fd1-4b91-81fb-be4ad5281274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:15.647305 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383c559d-5fd1-4b91-81fb-be4ad5281274 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:15.647586 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383c559d-5fd1-4b91-81fb-be4ad5281274 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:15.647859 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383c559d-5fd1-4b91-81fb-be4ad5281274 None admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:15.648928 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383c559d-5fd1-4b91-81fb-be4ad5281274 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:15.649459 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383c559d-5fd1-4b91-81fb-be4ad5281274 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:15.650561 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383c559d-5fd1-4b91-81fb-be4ad5281274 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:15.685474 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 377/756] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 5 12:04:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:04:15.691386 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383c559d-5fd1-4b91-81fb-be4ad5281274 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:15.725084 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b062afeb-5d16-4e51-b994-de1a2d19fa6c None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:15.773797 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6cee12-43c0-4cf4-b09b-ed7b592d6628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:15.776160 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6cee12-43c0-4cf4-b09b-ed7b592d6628 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:15.776884 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6cee12-43c0-4cf4-b09b-ed7b592d6628 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:15.778100 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6cee12-43c0-4cf4-b09b-ed7b592d6628 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:15.803246 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6cee12-43c0-4cf4-b09b-ed7b592d6628 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:15.804731 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6cee12-43c0-4cf4-b09b-ed7b592d6628 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:15.838135 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application [None req-9f6cee12-43c0-4cf4-b09b-ed7b592d6628 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:04:15.838135 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:15.838135 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:04:15.838135 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:04:15.838135 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:04:15.838135 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:04:15.838135 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:04:15.838135 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:04:15.838135 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:04:15.838135 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:04:15.838135 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:04:15.838135 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:04:15.838135 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:04:15.838135 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:04:15.838135 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:04:15.838135 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:04:15.839175 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:04:15.839175 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:04:15.839175 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:04:15.839175 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:04:15.839175 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:04:15.839175 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:04:15.839175 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:04:15.839175 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application with Lock( Sep 05 12:04:15.839175 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:04:15.839175 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:04:15.839175 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:04:15.839175 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:04:15.839175 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:04:15.839175 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:04:15.839175 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:04:15.839175 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:04:15.839175 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:04:15.840068 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:04:15.840068 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:04:15.840068 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:04:15.840813 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 380/757] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 5 12:04:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 12:04:15.846362 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6cee12-43c0-4cf4-b09b-ed7b592d6628 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:15.869462 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383c559d-5fd1-4b91-81fb-be4ad5281274 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:15.880456 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:15.908273 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b136770f-b180-42e1-bf37-55f3f2401abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:15.908939 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b136770f-b180-42e1-bf37-55f3f2401abf None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:15.909224 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b136770f-b180-42e1-bf37-55f3f2401abf None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:15.909496 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b136770f-b180-42e1-bf37-55f3f2401abf None admin] PATH_INFO: `/v3/projects/service` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:15.917728 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b136770f-b180-42e1-bf37-55f3f2401abf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:15.919600 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b136770f-b180-42e1-bf37-55f3f2401abf None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:15.932856 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-b136770f-b180-42e1-bf37-55f3f2401abf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:04:15.932856 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:15.932856 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:04:15.932856 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:04:15.932856 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:04:15.932856 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:04:15.932856 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:04:15.932856 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:04:15.932856 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:04:15.932856 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:04:15.932856 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:04:15.932856 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:04:15.932856 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 12:04:15.932856 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 12:04:15.932856 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 12:04:15.934036 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 12:04:15.934036 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:04:15.934036 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:04:15.934036 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:04:15.934036 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:04:15.934036 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:04:15.934036 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:04:15.934036 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:04:15.934036 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:04:15.934036 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:04:15.934036 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:04:15.934036 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:04:15.934036 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:04:15.934036 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:04:15.934036 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:04:15.934036 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:04:15.934036 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:04:15.935112 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 12:04:15.935112 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 12:04:15.935112 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 12:04:15.935112 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 12:04:15.935112 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 12:04:15.935112 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 12:04:15.935112 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:04:15.935112 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:04:15.935112 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 378/758] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Sep 5 12:04:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 12:04:15.935112 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b136770f-b180-42e1-bf37-55f3f2401abf None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:15.972797 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6cee12-43c0-4cf4-b09b-ed7b592d6628 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:15.989883 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:16.014895 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb21844-13c4-4ffd-a40f-fb5173367c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:16.015825 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb21844-13c4-4ffd-a40f-fb5173367c7a None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:16.016259 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb21844-13c4-4ffd-a40f-fb5173367c7a None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:16.016707 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb21844-13c4-4ffd-a40f-fb5173367c7a None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:16.017517 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb21844-13c4-4ffd-a40f-fb5173367c7a None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:16.019175 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb21844-13c4-4ffd-a40f-fb5173367c7a None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:16.034005 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application [None req-8bb21844-13c4-4ffd-a40f-fb5173367c7a None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 05 12:04:16.034005 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:16.034005 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 05 12:04:16.034005 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 05 12:04:16.034005 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 05 12:04:16.034005 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 05 12:04:16.034005 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 05 12:04:16.034005 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 12:04:16.034005 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 05 12:04:16.034005 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:04:16.034005 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 12:04:16.034005 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:04:16.034005 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:16.034005 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:04:16.034005 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:04:16.034005 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:04:16.034005 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:04:16.035404 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:04:16.035404 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:04:16.035404 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:04:16.035404 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:04:16.035404 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:04:16.035404 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:04:16.035404 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 05 12:04:16.035404 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 05 12:04:16.035404 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 05 12:04:16.035404 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 05 12:04:16.035404 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:04:16.035404 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:04:16.035404 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:04:16.035404 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:04:16.035404 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:04:16.035404 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:04:16.036393 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:04:16.036393 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application with Lock( Sep 05 12:04:16.036393 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:04:16.036393 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:04:16.036393 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:04:16.036393 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:04:16.036393 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:04:16.036393 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:04:16.036393 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:04:16.036393 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:04:16.036393 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 05 12:04:16.036393 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 12:04:16.036393 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 05 12:04:16.036393 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:04:16.038930 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 381/759] 10.222.0.50 () {56 vars in 1129 bytes} [Mon Sep 5 12:04:15 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 12:04:16.040265 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb21844-13c4-4ffd-a40f-fb5173367c7a None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:16.047182 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b136770f-b180-42e1-bf37-55f3f2401abf None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:16.088417 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b3628d-e523-4653-a90d-7e3ad4b40f31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:16.089161 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b3628d-e523-4653-a90d-7e3ad4b40f31 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:16.089445 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b3628d-e523-4653-a90d-7e3ad4b40f31 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:16.089727 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b3628d-e523-4653-a90d-7e3ad4b40f31 None admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:16.090512 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b3628d-e523-4653-a90d-7e3ad4b40f31 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:16.090804 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b3628d-e523-4653-a90d-7e3ad4b40f31 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:16.092216 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b3628d-e523-4653-a90d-7e3ad4b40f31 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:16.108007 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 379/760] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 5 12:04:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:04:16.108923 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b3628d-e523-4653-a90d-7e3ad4b40f31 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:16.172622 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:16.184645 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb21844-13c4-4ffd-a40f-fb5173367c7a None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:16.222612 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c2646a-b447-41c0-bf43-81107928164b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:16.223230 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c2646a-b447-41c0-bf43-81107928164b None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:16.223512 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c2646a-b447-41c0-bf43-81107928164b None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:16.223789 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c2646a-b447-41c0-bf43-81107928164b None admin] PATH_INFO: `/v3/projects` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:16.224525 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c2646a-b447-41c0-bf43-81107928164b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:16.224837 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c2646a-b447-41c0-bf43-81107928164b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:16.225236 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b3628d-e523-4653-a90d-7e3ad4b40f31 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:16.226323 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c2646a-b447-41c0-bf43-81107928164b None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:16.238928 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:16.240114 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 382/761] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Sep 5 12:04:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:04:16.241004 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c2646a-b447-41c0-bf43-81107928164b None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:16.270844 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30094e4c-1b83-4430-b7f2-f076ec63e411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:16.271468 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30094e4c-1b83-4430-b7f2-f076ec63e411 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:16.271745 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30094e4c-1b83-4430-b7f2-f076ec63e411 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:16.272023 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30094e4c-1b83-4430-b7f2-f076ec63e411 None admin] PATH_INFO: `/v3/services` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:16.272661 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30094e4c-1b83-4430-b7f2-f076ec63e411 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:16.273241 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30094e4c-1b83-4430-b7f2-f076ec63e411 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:16.274661 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30094e4c-1b83-4430-b7f2-f076ec63e411 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:16.280061 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 380/762] 10.222.0.50 () {56 vars in 1124 bytes} [Mon Sep 5 12:04:16 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:04:16.286000 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0cf755-92a2-4b52-be18-c2c770a468f4 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:16.286296 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0cf755-92a2-4b52-be18-c2c770a468f4 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:16.286561 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0cf755-92a2-4b52-be18-c2c770a468f4 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:16.288008 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 381/763] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:04:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:04:16.288601 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0cf755-92a2-4b52-be18-c2c770a468f4 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:16.364803 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c2646a-b447-41c0-bf43-81107928164b None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:16.403379 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d7a6df-2f94-4807-a9c5-c7fe62df9aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:16.403827 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0cf755-92a2-4b52-be18-c2c770a468f4 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:16.404019 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d7a6df-2f94-4807-a9c5-c7fe62df9aa9 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:16.404302 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d7a6df-2f94-4807-a9c5-c7fe62df9aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:16.404576 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d7a6df-2f94-4807-a9c5-c7fe62df9aa9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:16.412688 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d7a6df-2f94-4807-a9c5-c7fe62df9aa9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:16.414173 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d7a6df-2f94-4807-a9c5-c7fe62df9aa9 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:16.426162 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application [None req-88d7a6df-2f94-4807-a9c5-c7fe62df9aa9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 05 12:04:16.426162 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:16.426162 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:04:16.426162 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:04:16.426162 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:04:16.426162 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:04:16.426162 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:04:16.426162 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:04:16.426162 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:04:16.426162 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:04:16.426162 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:04:16.426162 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:04:16.426162 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 12:04:16.426162 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 12:04:16.426162 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 12:04:16.426162 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 12:04:16.427201 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:04:16.427201 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:04:16.427201 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 12:04:16.427201 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:04:16.427201 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 12:04:16.427201 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:04:16.427201 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:04:16.427201 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:04:16.427201 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:04:16.427201 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:04:16.427201 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:04:16.427201 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application with Lock( Sep 05 12:04:16.427201 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:04:16.427201 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:04:16.427201 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:04:16.427201 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:04:16.427201 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:04:16.427201 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:04:16.428338 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:04:16.428338 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:04:16.428338 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 12:04:16.428338 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 12:04:16.428338 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 12:04:16.428338 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 12:04:16.428338 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 12:04:16.428338 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 12:04:16.428338 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 05 12:04:16.428338 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:04:16.428338 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 383/764] 10.222.0.50 () {56 vars in 1093 bytes} [Mon Sep 5 12:04:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:04:16.428338 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d7a6df-2f94-4807-a9c5-c7fe62df9aa9 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:16.444063 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:16.448529 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28016798-f8d9-44d7-854c-b4cce5fb2641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:16.449273 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28016798-f8d9-44d7-854c-b4cce5fb2641 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:16.449614 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28016798-f8d9-44d7-854c-b4cce5fb2641 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:16.449955 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28016798-f8d9-44d7-854c-b4cce5fb2641 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:16.450701 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28016798-f8d9-44d7-854c-b4cce5fb2641 None admin] RBAC: Adding query filter params (role.id=16e2ccc8bd1b497d8cee780c1c7df0d2, scope.project.id=ae4f8939fcc040bca99783a77e6ede4d, user.id=ea2b32d58d964585a24e7c5784a8355f) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:16.451007 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28016798-f8d9-44d7-854c-b4cce5fb2641 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:16.452459 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28016798-f8d9-44d7-854c-b4cce5fb2641 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:16.458547 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 382/765] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Sep 5 12:04:16 2022] GET /identity/v3/role_assignments?user.id=ea2b32d58d964585a24e7c5784a8355f&scope.project.id=ae4f8939fcc040bca99783a77e6ede4d&role.id=16e2ccc8bd1b497d8cee780c1c7df0d2 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:04:16.459827 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616ffad6-f978-433b-8fcb-4e00be7695f8 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:16.460114 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616ffad6-f978-433b-8fcb-4e00be7695f8 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:16.460389 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616ffad6-f978-433b-8fcb-4e00be7695f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:16.480722 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-616ffad6-f978-433b-8fcb-4e00be7695f8 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:04:16.482082 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-616ffad6-f978-433b-8fcb-4e00be7695f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:04:16.517508 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:16.577654 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 383/766] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:04:16 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 12:04:16.579035 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616ffad6-f978-433b-8fcb-4e00be7695f8 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:16.580010 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d7a6df-2f94-4807-a9c5-c7fe62df9aa9 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:16.664596 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17608d92-7f9f-495a-b2c4-9d6209aa1dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:16.665212 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17608d92-7f9f-495a-b2c4-9d6209aa1dd9 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:16.665495 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17608d92-7f9f-495a-b2c4-9d6209aa1dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:16.665768 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17608d92-7f9f-495a-b2c4-9d6209aa1dd9 None admin] PATH_INFO: `/v3/services` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:16.666437 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17608d92-7f9f-495a-b2c4-9d6209aa1dd9 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:16.667286 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17608d92-7f9f-495a-b2c4-9d6209aa1dd9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:16.668712 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17608d92-7f9f-495a-b2c4-9d6209aa1dd9 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:16.680922 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 384/767] 10.222.0.50 () {56 vars in 1124 bytes} [Mon Sep 5 12:04:16 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:04:16.685074 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17608d92-7f9f-495a-b2c4-9d6209aa1dd9 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:16.811185 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:16.823105 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616ffad6-f978-433b-8fcb-4e00be7695f8 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:16.859929 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17608d92-7f9f-495a-b2c4-9d6209aa1dd9 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:16.863837 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df450565-2c0a-4ef5-abff-508189386803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:16.864584 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df450565-2c0a-4ef5-abff-508189386803 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:16.865005 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df450565-2c0a-4ef5-abff-508189386803 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:16.865378 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df450565-2c0a-4ef5-abff-508189386803 None admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:16.866828 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df450565-2c0a-4ef5-abff-508189386803 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:16.866828 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df450565-2c0a-4ef5-abff-508189386803 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:16.868297 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df450565-2c0a-4ef5-abff-508189386803 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:16.893157 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 384/768] 10.222.0.50 () {56 vars in 1133 bytes} [Mon Sep 5 12:04:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:04:16.894760 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df450565-2c0a-4ef5-abff-508189386803 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:16.925448 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:16.942111 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59739eee-5cd4-4435-a462-270fde0c40c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:16.942792 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59739eee-5cd4-4435-a462-270fde0c40c0 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:16.943133 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59739eee-5cd4-4435-a462-270fde0c40c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:16.943416 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59739eee-5cd4-4435-a462-270fde0c40c0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:16.944138 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59739eee-5cd4-4435-a462-270fde0c40c0 None admin] RBAC: Adding query filter params (interface=public, service_id=d486adce742343df8a51a668623cc804, region_id=RegionOne) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:16.944495 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59739eee-5cd4-4435-a462-270fde0c40c0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:16.949306 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59739eee-5cd4-4435-a462-270fde0c40c0 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:16.958336 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 385/769] 10.222.0.50 () {56 vars in 1251 bytes} [Mon Sep 5 12:04:16 2022] GET /identity/v3/endpoints?service_id=d486adce742343df8a51a668623cc804&interface=public®ion_id=RegionOne => generated 194 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:04:16.959197 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59739eee-5cd4-4435-a462-270fde0c40c0 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:17.018624 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df450565-2c0a-4ef5-abff-508189386803 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:17.062648 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa48f888-e485-43d6-bbb3-34f2b2a05d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:17.063295 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa48f888-e485-43d6-bbb3-34f2b2a05d64 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:17.063575 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa48f888-e485-43d6-bbb3-34f2b2a05d64 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:17.063849 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa48f888-e485-43d6-bbb3-34f2b2a05d64 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:17.074706 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa48f888-e485-43d6-bbb3-34f2b2a05d64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:17.076186 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa48f888-e485-43d6-bbb3-34f2b2a05d64 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:17.096139 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-fa48f888-e485-43d6-bbb3-34f2b2a05d64 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:04:17.096139 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:17.096139 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:04:17.096139 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:04:17.096139 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:04:17.096139 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:04:17.096139 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:04:17.096139 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:04:17.096139 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:04:17.096139 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:04:17.096139 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:04:17.096139 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:04:17.096139 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:04:17.096139 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:04:17.096139 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:04:17.096139 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:04:17.097242 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:04:17.097242 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:04:17.097242 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:04:17.097242 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:04:17.097242 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:04:17.097242 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:04:17.097242 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:04:17.097242 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:04:17.097242 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:04:17.097242 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:04:17.097242 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:04:17.097242 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:04:17.097242 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:04:17.097242 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:04:17.097242 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:04:17.097242 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:04:17.097242 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:04:17.098177 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:04:17.098177 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:04:17.098177 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:04:17.098177 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 385/770] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 5 12:04:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 12:04:17.098177 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa48f888-e485-43d6-bbb3-34f2b2a05d64 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:17.120852 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59739eee-5cd4-4435-a462-270fde0c40c0 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:17.161261 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b544cd5c-0c2f-4dad-b072-b523f9f9c59b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:17.162218 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b544cd5c-0c2f-4dad-b072-b523f9f9c59b None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:17.162506 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b544cd5c-0c2f-4dad-b072-b523f9f9c59b None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:17.162930 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b544cd5c-0c2f-4dad-b072-b523f9f9c59b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:17.171080 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:17.178030 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b544cd5c-0c2f-4dad-b072-b523f9f9c59b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:04:17.183145 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application [None req-b544cd5c-0c2f-4dad-b072-b523f9f9c59b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 05 12:04:17.183145 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:17.183145 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:04:17.183145 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:04:17.183145 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:04:17.183145 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:04:17.183145 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:04:17.183145 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:04:17.183145 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:04:17.183145 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:04:17.183145 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:04:17.183145 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:04:17.183145 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:04:17.183145 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:04:17.183145 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:04:17.183145 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:04:17.184128 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:04:17.184128 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:04:17.184128 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:04:17.184128 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:04:17.184128 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:04:17.184128 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:04:17.184128 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:04:17.184128 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:04:17.184128 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:04:17.184128 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:04:17.184128 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:04:17.184128 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application with Lock( Sep 05 12:04:17.184128 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:04:17.184128 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:04:17.184128 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:04:17.184128 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:04:17.185030 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:04:17.185030 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:04:17.185030 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:04:17.185030 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:04:17.185030 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:04:17.185030 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:04:17.185030 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:04:17.185030 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:04:17.185030 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:04:17.185030 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:04:17.185030 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 05 12:04:17.185030 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:04:17.185030 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 386/771] 10.222.0.50 () {56 vars in 1102 bytes} [Mon Sep 5 12:04:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:04:17.185790 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c1e7f5-2710-4db6-8d99-9cabcd25d4c8 None None] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:17.185861 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c1e7f5-2710-4db6-8d99-9cabcd25d4c8 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:17.186602 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c1e7f5-2710-4db6-8d99-9cabcd25d4c8 None None] PATH_INFO: `/` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:17.187528 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 387/772] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:04:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:04:17.192207 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c1e7f5-2710-4db6-8d99-9cabcd25d4c8 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:17.212073 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:17.248196 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa48f888-e485-43d6-bbb3-34f2b2a05d64 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:17.292437 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d084ede6-c35a-4960-9be0-3d93fbdb6508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:17.293102 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d084ede6-c35a-4960-9be0-3d93fbdb6508 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:17.293386 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d084ede6-c35a-4960-9be0-3d93fbdb6508 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:17.293660 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d084ede6-c35a-4960-9be0-3d93fbdb6508 None admin] PATH_INFO: `/v3/services` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:17.294408 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d084ede6-c35a-4960-9be0-3d93fbdb6508 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:17.295821 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d084ede6-c35a-4960-9be0-3d93fbdb6508 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:17.301563 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 386/773] 10.222.0.50 () {56 vars in 1087 bytes} [Mon Sep 5 12:04:17 2022] GET /identity/v3/services => generated 772 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:04:17.309992 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d084ede6-c35a-4960-9be0-3d93fbdb6508 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:17.332362 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c1e7f5-2710-4db6-8d99-9cabcd25d4c8 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:17.386636 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b483df2-0171-4f3b-9e79-1f090f377680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:17.387480 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b483df2-0171-4f3b-9e79-1f090f377680 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:17.387910 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b483df2-0171-4f3b-9e79-1f090f377680 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:17.388412 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b483df2-0171-4f3b-9e79-1f090f377680 None admin] PATH_INFO: `/v3/domains` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:17.389248 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b483df2-0171-4f3b-9e79-1f090f377680 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:17.389558 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b483df2-0171-4f3b-9e79-1f090f377680 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:17.391283 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b483df2-0171-4f3b-9e79-1f090f377680 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:17.417345 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 388/774] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 5 12:04:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:04:17.417345 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2be382-da57-4f95-8a4c-8314f8e8811d None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:17.417345 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2be382-da57-4f95-8a4c-8314f8e8811d None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:17.417345 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2be382-da57-4f95-8a4c-8314f8e8811d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:17.442908 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-1a2be382-da57-4f95-8a4c-8314f8e8811d None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:04:17.444214 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-1a2be382-da57-4f95-8a4c-8314f8e8811d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:04:17.485252 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d084ede6-c35a-4960-9be0-3d93fbdb6508 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:17.530406 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:17.543101 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5436e2-4f73-4fd4-9d98-84d21b900c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:17.544206 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5436e2-4f73-4fd4-9d98-84d21b900c7b None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:17.544678 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5436e2-4f73-4fd4-9d98-84d21b900c7b None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:17.545413 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5436e2-4f73-4fd4-9d98-84d21b900c7b None admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:17.546776 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5436e2-4f73-4fd4-9d98-84d21b900c7b None admin] RBAC: Adding query filter params (name=service) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:17.547602 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5436e2-4f73-4fd4-9d98-84d21b900c7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:17.549559 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5436e2-4f73-4fd4-9d98-84d21b900c7b None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:17.553967 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 389/775] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:04:17 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 12:04:17.560950 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2be382-da57-4f95-8a4c-8314f8e8811d None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:17.567417 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 387/776] 10.222.0.50 () {56 vars in 1103 bytes} [Mon Sep 5 12:04:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:04:17.574440 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5436e2-4f73-4fd4-9d98-84d21b900c7b None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:17.577963 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:17.731214 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2be382-da57-4f95-8a4c-8314f8e8811d None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:17.772040 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03f4e09-48b0-48e8-a5e2-2017f87b6b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:17.772724 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03f4e09-48b0-48e8-a5e2-2017f87b6b03 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:17.773301 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03f4e09-48b0-48e8-a5e2-2017f87b6b03 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:17.773587 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03f4e09-48b0-48e8-a5e2-2017f87b6b03 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:17.782025 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03f4e09-48b0-48e8-a5e2-2017f87b6b03 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:17.784307 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03f4e09-48b0-48e8-a5e2-2017f87b6b03 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:17.807947 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application [None req-b03f4e09-48b0-48e8-a5e2-2017f87b6b03 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:04:17.807947 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:17.807947 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:04:17.807947 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:04:17.807947 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:04:17.807947 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:04:17.807947 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:04:17.807947 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:04:17.807947 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:04:17.807947 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:04:17.807947 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:04:17.807947 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:04:17.807947 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 12:04:17.807947 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 12:04:17.807947 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 12:04:17.810102 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 12:04:17.810102 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:04:17.810102 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:04:17.810102 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:04:17.810102 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:04:17.810102 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:04:17.810102 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:04:17.810102 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:04:17.810102 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application with Lock( Sep 05 12:04:17.810102 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:04:17.810102 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:04:17.810102 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:04:17.810102 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:04:17.810102 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:04:17.810102 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:04:17.810102 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:04:17.810102 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:04:17.812416 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 12:04:17.812416 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 12:04:17.812416 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 12:04:17.812416 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 12:04:17.812416 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 12:04:17.812416 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 12:04:17.812416 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:04:17.812416 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:04:17.816227 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 390/777] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Sep 5 12:04:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:04:17.826534 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03f4e09-48b0-48e8-a5e2-2017f87b6b03 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:17.836442 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5436e2-4f73-4fd4-9d98-84d21b900c7b None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:17.919047 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0cbd50-9a8d-4445-8149-17e9beececc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:17.920002 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0cbd50-9a8d-4445-8149-17e9beececc1 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:17.920463 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0cbd50-9a8d-4445-8149-17e9beececc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:17.920961 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0cbd50-9a8d-4445-8149-17e9beececc1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:17.935809 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:17.945207 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0cbd50-9a8d-4445-8149-17e9beececc1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:17.947077 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0cbd50-9a8d-4445-8149-17e9beececc1 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:17.967120 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-cd0cbd50-9a8d-4445-8149-17e9beececc1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:04:17.967120 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:17.967120 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:04:17.967120 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:04:17.967120 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:04:17.967120 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:04:17.967120 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:04:17.967120 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:04:17.967120 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:04:17.967120 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:04:17.967120 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:04:17.967120 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:04:17.967120 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:04:17.967120 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:04:17.967120 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:04:17.967120 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:04:17.968168 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:04:17.968168 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:04:17.968168 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:04:17.968168 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:04:17.968168 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:04:17.968168 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:04:17.968168 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:04:17.968168 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:04:17.968168 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:04:17.968168 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:04:17.968168 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:04:17.968168 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:04:17.968168 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:04:17.968168 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:04:17.968168 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:04:17.968168 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:04:17.968168 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:04:17.969662 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:04:17.969662 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:04:17.969662 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:04:17.969662 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 388/778] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 5 12:04:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 395 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 12:04:17.969662 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0cbd50-9a8d-4445-8149-17e9beececc1 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:18.014848 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03f4e09-48b0-48e8-a5e2-2017f87b6b03 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:18.033027 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:18.067358 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6411d0d-e8f0-4356-bc59-ee1cc3d750df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:18.068696 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6411d0d-e8f0-4356-bc59-ee1cc3d750df None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:18.069189 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6411d0d-e8f0-4356-bc59-ee1cc3d750df None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:18.069614 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6411d0d-e8f0-4356-bc59-ee1cc3d750df None admin] PATH_INFO: `/v3/projects` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:18.070461 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6411d0d-e8f0-4356-bc59-ee1cc3d750df None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:18.071464 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6411d0d-e8f0-4356-bc59-ee1cc3d750df None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:18.074010 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6411d0d-e8f0-4356-bc59-ee1cc3d750df None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:18.085301 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0cbd50-9a8d-4445-8149-17e9beececc1 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:18.092320 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 391/779] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Sep 5 12:04:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:04:18.093618 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6411d0d-e8f0-4356-bc59-ee1cc3d750df None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:18.124434 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6479b90-f1b4-4e70-b65b-a15d4a287b5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:18.125118 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6479b90-f1b4-4e70-b65b-a15d4a287b5a None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:18.125401 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6479b90-f1b4-4e70-b65b-a15d4a287b5a None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:18.125777 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6479b90-f1b4-4e70-b65b-a15d4a287b5a None admin] PATH_INFO: `/v3/services/network` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:18.126305 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6479b90-f1b4-4e70-b65b-a15d4a287b5a None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:18.127743 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6479b90-f1b4-4e70-b65b-a15d4a287b5a None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:18.138224 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-f6479b90-f1b4-4e70-b65b-a15d4a287b5a None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 05 12:04:18.138224 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:18.138224 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 05 12:04:18.138224 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 05 12:04:18.138224 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 05 12:04:18.138224 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 05 12:04:18.138224 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 05 12:04:18.138224 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 12:04:18.138224 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 05 12:04:18.138224 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:04:18.138224 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 12:04:18.138224 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:04:18.138224 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:18.138224 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:04:18.138224 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:04:18.138224 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:04:18.138224 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:04:18.139272 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:04:18.139272 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:04:18.139272 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:04:18.139272 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:04:18.139272 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:04:18.139272 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:04:18.139272 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 05 12:04:18.139272 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 05 12:04:18.139272 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 05 12:04:18.139272 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 05 12:04:18.139272 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:04:18.139272 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:04:18.139272 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:04:18.139272 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:04:18.139272 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:04:18.139272 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:04:18.140118 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:04:18.140118 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:04:18.140118 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:04:18.140118 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:04:18.140118 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:04:18.140118 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:04:18.140118 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:04:18.140118 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:04:18.140118 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:04:18.140118 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:04:18.140118 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 05 12:04:18.140118 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 12:04:18.140118 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 05 12:04:18.140118 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:04:18.144756 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 389/780] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Sep 5 12:04:17 2022] GET /identity/v3/services/network => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:04:18.145176 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6479b90-f1b4-4e70-b65b-a15d4a287b5a None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:18.238771 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6411d0d-e8f0-4356-bc59-ee1cc3d750df None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:18.252335 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:18.265906 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6479b90-f1b4-4e70-b65b-a15d4a287b5a None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:18.285570 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:18.290435 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ef1e18-28cd-4634-9b21-2fd8a039cc2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:18.292710 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ef1e18-28cd-4634-9b21-2fd8a039cc2a None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:18.293209 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ef1e18-28cd-4634-9b21-2fd8a039cc2a None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:18.293660 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ef1e18-28cd-4634-9b21-2fd8a039cc2a None admin] PATH_INFO: `/v3/domains` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:18.295199 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ef1e18-28cd-4634-9b21-2fd8a039cc2a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:18.295807 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ef1e18-28cd-4634-9b21-2fd8a039cc2a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:18.297204 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ef1e18-28cd-4634-9b21-2fd8a039cc2a None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:18.313969 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 392/781] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 5 12:04:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:04:18.314911 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ef1e18-28cd-4634-9b21-2fd8a039cc2a None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:18.318757 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68ebe09-f15e-4527-9201-124ce0e347f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:18.319898 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68ebe09-f15e-4527-9201-124ce0e347f9 None admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:18.320426 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68ebe09-f15e-4527-9201-124ce0e347f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:18.321319 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68ebe09-f15e-4527-9201-124ce0e347f9 None admin] PATH_INFO: `/v3/projects/ae4f8939fcc040bca99783a77e6ede4d/users/cb060ff495bc4abb83ff88992fb7be09/roles/16e2ccc8bd1b497d8cee780c1c7df0d2` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:18.324764 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68ebe09-f15e-4527-9201-124ce0e347f9 None admin] RBAC: Authorizing `identity:create_grant(project_id=ae4f8939fcc040bca99783a77e6ede4d, user_id=cb060ff495bc4abb83ff88992fb7be09, role_id=16e2ccc8bd1b497d8cee780c1c7df0d2)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:18.327583 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68ebe09-f15e-4527-9201-124ce0e347f9 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:18.346034 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 390/782] 10.222.0.50 () {58 vars in 1439 bytes} [Mon Sep 5 12:04:18 2022] PUT /identity/v3/projects/ae4f8939fcc040bca99783a77e6ede4d/users/cb060ff495bc4abb83ff88992fb7be09/roles/16e2ccc8bd1b497d8cee780c1c7df0d2 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:04:18.347919 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68ebe09-f15e-4527-9201-124ce0e347f9 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:18.438959 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ef1e18-28cd-4634-9b21-2fd8a039cc2a None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:18.492255 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68ebe09-f15e-4527-9201-124ce0e347f9 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:18.534768 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa261da4-7660-4929-adcb-ff4f4b832cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:18.535384 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa261da4-7660-4929-adcb-ff4f4b832cc5 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:18.535676 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa261da4-7660-4929-adcb-ff4f4b832cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:18.535940 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa261da4-7660-4929-adcb-ff4f4b832cc5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:18.543288 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4518d9-4750-4f82-b3e2-e574f930c7d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:18.544258 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4518d9-4750-4f82-b3e2-e574f930c7d7 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:18.544721 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4518d9-4750-4f82-b3e2-e574f930c7d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:18.545197 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4518d9-4750-4f82-b3e2-e574f930c7d7 None admin] PATH_INFO: `/v3/services` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:18.545660 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa261da4-7660-4929-adcb-ff4f4b832cc5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:18.546221 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4518d9-4750-4f82-b3e2-e574f930c7d7 None admin] RBAC: Adding query filter params (name=network) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:18.546711 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4518d9-4750-4f82-b3e2-e574f930c7d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:18.547132 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa261da4-7660-4929-adcb-ff4f4b832cc5 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:18.548455 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4518d9-4750-4f82-b3e2-e574f930c7d7 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:18.556379 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 393/783] 10.222.0.50 () {56 vars in 1112 bytes} [Mon Sep 5 12:04:18 2022] GET /identity/v3/services?name=network => generated 124 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:04:18.562630 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4518d9-4750-4f82-b3e2-e574f930c7d7 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:18.563245 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-aa261da4-7660-4929-adcb-ff4f4b832cc5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 05 12:04:18.563245 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:18.563245 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:04:18.563245 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:04:18.563245 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:04:18.563245 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:04:18.563245 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:04:18.563245 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:04:18.563245 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:04:18.563245 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:04:18.563245 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:04:18.563245 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:04:18.563245 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 12:04:18.563245 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 12:04:18.563245 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 12:04:18.563245 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 12:04:18.564190 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:04:18.564190 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:04:18.564190 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 12:04:18.564190 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:04:18.564190 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 12:04:18.564190 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:04:18.564190 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:04:18.564190 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:04:18.564190 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:04:18.564190 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:04:18.564190 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:04:18.564190 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:04:18.564190 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:04:18.564190 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:04:18.564190 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:04:18.564190 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:04:18.564190 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:04:18.564190 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:04:18.565199 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:04:18.565199 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:04:18.565199 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 12:04:18.565199 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 12:04:18.565199 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 12:04:18.565199 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 12:04:18.565199 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 12:04:18.565199 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 12:04:18.565199 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 05 12:04:18.565199 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:04:18.567782 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 391/784] 10.222.0.50 () {56 vars in 1117 bytes} [Mon Sep 5 12:04:18 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:04:18.576580 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa261da4-7660-4929-adcb-ff4f4b832cc5 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:18.641272 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:18.793301 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:18.808443 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa261da4-7660-4929-adcb-ff4f4b832cc5 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:18.856189 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6253a71-82f6-40bd-a933-ca01bc1f838b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:18.856855 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6253a71-82f6-40bd-a933-ca01bc1f838b None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:18.857184 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6253a71-82f6-40bd-a933-ca01bc1f838b None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:18.857463 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6253a71-82f6-40bd-a933-ca01bc1f838b None admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:18.858216 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6253a71-82f6-40bd-a933-ca01bc1f838b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:18.858525 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6253a71-82f6-40bd-a933-ca01bc1f838b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:18.860086 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6253a71-82f6-40bd-a933-ca01bc1f838b None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:18.879763 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 392/785] 10.222.0.50 () {56 vars in 1149 bytes} [Mon Sep 5 12:04:18 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:04:18.884938 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cc1241-b9c0-40c1-9085-4bfe3bc9b57e None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:18.884938 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cc1241-b9c0-40c1-9085-4bfe3bc9b57e None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:18.884938 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cc1241-b9c0-40c1-9085-4bfe3bc9b57e None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:18.884938 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 393/786] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:04:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:04:18.887843 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cc1241-b9c0-40c1-9085-4bfe3bc9b57e None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:18.918303 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4518d9-4750-4f82-b3e2-e574f930c7d7 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:18.992612 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7e6960-97bf-41c7-a2da-6ded0982b28f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:18.993849 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7e6960-97bf-41c7-a2da-6ded0982b28f None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:18.995173 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7e6960-97bf-41c7-a2da-6ded0982b28f None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:18.995653 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7e6960-97bf-41c7-a2da-6ded0982b28f None admin] PATH_INFO: `/v3/services` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:18.996857 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7e6960-97bf-41c7-a2da-6ded0982b28f None admin] RBAC: Adding query filter params (type=network) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:18.997457 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7e6960-97bf-41c7-a2da-6ded0982b28f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:19.001338 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7e6960-97bf-41c7-a2da-6ded0982b28f None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:19.013240 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 394/787] 10.222.0.50 () {56 vars in 1112 bytes} [Mon Sep 5 12:04:18 2022] GET /identity/v3/services?type=network => generated 350 bytes in 451 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:04:19.016737 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64c8ebb-c9e3-4b6a-95e6-7e59390ed900 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:19.018040 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64c8ebb-c9e3-4b6a-95e6-7e59390ed900 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:19.019017 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64c8ebb-c9e3-4b6a-95e6-7e59390ed900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:19.034392 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:19.038031 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cc1241-b9c0-40c1-9085-4bfe3bc9b57e None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:19.063092 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-e64c8ebb-c9e3-4b6a-95e6-7e59390ed900 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:04:19.066184 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-e64c8ebb-c9e3-4b6a-95e6-7e59390ed900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:04:19.103602 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e44be48-2620-4a56-ac28-7c23aaebbcbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:19.105598 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e44be48-2620-4a56-ac28-7c23aaebbcbc None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:19.106329 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e44be48-2620-4a56-ac28-7c23aaebbcbc None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:19.107583 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e44be48-2620-4a56-ac28-7c23aaebbcbc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:19.130415 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e44be48-2620-4a56-ac28-7c23aaebbcbc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:19.133180 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e44be48-2620-4a56-ac28-7c23aaebbcbc None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:19.155837 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-1e44be48-2620-4a56-ac28-7c23aaebbcbc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:04:19.155837 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:19.155837 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:04:19.155837 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:04:19.155837 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:04:19.155837 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:04:19.155837 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:04:19.155837 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:04:19.155837 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:04:19.155837 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:04:19.155837 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:04:19.155837 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:04:19.155837 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:04:19.155837 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:04:19.155837 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:04:19.155837 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:04:19.156978 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:04:19.156978 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:04:19.156978 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:04:19.156978 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:04:19.156978 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:04:19.156978 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:04:19.156978 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:04:19.156978 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:04:19.156978 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:04:19.156978 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:04:19.156978 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:04:19.156978 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:04:19.156978 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:04:19.156978 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:04:19.156978 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:04:19.156978 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:04:19.156978 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:04:19.158555 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:04:19.158555 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:04:19.158555 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:04:19.158555 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 394/788] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 5 12:04:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:04:19.158555 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e44be48-2620-4a56-ac28-7c23aaebbcbc None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:19.186972 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 395/789] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:04:19 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 12:04:19.188412 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64c8ebb-c9e3-4b6a-95e6-7e59390ed900 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:19.246850 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:19.341093 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e44be48-2620-4a56-ac28-7c23aaebbcbc None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:19.382005 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1a329f-2160-4de5-b0a7-dc71752888e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:19.384586 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1a329f-2160-4de5-b0a7-dc71752888e5 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:19.384956 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1a329f-2160-4de5-b0a7-dc71752888e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:19.385812 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1a329f-2160-4de5-b0a7-dc71752888e5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:19.386540 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1a329f-2160-4de5-b0a7-dc71752888e5 None admin] RBAC: Adding query filter params (interface=public, service_id=4b07c5d3d14a4e5aa0457527a1c14e24, region_id=RegionOne) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:19.386853 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1a329f-2160-4de5-b0a7-dc71752888e5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:19.388261 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1a329f-2160-4de5-b0a7-dc71752888e5 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:19.398993 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64c8ebb-c9e3-4b6a-95e6-7e59390ed900 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:19.412079 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 395/790] 10.222.0.50 () {56 vars in 1251 bytes} [Mon Sep 5 12:04:19 2022] GET /identity/v3/endpoints?service_id=4b07c5d3d14a4e5aa0457527a1c14e24&interface=public®ion_id=RegionOne => generated 194 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:04:19.417394 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1a329f-2160-4de5-b0a7-dc71752888e5 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:19.450847 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:19.537656 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c9cfad-b391-42d7-b78f-03543c2ef798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:19.538301 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c9cfad-b391-42d7-b78f-03543c2ef798 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:19.538582 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c9cfad-b391-42d7-b78f-03543c2ef798 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:19.538857 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c9cfad-b391-42d7-b78f-03543c2ef798 None admin] PATH_INFO: `/v3/domains` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:19.539524 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c9cfad-b391-42d7-b78f-03543c2ef798 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:19.539829 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c9cfad-b391-42d7-b78f-03543c2ef798 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:19.543968 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c9cfad-b391-42d7-b78f-03543c2ef798 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:19.554036 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 396/791] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 5 12:04:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:04:19.555072 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c9cfad-b391-42d7-b78f-03543c2ef798 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:19.563260 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1a329f-2160-4de5-b0a7-dc71752888e5 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:19.621507 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d2f1cd-cbf2-4dd0-a225-150ae7038df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:19.622447 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d2f1cd-cbf2-4dd0-a225-150ae7038df7 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:19.622735 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d2f1cd-cbf2-4dd0-a225-150ae7038df7 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:19.623018 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d2f1cd-cbf2-4dd0-a225-150ae7038df7 None admin] PATH_INFO: `/v3/services` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:19.623919 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d2f1cd-cbf2-4dd0-a225-150ae7038df7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:19.626129 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d2f1cd-cbf2-4dd0-a225-150ae7038df7 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:19.633222 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 396/792] 10.222.0.50 () {56 vars in 1087 bytes} [Mon Sep 5 12:04:19 2022] GET /identity/v3/services => generated 772 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:04:19.634151 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d2f1cd-cbf2-4dd0-a225-150ae7038df7 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:19.658290 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:19.679590 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c9cfad-b391-42d7-b78f-03543c2ef798 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:19.718212 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f73cf5b-bfd7-4100-ade8-a1ab62ef07bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:19.718869 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f73cf5b-bfd7-4100-ade8-a1ab62ef07bb None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:19.719152 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f73cf5b-bfd7-4100-ade8-a1ab62ef07bb None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:19.719427 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f73cf5b-bfd7-4100-ade8-a1ab62ef07bb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:19.735916 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f73cf5b-bfd7-4100-ade8-a1ab62ef07bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:04:19.743550 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application [None req-3f73cf5b-bfd7-4100-ade8-a1ab62ef07bb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 12:04:19.743550 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:19.743550 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:04:19.743550 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:04:19.743550 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:04:19.743550 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:04:19.743550 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:04:19.743550 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:04:19.743550 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:04:19.743550 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:04:19.743550 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:04:19.743550 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:04:19.743550 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:04:19.743550 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:04:19.743550 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:04:19.743550 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:04:19.745198 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:04:19.745198 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:04:19.745198 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:04:19.745198 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:04:19.745198 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:04:19.745198 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:04:19.745198 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:04:19.745198 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:04:19.745198 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:04:19.745198 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:04:19.745198 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:04:19.745198 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application with Lock( Sep 05 12:04:19.745198 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:04:19.745198 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:04:19.745198 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:04:19.745198 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:04:19.746726 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:04:19.746726 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:04:19.746726 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:04:19.746726 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:04:19.746726 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:04:19.746726 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:04:19.746726 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:04:19.746726 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:04:19.746726 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:04:19.746726 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:04:19.746726 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 12:04:19.746726 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:04:19.746726 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 397/793] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Sep 5 12:04:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:04:19.747437 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559fd7b2-d4c3-4cee-9f10-e17511127ee0 None None] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:19.747437 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559fd7b2-d4c3-4cee-9f10-e17511127ee0 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:19.747437 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559fd7b2-d4c3-4cee-9f10-e17511127ee0 None None] PATH_INFO: `/` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:19.748918 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 398/794] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:04:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:04:19.751188 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559fd7b2-d4c3-4cee-9f10-e17511127ee0 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:19.759133 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:19.773591 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d2f1cd-cbf2-4dd0-a225-150ae7038df7 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:19.839729 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0a7537-08be-42c3-85ec-9e5605cdd623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:19.840577 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0a7537-08be-42c3-85ec-9e5605cdd623 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:19.840691 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0a7537-08be-42c3-85ec-9e5605cdd623 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:19.840921 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0a7537-08be-42c3-85ec-9e5605cdd623 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:19.850829 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0a7537-08be-42c3-85ec-9e5605cdd623 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:19.852410 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0a7537-08be-42c3-85ec-9e5605cdd623 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:19.866890 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-2c0a7537-08be-42c3-85ec-9e5605cdd623 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:04:19.866890 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:19.866890 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:04:19.866890 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:04:19.866890 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:04:19.866890 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:04:19.866890 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:04:19.866890 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:04:19.866890 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:04:19.866890 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:04:19.866890 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:04:19.866890 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:04:19.866890 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 12:04:19.866890 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 12:04:19.866890 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 12:04:19.868030 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 12:04:19.868030 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:04:19.868030 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:04:19.868030 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:04:19.868030 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:04:19.868030 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:04:19.868030 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:04:19.868030 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:04:19.868030 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:04:19.868030 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:04:19.868030 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:04:19.868030 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:04:19.868030 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:04:19.868030 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:04:19.868030 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:04:19.868030 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:04:19.868030 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:04:19.869053 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 12:04:19.869053 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 12:04:19.869053 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 12:04:19.869053 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 12:04:19.869053 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 12:04:19.869053 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 12:04:19.869053 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:04:19.869053 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:04:19.869053 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 397/795] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Sep 5 12:04:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:04:19.869644 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061ec681-d611-4b22-aca3-1a51e30a3719 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:19.870513 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061ec681-d611-4b22-aca3-1a51e30a3719 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:19.870816 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061ec681-d611-4b22-aca3-1a51e30a3719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:19.896589 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-061ec681-d611-4b22-aca3-1a51e30a3719 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:04:19.898311 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-061ec681-d611-4b22-aca3-1a51e30a3719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:04:19.904011 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559fd7b2-d4c3-4cee-9f10-e17511127ee0 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:19.956336 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a287f4-3c8a-4643-b6fb-d3f0664b615a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:19.956982 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a287f4-3c8a-4643-b6fb-d3f0664b615a None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:19.957442 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a287f4-3c8a-4643-b6fb-d3f0664b615a None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:19.957720 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a287f4-3c8a-4643-b6fb-d3f0664b615a None admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:19.958804 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a287f4-3c8a-4643-b6fb-d3f0664b615a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:19.959264 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a287f4-3c8a-4643-b6fb-d3f0664b615a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:19.960946 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a287f4-3c8a-4643-b6fb-d3f0664b615a None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:19.972470 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 399/796] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Sep 5 12:04:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:04:19.973492 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a287f4-3c8a-4643-b6fb-d3f0664b615a None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:19.987924 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:19.988214 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 398/797] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:04:19 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 12:04:19.996050 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061ec681-d611-4b22-aca3-1a51e30a3719 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:20.149015 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:20.181423 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a287f4-3c8a-4643-b6fb-d3f0664b615a None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:20.211277 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061ec681-d611-4b22-aca3-1a51e30a3719 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:20.225215 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2915911f-d33f-49ee-b42e-5b2bd6b5e2d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:20.225844 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2915911f-d33f-49ee-b42e-5b2bd6b5e2d8 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:20.226167 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2915911f-d33f-49ee-b42e-5b2bd6b5e2d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:20.226444 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2915911f-d33f-49ee-b42e-5b2bd6b5e2d8 None admin] PATH_INFO: `/v3/projects` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:20.227171 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2915911f-d33f-49ee-b42e-5b2bd6b5e2d8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:20.227483 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2915911f-d33f-49ee-b42e-5b2bd6b5e2d8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:20.229661 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2915911f-d33f-49ee-b42e-5b2bd6b5e2d8 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:20.249208 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 400/798] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Sep 5 12:04:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:04:20.250628 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2915911f-d33f-49ee-b42e-5b2bd6b5e2d8 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:20.341458 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:20.389591 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2915911f-d33f-49ee-b42e-5b2bd6b5e2d8 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:20.429054 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb05112-bc52-4ec8-b35a-9a0ac78f093d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:20.430035 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb05112-bc52-4ec8-b35a-9a0ac78f093d None admin] REQUEST_METHOD: `PUT` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:20.430313 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb05112-bc52-4ec8-b35a-9a0ac78f093d None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:20.430691 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb05112-bc52-4ec8-b35a-9a0ac78f093d None admin] PATH_INFO: `/v3/projects/ae4f8939fcc040bca99783a77e6ede4d/users/bacc8ece8df24bf498c1d55ca2918224/roles/fe10209913504171981606bfdf25a9bb` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:20.435505 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997b8b7f-fb39-42c4-9f46-bc16967cc748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:20.436375 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997b8b7f-fb39-42c4-9f46-bc16967cc748 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:20.436859 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997b8b7f-fb39-42c4-9f46-bc16967cc748 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:20.437337 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997b8b7f-fb39-42c4-9f46-bc16967cc748 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:20.447454 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb05112-bc52-4ec8-b35a-9a0ac78f093d None admin] RBAC: Authorizing `identity:create_grant(project_id=ae4f8939fcc040bca99783a77e6ede4d, user_id=bacc8ece8df24bf498c1d55ca2918224, role_id=fe10209913504171981606bfdf25a9bb)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:20.449474 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997b8b7f-fb39-42c4-9f46-bc16967cc748 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:20.449644 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb05112-bc52-4ec8-b35a-9a0ac78f093d None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:20.451395 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997b8b7f-fb39-42c4-9f46-bc16967cc748 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:20.469746 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-997b8b7f-fb39-42c4-9f46-bc16967cc748 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:04:20.469746 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:20.469746 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:04:20.469746 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:04:20.469746 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:04:20.469746 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:04:20.469746 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:04:20.469746 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:04:20.469746 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:04:20.469746 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:04:20.469746 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:04:20.469746 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:04:20.469746 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:04:20.469746 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:04:20.469746 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:04:20.469746 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:04:20.470793 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:04:20.470793 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:04:20.470793 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:04:20.470793 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:04:20.470793 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:04:20.470793 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:04:20.470793 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:04:20.470793 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:04:20.470793 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:04:20.470793 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:04:20.470793 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:04:20.470793 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:04:20.470793 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:04:20.470793 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:04:20.470793 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:04:20.470793 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:04:20.470793 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:04:20.471778 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:04:20.471778 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:04:20.471778 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:04:20.471953 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 401/799] 10.222.0.50 () {58 vars in 1439 bytes} [Mon Sep 5 12:04:20 2022] PUT /identity/v3/projects/ae4f8939fcc040bca99783a77e6ede4d/users/bacc8ece8df24bf498c1d55ca2918224/roles/fe10209913504171981606bfdf25a9bb => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:04:20.472704 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb05112-bc52-4ec8-b35a-9a0ac78f093d None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:20.474505 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 399/800] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 5 12:04:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 486 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:04:20.482098 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997b8b7f-fb39-42c4-9f46-bc16967cc748 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:20.639211 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997b8b7f-fb39-42c4-9f46-bc16967cc748 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:20.666921 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:20.691456 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcaccad-b13e-409c-8941-07cc98a28998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:20.692001 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcaccad-b13e-409c-8941-07cc98a28998 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:20.692282 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcaccad-b13e-409c-8941-07cc98a28998 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:20.692555 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcaccad-b13e-409c-8941-07cc98a28998 None admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:20.693419 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcaccad-b13e-409c-8941-07cc98a28998 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:20.693729 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcaccad-b13e-409c-8941-07cc98a28998 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:20.695503 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcaccad-b13e-409c-8941-07cc98a28998 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:20.712698 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 400/801] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 5 12:04:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:04:20.718790 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fee66e6-3564-4a75-81f4-8111e0eaf1e8 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:20.719114 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fee66e6-3564-4a75-81f4-8111e0eaf1e8 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:20.719494 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fee66e6-3564-4a75-81f4-8111e0eaf1e8 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:20.720856 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 401/802] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:04:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:04:20.721522 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fee66e6-3564-4a75-81f4-8111e0eaf1e8 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:20.729530 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb05112-bc52-4ec8-b35a-9a0ac78f093d None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:20.748984 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:20.774686 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb01c20-7535-4e7b-814a-f866a913b057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:20.775336 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb01c20-7535-4e7b-814a-f866a913b057 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:20.775617 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb01c20-7535-4e7b-814a-f866a913b057 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:20.776459 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb01c20-7535-4e7b-814a-f866a913b057 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:20.777099 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb01c20-7535-4e7b-814a-f866a913b057 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:20.778477 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb01c20-7535-4e7b-814a-f866a913b057 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:20.792307 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application [None req-0fb01c20-7535-4e7b-814a-f866a913b057 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 05 12:04:20.792307 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:20.792307 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 05 12:04:20.792307 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 05 12:04:20.792307 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 05 12:04:20.792307 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 05 12:04:20.792307 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 05 12:04:20.792307 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 12:04:20.792307 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 05 12:04:20.792307 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:04:20.792307 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 12:04:20.792307 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:04:20.792307 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:20.792307 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:04:20.792307 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:04:20.792307 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:04:20.792307 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:04:20.793390 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:04:20.793390 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:04:20.793390 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:04:20.793390 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:04:20.793390 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:04:20.793390 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:04:20.793390 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 05 12:04:20.793390 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 05 12:04:20.793390 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 05 12:04:20.793390 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 05 12:04:20.793390 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:04:20.793390 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:04:20.793390 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:04:20.793390 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:04:20.793390 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:04:20.793390 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:04:20.795239 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:04:20.795239 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application with Lock( Sep 05 12:04:20.795239 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:04:20.795239 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:04:20.795239 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:04:20.795239 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:04:20.795239 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:04:20.795239 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:04:20.795239 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:04:20.795239 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:04:20.795239 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 05 12:04:20.795239 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 12:04:20.795239 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 05 12:04:20.795239 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:04:20.795239 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 402/803] 10.222.0.50 () {56 vars in 1129 bytes} [Mon Sep 5 12:04:20 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:04:20.796059 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa0c890-c272-494d-8585-b413fcd1a567 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:20.796059 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa0c890-c272-494d-8585-b413fcd1a567 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:20.796059 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa0c890-c272-494d-8585-b413fcd1a567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:20.819816 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-dfa0c890-c272-494d-8585-b413fcd1a567 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:04:20.821690 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-dfa0c890-c272-494d-8585-b413fcd1a567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:04:20.876049 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fee66e6-3564-4a75-81f4-8111e0eaf1e8 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:20.916298 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 403/804] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:04:20 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 12:04:20.918002 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa0c890-c272-494d-8585-b413fcd1a567 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:20.930083 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11307da-5c12-4183-aad5-316e3a161d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:20.930754 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11307da-5c12-4183-aad5-316e3a161d6c None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:20.931087 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11307da-5c12-4183-aad5-316e3a161d6c None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:20.931361 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11307da-5c12-4183-aad5-316e3a161d6c None admin] PATH_INFO: `/v3/users/swift` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:20.942113 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11307da-5c12-4183-aad5-316e3a161d6c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:20.944456 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11307da-5c12-4183-aad5-316e3a161d6c None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:20.969377 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-d11307da-5c12-4183-aad5-316e3a161d6c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 05 12:04:20.969377 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:20.969377 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:04:20.969377 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:04:20.969377 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:04:20.969377 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:04:20.969377 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:04:20.969377 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:04:20.969377 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:04:20.969377 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:04:20.969377 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:04:20.969377 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:04:20.969377 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 12:04:20.969377 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 12:04:20.969377 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 12:04:20.969377 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 12:04:20.970400 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:04:20.970400 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:04:20.970400 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 12:04:20.970400 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:04:20.970400 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 12:04:20.970400 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:04:20.970400 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:04:20.970400 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:04:20.970400 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:04:20.970400 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:04:20.970400 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:04:20.970400 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:04:20.970400 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:04:20.970400 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:04:20.970400 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:04:20.970400 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:04:20.970400 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:04:20.970400 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:04:20.971774 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:04:20.971774 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:04:20.971774 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 12:04:20.971774 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 12:04:20.971774 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 12:04:20.971774 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 12:04:20.971774 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 12:04:20.971774 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 12:04:20.971774 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 05 12:04:20.971774 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:04:20.971774 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 402/805] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Sep 5 12:04:20 2022] GET /identity/v3/users/swift => generated 83 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:04:20.992656 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11307da-5c12-4183-aad5-316e3a161d6c None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:21.068620 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa0c890-c272-494d-8585-b413fcd1a567 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:21.084270 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:21.087369 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:21.109302 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fda3036-4fed-438e-a144-605f0a854775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:21.109995 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fda3036-4fed-438e-a144-605f0a854775 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:21.110244 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fda3036-4fed-438e-a144-605f0a854775 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:21.110565 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fda3036-4fed-438e-a144-605f0a854775 None admin] PATH_INFO: `/v3/services` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:21.111211 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fda3036-4fed-438e-a144-605f0a854775 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:21.111517 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fda3036-4fed-438e-a144-605f0a854775 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:21.112877 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fda3036-4fed-438e-a144-605f0a854775 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:21.118140 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 404/806] 10.222.0.50 () {56 vars in 1124 bytes} [Mon Sep 5 12:04:20 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:04:21.125817 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fda3036-4fed-438e-a144-605f0a854775 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:21.205689 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11307da-5c12-4183-aad5-316e3a161d6c None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:21.244364 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc899d4-cf40-4d53-8659-3cb9f066a65f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:21.245754 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc899d4-cf40-4d53-8659-3cb9f066a65f None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:21.246195 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc899d4-cf40-4d53-8659-3cb9f066a65f None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:21.246641 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc899d4-cf40-4d53-8659-3cb9f066a65f None admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:21.247410 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc899d4-cf40-4d53-8659-3cb9f066a65f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:21.247722 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc899d4-cf40-4d53-8659-3cb9f066a65f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:21.249249 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc899d4-cf40-4d53-8659-3cb9f066a65f None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:21.287464 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 403/807] 10.222.0.50 () {56 vars in 1135 bytes} [Mon Sep 5 12:04:20 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:04:21.288401 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc899d4-cf40-4d53-8659-3cb9f066a65f None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:21.290071 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fda3036-4fed-438e-a144-605f0a854775 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:21.339552 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d67dd03-1599-449c-a912-cf17eb96e33f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:21.340375 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d67dd03-1599-449c-a912-cf17eb96e33f None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:21.341142 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d67dd03-1599-449c-a912-cf17eb96e33f None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:21.341423 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d67dd03-1599-449c-a912-cf17eb96e33f None admin] PATH_INFO: `/v3/services` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:21.342077 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d67dd03-1599-449c-a912-cf17eb96e33f None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:21.342384 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d67dd03-1599-449c-a912-cf17eb96e33f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:21.344786 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d67dd03-1599-449c-a912-cf17eb96e33f None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:21.352463 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 405/808] 10.222.0.50 () {56 vars in 1124 bytes} [Mon Sep 5 12:04:21 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:04:21.353822 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d67dd03-1599-449c-a912-cf17eb96e33f None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:21.403946 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:21.408615 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:21.412767 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc899d4-cf40-4d53-8659-3cb9f066a65f None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:21.459040 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e58d51-72ee-4689-a16c-d0a92541c544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:21.459970 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e58d51-72ee-4689-a16c-d0a92541c544 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:21.460429 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e58d51-72ee-4689-a16c-d0a92541c544 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:21.460881 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e58d51-72ee-4689-a16c-d0a92541c544 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:21.474869 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d67dd03-1599-449c-a912-cf17eb96e33f None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:21.475854 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e58d51-72ee-4689-a16c-d0a92541c544 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:04:21.482139 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-91e58d51-72ee-4689-a16c-d0a92541c544 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 12:04:21.482139 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:21.482139 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:04:21.482139 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:04:21.482139 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:04:21.482139 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:04:21.482139 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:04:21.482139 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:04:21.482139 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:04:21.482139 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:04:21.482139 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:04:21.482139 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:04:21.482139 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:04:21.482139 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:04:21.482139 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:04:21.482139 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:04:21.483129 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:04:21.483129 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:04:21.483129 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:04:21.483129 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:04:21.483129 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:04:21.483129 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:04:21.483129 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:04:21.483129 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:04:21.483129 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:04:21.483129 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:04:21.483129 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:04:21.483129 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:04:21.483129 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:04:21.483129 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:04:21.483129 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:04:21.483129 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:04:21.483979 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:04:21.483979 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:04:21.483979 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:04:21.483979 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:04:21.483979 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:04:21.483979 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:04:21.483979 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:04:21.483979 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:04:21.483979 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:04:21.483979 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:04:21.483979 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 12:04:21.483979 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:04:21.491544 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 404/809] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Sep 5 12:04:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:04:21.491544 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e58d51-72ee-4689-a16c-d0a92541c544 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:21.519862 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad9777e-86f2-489f-8663-f130b7dc7b95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:21.520303 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad9777e-86f2-489f-8663-f130b7dc7b95 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:21.520604 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad9777e-86f2-489f-8663-f130b7dc7b95 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:21.520915 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad9777e-86f2-489f-8663-f130b7dc7b95 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:21.533642 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad9777e-86f2-489f-8663-f130b7dc7b95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:21.535102 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad9777e-86f2-489f-8663-f130b7dc7b95 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:21.552097 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application [None req-5ad9777e-86f2-489f-8663-f130b7dc7b95 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:04:21.552097 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:21.552097 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:04:21.552097 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:04:21.552097 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:04:21.552097 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:04:21.552097 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:04:21.552097 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:04:21.552097 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:04:21.552097 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:04:21.552097 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:04:21.552097 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:04:21.552097 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:04:21.552097 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:04:21.552097 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:04:21.552097 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:04:21.553157 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:04:21.553157 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:04:21.553157 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:04:21.553157 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:04:21.553157 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:04:21.553157 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:04:21.553157 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:04:21.553157 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application with Lock( Sep 05 12:04:21.553157 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:04:21.553157 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:04:21.553157 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:04:21.553157 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:04:21.553157 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:04:21.553157 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:04:21.553157 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:04:21.553157 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:04:21.553157 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:04:21.554045 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:04:21.554045 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:04:21.554045 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:04:21.554045 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 406/810] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 5 12:04:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:04:21.554763 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad9777e-86f2-489f-8663-f130b7dc7b95 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:21.625845 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e58d51-72ee-4689-a16c-d0a92541c544 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:21.658041 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:21.669705 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad9777e-86f2-489f-8663-f130b7dc7b95 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:21.671814 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02868301-b52e-466c-8aea-bacc1172dbcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:21.673150 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02868301-b52e-466c-8aea-bacc1172dbcd None admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:21.673647 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02868301-b52e-466c-8aea-bacc1172dbcd None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:21.674120 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02868301-b52e-466c-8aea-bacc1172dbcd None admin] PATH_INFO: `/v3/endpoints` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:21.675057 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02868301-b52e-466c-8aea-bacc1172dbcd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:21.676741 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02868301-b52e-466c-8aea-bacc1172dbcd None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:21.709003 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 405/811] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 5 12:04:21 2022] POST /identity/v3/endpoints => generated 346 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:04:21.710349 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02868301-b52e-466c-8aea-bacc1172dbcd None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:21.721004 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b6f5ef-fe6c-4c06-a12f-b9a93dafc3d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:21.721811 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b6f5ef-fe6c-4c06-a12f-b9a93dafc3d6 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:21.722190 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b6f5ef-fe6c-4c06-a12f-b9a93dafc3d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:21.722565 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b6f5ef-fe6c-4c06-a12f-b9a93dafc3d6 None admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:21.723468 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b6f5ef-fe6c-4c06-a12f-b9a93dafc3d6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:21.723801 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b6f5ef-fe6c-4c06-a12f-b9a93dafc3d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:21.725569 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b6f5ef-fe6c-4c06-a12f-b9a93dafc3d6 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:21.731207 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:21.737401 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 407/812] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Sep 5 12:04:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:04:21.744060 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b6f5ef-fe6c-4c06-a12f-b9a93dafc3d6 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:21.920071 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02868301-b52e-466c-8aea-bacc1172dbcd None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:21.942887 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b6f5ef-fe6c-4c06-a12f-b9a93dafc3d6 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:21.965112 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fe7229-bf10-4138-ac0d-140bbd108f82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:21.966067 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fe7229-bf10-4138-ac0d-140bbd108f82 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:21.966548 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fe7229-bf10-4138-ac0d-140bbd108f82 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:21.967011 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fe7229-bf10-4138-ac0d-140bbd108f82 None admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:21.967671 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fe7229-bf10-4138-ac0d-140bbd108f82 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:21.967981 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fe7229-bf10-4138-ac0d-140bbd108f82 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:21.969421 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fe7229-bf10-4138-ac0d-140bbd108f82 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:21.983116 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 406/813] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 5 12:04:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:04:21.989776 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128de4cc-b3c1-4156-82ff-e58b63248f8e None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:21.990094 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128de4cc-b3c1-4156-82ff-e58b63248f8e None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:21.990938 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128de4cc-b3c1-4156-82ff-e58b63248f8e None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:21.992150 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 407/814] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:04:21 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:04:21.992269 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159688b3-bdb6-441e-a0b9-9cc3d5ec4399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:21.992729 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159688b3-bdb6-441e-a0b9-9cc3d5ec4399 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:21.993319 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159688b3-bdb6-441e-a0b9-9cc3d5ec4399 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:21.993319 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159688b3-bdb6-441e-a0b9-9cc3d5ec4399 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:21.995362 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128de4cc-b3c1-4156-82ff-e58b63248f8e None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:22.011698 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159688b3-bdb6-441e-a0b9-9cc3d5ec4399 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:22.013338 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159688b3-bdb6-441e-a0b9-9cc3d5ec4399 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:22.037774 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application [None req-159688b3-bdb6-441e-a0b9-9cc3d5ec4399 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:04:22.037774 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:22.037774 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:04:22.037774 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:04:22.037774 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:04:22.037774 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:04:22.037774 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:04:22.037774 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:04:22.037774 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:04:22.037774 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:04:22.037774 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:04:22.037774 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:04:22.037774 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:04:22.037774 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:04:22.037774 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:04:22.037774 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:04:22.038820 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:04:22.038820 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:04:22.038820 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:04:22.038820 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:04:22.038820 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:04:22.038820 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:04:22.038820 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:04:22.038820 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application with Lock( Sep 05 12:04:22.038820 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:04:22.038820 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:04:22.038820 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:04:22.038820 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:04:22.038820 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:04:22.038820 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:04:22.038820 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:04:22.038820 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:04:22.038820 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:04:22.039753 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:04:22.039753 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:04:22.039753 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:04:22.039753 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 408/815] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 5 12:04:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 12:04:22.040789 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a164fc6-af97-475f-aab2-37be19a389b5 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:22.041102 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a164fc6-af97-475f-aab2-37be19a389b5 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:22.041900 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a164fc6-af97-475f-aab2-37be19a389b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:22.050352 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:22.070120 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-4a164fc6-af97-475f-aab2-37be19a389b5 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:04:22.071342 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-4a164fc6-af97-475f-aab2-37be19a389b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:04:22.091448 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:22.127805 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128de4cc-b3c1-4156-82ff-e58b63248f8e None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:22.168711 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94173bd2-5b95-4a6c-b39b-6c659622d2f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:22.169764 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94173bd2-5b95-4a6c-b39b-6c659622d2f2 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:22.170247 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94173bd2-5b95-4a6c-b39b-6c659622d2f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:22.176214 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 409/816] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:04:22 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 12:04:22.176214 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a164fc6-af97-475f-aab2-37be19a389b5 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:22.176853 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94173bd2-5b95-4a6c-b39b-6c659622d2f2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:22.198154 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94173bd2-5b95-4a6c-b39b-6c659622d2f2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:22.200025 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94173bd2-5b95-4a6c-b39b-6c659622d2f2 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:22.234836 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-94173bd2-5b95-4a6c-b39b-6c659622d2f2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:04:22.234836 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:22.234836 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:04:22.234836 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:04:22.234836 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:04:22.234836 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:04:22.234836 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:04:22.234836 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:04:22.234836 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:04:22.234836 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:04:22.234836 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:04:22.234836 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:04:22.234836 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 12:04:22.234836 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 12:04:22.234836 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 12:04:22.236291 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 12:04:22.236291 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:04:22.236291 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:04:22.236291 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:04:22.236291 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:04:22.236291 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:04:22.236291 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:04:22.236291 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:04:22.236291 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:04:22.236291 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:04:22.236291 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:04:22.236291 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:04:22.236291 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:04:22.236291 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:04:22.236291 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:04:22.236291 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:04:22.236291 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:04:22.237993 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 12:04:22.237993 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 12:04:22.237993 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 12:04:22.237993 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 12:04:22.237993 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 12:04:22.237993 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 12:04:22.237993 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:04:22.237993 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:04:22.237993 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 408/817] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Sep 5 12:04:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:04:22.249952 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94173bd2-5b95-4a6c-b39b-6c659622d2f2 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:22.287160 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a164fc6-af97-475f-aab2-37be19a389b5 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:22.322675 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:22.328231 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8dc468-e053-4bbb-b263-22b9b60a6d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:22.328852 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8dc468-e053-4bbb-b263-22b9b60a6d07 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:22.329221 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8dc468-e053-4bbb-b263-22b9b60a6d07 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:22.329747 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8dc468-e053-4bbb-b263-22b9b60a6d07 None admin] PATH_INFO: `/v3/domains` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:22.330467 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8dc468-e053-4bbb-b263-22b9b60a6d07 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:22.331217 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8dc468-e053-4bbb-b263-22b9b60a6d07 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:22.333337 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8dc468-e053-4bbb-b263-22b9b60a6d07 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:22.353342 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 410/818] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 5 12:04:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:04:22.355369 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8dc468-e053-4bbb-b263-22b9b60a6d07 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:22.472674 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8dc468-e053-4bbb-b263-22b9b60a6d07 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:22.494079 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94173bd2-5b95-4a6c-b39b-6c659622d2f2 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:22.517428 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bd8c66-22fd-422d-a3ae-9835c6efd346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:22.518068 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bd8c66-22fd-422d-a3ae-9835c6efd346 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:22.518353 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bd8c66-22fd-422d-a3ae-9835c6efd346 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:22.518630 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bd8c66-22fd-422d-a3ae-9835c6efd346 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:22.527582 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:22.531492 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bd8c66-22fd-422d-a3ae-9835c6efd346 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:22.533595 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bd8c66-22fd-422d-a3ae-9835c6efd346 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:22.535121 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6b6b0f-3ed7-41e4-84d7-744db972c4d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:22.535990 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6b6b0f-3ed7-41e4-84d7-744db972c4d8 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:22.536486 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6b6b0f-3ed7-41e4-84d7-744db972c4d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:22.536995 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6b6b0f-3ed7-41e4-84d7-744db972c4d8 None admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:22.537947 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6b6b0f-3ed7-41e4-84d7-744db972c4d8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:22.538473 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6b6b0f-3ed7-41e4-84d7-744db972c4d8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:22.540117 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6b6b0f-3ed7-41e4-84d7-744db972c4d8 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:22.547601 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application [None req-20bd8c66-22fd-422d-a3ae-9835c6efd346 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 05 12:04:22.547601 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:22.547601 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:04:22.547601 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:04:22.547601 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:04:22.547601 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:04:22.547601 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:04:22.547601 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:04:22.547601 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:04:22.547601 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:04:22.547601 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:04:22.547601 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:04:22.547601 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 12:04:22.547601 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 12:04:22.547601 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 12:04:22.547601 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 12:04:22.548665 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:04:22.548665 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:04:22.548665 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 12:04:22.548665 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:04:22.548665 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 12:04:22.548665 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:04:22.548665 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:04:22.548665 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:04:22.548665 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:04:22.548665 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:04:22.548665 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:04:22.548665 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application with Lock( Sep 05 12:04:22.548665 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:04:22.548665 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:04:22.548665 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:04:22.548665 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:04:22.548665 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:04:22.548665 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:04:22.549698 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:04:22.549698 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:04:22.549698 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 12:04:22.549698 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 12:04:22.549698 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 12:04:22.549698 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 12:04:22.549698 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 12:04:22.549698 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 12:04:22.549698 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 05 12:04:22.549698 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:04:22.552972 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 411/819] 10.222.0.50 () {56 vars in 1093 bytes} [Mon Sep 5 12:04:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 12:04:22.554070 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bd8c66-22fd-422d-a3ae-9835c6efd346 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:22.566467 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 409/820] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Sep 5 12:04:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:04:22.567744 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6b6b0f-3ed7-41e4-84d7-744db972c4d8 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:22.629243 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:22.680793 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6b6b0f-3ed7-41e4-84d7-744db972c4d8 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:22.691323 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bd8c66-22fd-422d-a3ae-9835c6efd346 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:22.724449 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cc0e00-2412-4ce3-b532-ae6411d75e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:22.725096 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cc0e00-2412-4ce3-b532-ae6411d75e0c None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:22.725597 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cc0e00-2412-4ce3-b532-ae6411d75e0c None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:22.725770 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cc0e00-2412-4ce3-b532-ae6411d75e0c None admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:22.726554 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cc0e00-2412-4ce3-b532-ae6411d75e0c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:22.726862 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cc0e00-2412-4ce3-b532-ae6411d75e0c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:22.728309 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cc0e00-2412-4ce3-b532-ae6411d75e0c None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:22.735585 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbc90b0-4a14-47d9-bfc3-25342574982a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:22.736224 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc90b0-4a14-47d9-bfc3-25342574982a None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:22.736511 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc90b0-4a14-47d9-bfc3-25342574982a None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:22.736786 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc90b0-4a14-47d9-bfc3-25342574982a None admin] PATH_INFO: `/v3/services/network` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:22.737403 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbc90b0-4a14-47d9-bfc3-25342574982a None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:22.738760 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbc90b0-4a14-47d9-bfc3-25342574982a None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:22.752979 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 410/821] 10.222.0.50 () {56 vars in 1133 bytes} [Mon Sep 5 12:04:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:04:22.752979 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cc0e00-2412-4ce3-b532-ae6411d75e0c None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:22.753310 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application [None req-1cbc90b0-4a14-47d9-bfc3-25342574982a None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 05 12:04:22.753310 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:22.753310 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 05 12:04:22.753310 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 05 12:04:22.753310 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 05 12:04:22.753310 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 05 12:04:22.753310 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 05 12:04:22.753310 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 12:04:22.753310 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 05 12:04:22.753310 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:04:22.753310 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 12:04:22.753310 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:04:22.753310 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:22.753310 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:04:22.753310 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:04:22.753310 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:04:22.753310 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:04:22.754232 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:04:22.754232 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:04:22.754232 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:04:22.754232 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:04:22.754232 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:04:22.754232 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:04:22.754232 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 05 12:04:22.754232 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 05 12:04:22.754232 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 05 12:04:22.754232 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 05 12:04:22.754232 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:04:22.754232 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:04:22.754232 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:04:22.754232 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:04:22.754232 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:04:22.754232 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:04:22.755081 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:04:22.755081 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application with Lock( Sep 05 12:04:22.755081 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:04:22.755081 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:04:22.755081 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:04:22.755081 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:04:22.755081 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:04:22.755081 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:04:22.755081 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:04:22.755081 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:04:22.755081 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 05 12:04:22.755081 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 12:04:22.755081 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 05 12:04:22.755081 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:04:22.755081 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 412/822] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Sep 5 12:04:22 2022] GET /identity/v3/services/network => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:04:22.755894 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9176ed-88e3-4b03-9027-985a3dc880c9 None None] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:22.755894 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9176ed-88e3-4b03-9027-985a3dc880c9 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:22.755894 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9176ed-88e3-4b03-9027-985a3dc880c9 None None] PATH_INFO: `/` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:22.755894 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 413/823] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:04:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:04:22.755894 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9176ed-88e3-4b03-9027-985a3dc880c9 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:22.818483 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:22.869653 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cc0e00-2412-4ce3-b532-ae6411d75e0c None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:22.875455 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9176ed-88e3-4b03-9027-985a3dc880c9 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:22.897477 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:22.909760 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e99e0a0-974d-4156-89ec-f7e2284636d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:22.910710 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e99e0a0-974d-4156-89ec-f7e2284636d3 None admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:22.911148 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e99e0a0-974d-4156-89ec-f7e2284636d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:22.911420 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e99e0a0-974d-4156-89ec-f7e2284636d3 None admin] PATH_INFO: `/v3/projects/ae4f8939fcc040bca99783a77e6ede4d/users/ea2b32d58d964585a24e7c5784a8355f/roles/16e2ccc8bd1b497d8cee780c1c7df0d2` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:22.913546 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e99e0a0-974d-4156-89ec-f7e2284636d3 None admin] RBAC: Authorizing `identity:create_grant(project_id=ae4f8939fcc040bca99783a77e6ede4d, user_id=ea2b32d58d964585a24e7c5784a8355f, role_id=16e2ccc8bd1b497d8cee780c1c7df0d2)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:22.914997 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e99e0a0-974d-4156-89ec-f7e2284636d3 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:22.921113 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd44fb1e-22f2-4400-a1e2-35f97ff226ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:22.922385 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd44fb1e-22f2-4400-a1e2-35f97ff226ea None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:22.923090 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd44fb1e-22f2-4400-a1e2-35f97ff226ea None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:22.923757 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd44fb1e-22f2-4400-a1e2-35f97ff226ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:22.945051 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 411/824] 10.222.0.50 () {58 vars in 1439 bytes} [Mon Sep 5 12:04:22 2022] PUT /identity/v3/projects/ae4f8939fcc040bca99783a77e6ede4d/users/ea2b32d58d964585a24e7c5784a8355f/roles/16e2ccc8bd1b497d8cee780c1c7df0d2 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:04:22.957057 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff32ee4-f184-49e3-ac86-8ab338449d5d None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:22.957057 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff32ee4-f184-49e3-ac86-8ab338449d5d None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:22.957057 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff32ee4-f184-49e3-ac86-8ab338449d5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:22.977140 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-3ff32ee4-f184-49e3-ac86-8ab338449d5d None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:04:22.978872 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-3ff32ee4-f184-49e3-ac86-8ab338449d5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:04:23.043376 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd44fb1e-22f2-4400-a1e2-35f97ff226ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:23.044977 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd44fb1e-22f2-4400-a1e2-35f97ff226ea None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:23.092131 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 412/825] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:04:22 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 12:04:23.093158 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff32ee4-f184-49e3-ac86-8ab338449d5d None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:23.153685 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:23.163372 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 414/826] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Sep 5 12:04:22 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 05 12:04:23.167840 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd44fb1e-22f2-4400-a1e2-35f97ff226ea None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:23.189463 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:23.238921 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff32ee4-f184-49e3-ac86-8ab338449d5d None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:23.297848 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fdd66f-f411-487c-82fc-b319e4b06cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:23.298500 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fdd66f-f411-487c-82fc-b319e4b06cb2 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:23.298841 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fdd66f-f411-487c-82fc-b319e4b06cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:23.299192 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fdd66f-f411-487c-82fc-b319e4b06cb2 None admin] PATH_INFO: `/v3/services` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:23.300041 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fdd66f-f411-487c-82fc-b319e4b06cb2 None admin] RBAC: Adding query filter params (name=network) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:23.300419 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fdd66f-f411-487c-82fc-b319e4b06cb2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:23.303853 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fdd66f-f411-487c-82fc-b319e4b06cb2 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:23.316695 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 413/827] 10.222.0.50 () {56 vars in 1112 bytes} [Mon Sep 5 12:04:23 2022] GET /identity/v3/services?name=network => generated 124 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:04:23.324077 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fdd66f-f411-487c-82fc-b319e4b06cb2 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:23.361990 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd44fb1e-22f2-4400-a1e2-35f97ff226ea None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:23.444772 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e26bc2b-0dbb-40c4-a6b3-854627484a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:23.445470 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e26bc2b-0dbb-40c4-a6b3-854627484a97 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:23.445748 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e26bc2b-0dbb-40c4-a6b3-854627484a97 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:23.446020 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e26bc2b-0dbb-40c4-a6b3-854627484a97 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:23.458499 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e26bc2b-0dbb-40c4-a6b3-854627484a97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:23.459960 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e26bc2b-0dbb-40c4-a6b3-854627484a97 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:23.477584 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application [None req-2e26bc2b-0dbb-40c4-a6b3-854627484a97 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:04:23.477584 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:23.477584 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:04:23.477584 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:04:23.477584 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:04:23.477584 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:04:23.477584 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:04:23.477584 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:04:23.477584 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:04:23.477584 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:04:23.477584 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:04:23.477584 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:04:23.477584 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:04:23.477584 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:04:23.477584 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:04:23.477584 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:04:23.478626 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:04:23.478626 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:04:23.478626 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:04:23.478626 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:04:23.478626 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:04:23.478626 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:04:23.478626 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:04:23.478626 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application with Lock( Sep 05 12:04:23.478626 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:04:23.478626 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:04:23.478626 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:04:23.478626 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:04:23.478626 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:04:23.478626 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:04:23.478626 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:04:23.478626 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:04:23.478626 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:04:23.480103 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:04:23.480103 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:04:23.480103 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:04:23.480103 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 415/828] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 5 12:04:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 12:04:23.480764 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e26bc2b-0dbb-40c4-a6b3-854627484a97 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:23.491210 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fdd66f-f411-487c-82fc-b319e4b06cb2 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:23.495217 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:23.531169 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b743755-cee8-42fb-8266-bb3db4dc6740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:23.532200 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b743755-cee8-42fb-8266-bb3db4dc6740 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:23.533311 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b743755-cee8-42fb-8266-bb3db4dc6740 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:23.533595 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b743755-cee8-42fb-8266-bb3db4dc6740 None admin] PATH_INFO: `/v3/services` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:23.534258 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b743755-cee8-42fb-8266-bb3db4dc6740 None admin] RBAC: Adding query filter params (type=network) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:23.534565 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b743755-cee8-42fb-8266-bb3db4dc6740 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:23.535968 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b743755-cee8-42fb-8266-bb3db4dc6740 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:23.547366 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 414/829] 10.222.0.50 () {56 vars in 1112 bytes} [Mon Sep 5 12:04:23 2022] GET /identity/v3/services?type=network => generated 350 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:04:23.548298 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b743755-cee8-42fb-8266-bb3db4dc6740 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:23.568238 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:23.616627 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e26bc2b-0dbb-40c4-a6b3-854627484a97 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:23.667144 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bfa1c7-36eb-4c5a-af5e-9a3d76d3f7cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:23.668627 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bfa1c7-36eb-4c5a-af5e-9a3d76d3f7cb None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:23.668925 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bfa1c7-36eb-4c5a-af5e-9a3d76d3f7cb None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:23.669217 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bfa1c7-36eb-4c5a-af5e-9a3d76d3f7cb None admin] PATH_INFO: `/v3/roles/service` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:23.686699 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bfa1c7-36eb-4c5a-af5e-9a3d76d3f7cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:04:23.694936 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application [None req-36bfa1c7-36eb-4c5a-af5e-9a3d76d3f7cb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 05 12:04:23.694936 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:23.694936 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:04:23.694936 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:04:23.694936 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:04:23.694936 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:04:23.694936 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:04:23.694936 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:04:23.694936 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:04:23.694936 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:04:23.694936 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:04:23.694936 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:04:23.694936 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:04:23.694936 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:04:23.694936 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:04:23.694936 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:04:23.696378 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:04:23.696378 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:04:23.696378 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:04:23.696378 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:04:23.696378 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:04:23.696378 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:04:23.696378 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:04:23.696378 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:04:23.696378 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:04:23.696378 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:04:23.696378 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:04:23.696378 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application with Lock( Sep 05 12:04:23.696378 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:04:23.696378 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:04:23.696378 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:04:23.696378 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:04:23.698283 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:04:23.698283 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:04:23.698283 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:04:23.698283 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:04:23.698283 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:04:23.698283 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:04:23.698283 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:04:23.698283 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:04:23.698283 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:04:23.698283 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:04:23.698283 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 05 12:04:23.698283 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:04:23.698283 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 416/830] 10.222.0.50 () {56 vars in 1102 bytes} [Mon Sep 5 12:04:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:04:23.698283 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bfa1c7-36eb-4c5a-af5e-9a3d76d3f7cb None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:23.704683 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b743755-cee8-42fb-8266-bb3db4dc6740 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:23.746676 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8edc3f-f605-4a99-bfeb-d80569db8a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:23.747402 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8edc3f-f605-4a99-bfeb-d80569db8a04 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:23.747803 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8edc3f-f605-4a99-bfeb-d80569db8a04 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:23.748145 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8edc3f-f605-4a99-bfeb-d80569db8a04 None admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:23.749147 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8edc3f-f605-4a99-bfeb-d80569db8a04 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:23.749582 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8edc3f-f605-4a99-bfeb-d80569db8a04 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:23.751116 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8edc3f-f605-4a99-bfeb-d80569db8a04 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:23.773705 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 415/831] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 5 12:04:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:04:23.774744 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8edc3f-f605-4a99-bfeb-d80569db8a04 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:23.820061 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:23.826113 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bfa1c7-36eb-4c5a-af5e-9a3d76d3f7cb None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:23.860669 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:23.872667 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01401d6-9c5e-442b-8296-7672018e0a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:23.873602 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01401d6-9c5e-442b-8296-7672018e0a2c None admin] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:23.874032 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01401d6-9c5e-442b-8296-7672018e0a2c None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:23.874451 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01401d6-9c5e-442b-8296-7672018e0a2c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:23.875435 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01401d6-9c5e-442b-8296-7672018e0a2c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:23.877145 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01401d6-9c5e-442b-8296-7672018e0a2c None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:23.906267 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 417/832] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 5 12:04:23 2022] POST /identity/v3/endpoints => generated 337 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:04:23.908169 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01401d6-9c5e-442b-8296-7672018e0a2c None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:23.914740 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8edc3f-f605-4a99-bfeb-d80569db8a04 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:23.970508 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eb2f18-663b-4ccd-9f51-5cbe4faecab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:23.971129 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eb2f18-663b-4ccd-9f51-5cbe4faecab3 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:23.971406 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eb2f18-663b-4ccd-9f51-5cbe4faecab3 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:23.971734 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eb2f18-663b-4ccd-9f51-5cbe4faecab3 None admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:23.972565 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8eb2f18-663b-4ccd-9f51-5cbe4faecab3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:23.972950 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8eb2f18-663b-4ccd-9f51-5cbe4faecab3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:23.975021 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8eb2f18-663b-4ccd-9f51-5cbe4faecab3 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:23.992290 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 416/833] 10.222.0.50 () {56 vars in 1103 bytes} [Mon Sep 5 12:04:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:04:23.994958 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaf37c4-184b-4bfb-a058-3e20208b00ee None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:23.995775 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaf37c4-184b-4bfb-a058-3e20208b00ee None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:23.996384 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaf37c4-184b-4bfb-a058-3e20208b00ee None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:23.999731 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 417/834] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:04:23 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:04:24.001429 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaf37c4-184b-4bfb-a058-3e20208b00ee None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:24.044868 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01401d6-9c5e-442b-8296-7672018e0a2c None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:24.087957 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27328712-c516-4c32-a12a-9b39c612f155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:24.089190 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27328712-c516-4c32-a12a-9b39c612f155 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:24.089607 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27328712-c516-4c32-a12a-9b39c612f155 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:24.089885 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27328712-c516-4c32-a12a-9b39c612f155 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:24.098549 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27328712-c516-4c32-a12a-9b39c612f155 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:24.100198 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27328712-c516-4c32-a12a-9b39c612f155 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:24.115114 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application [None req-27328712-c516-4c32-a12a-9b39c612f155 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:04:24.115114 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:24.115114 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:04:24.115114 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:04:24.115114 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:04:24.115114 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:04:24.115114 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:04:24.115114 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:04:24.115114 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:04:24.115114 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:04:24.115114 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:04:24.115114 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:04:24.115114 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 12:04:24.115114 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 12:04:24.115114 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 12:04:24.116093 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 12:04:24.116093 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:04:24.116093 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:04:24.116093 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:04:24.116093 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:04:24.116093 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:04:24.116093 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:04:24.116093 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:04:24.116093 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application with Lock( Sep 05 12:04:24.116093 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:04:24.116093 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:04:24.116093 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:04:24.116093 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:04:24.116093 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:04:24.116093 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:04:24.116093 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:04:24.116093 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:04:24.117018 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 12:04:24.117018 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 12:04:24.117018 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 12:04:24.117018 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 12:04:24.117018 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 12:04:24.117018 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 12:04:24.117018 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:04:24.117018 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:04:24.117018 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 418/835] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Sep 5 12:04:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:04:24.117561 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ef85ff-c3fe-4f79-a4b5-fd59fea8cd9f None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:24.117757 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ef85ff-c3fe-4f79-a4b5-fd59fea8cd9f None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:24.118033 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ef85ff-c3fe-4f79-a4b5-fd59fea8cd9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:24.141032 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-f5ef85ff-c3fe-4f79-a4b5-fd59fea8cd9f None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:04:24.141032 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-f5ef85ff-c3fe-4f79-a4b5-fd59fea8cd9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:04:24.149395 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:24.174861 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaf37c4-184b-4bfb-a058-3e20208b00ee None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:24.198768 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:24.214731 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab288e2-a061-4dae-b250-b8a045270078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:24.215835 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab288e2-a061-4dae-b250-b8a045270078 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:24.216119 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab288e2-a061-4dae-b250-b8a045270078 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:24.216509 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab288e2-a061-4dae-b250-b8a045270078 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:24.227941 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab288e2-a061-4dae-b250-b8a045270078 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:24.229349 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 419/836] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:04:24 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 12:04:24.229561 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab288e2-a061-4dae-b250-b8a045270078 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:24.233809 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ef85ff-c3fe-4f79-a4b5-fd59fea8cd9f None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:24.245595 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-cab288e2-a061-4dae-b250-b8a045270078 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:04:24.245595 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:24.245595 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:04:24.245595 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:04:24.245595 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:04:24.245595 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:04:24.245595 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:04:24.245595 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:04:24.245595 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:04:24.245595 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:04:24.245595 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:04:24.245595 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:04:24.245595 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:04:24.245595 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:04:24.245595 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:04:24.245595 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:04:24.246634 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:04:24.246634 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:04:24.246634 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:04:24.246634 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:04:24.246634 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:04:24.246634 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:04:24.246634 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:04:24.246634 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:04:24.246634 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:04:24.246634 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:04:24.246634 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:04:24.246634 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:04:24.246634 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:04:24.246634 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:04:24.246634 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:04:24.246634 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:04:24.246634 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:04:24.247552 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:04:24.247552 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:04:24.247552 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:04:24.247552 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 418/837] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 5 12:04:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:04:24.252271 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab288e2-a061-4dae-b250-b8a045270078 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:24.366022 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ef85ff-c3fe-4f79-a4b5-fd59fea8cd9f None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:24.376021 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab288e2-a061-4dae-b250-b8a045270078 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:24.413349 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53298345-ff94-4cd7-8838-36ed7c6fc9b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:24.414108 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53298345-ff94-4cd7-8838-36ed7c6fc9b5 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:24.414488 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53298345-ff94-4cd7-8838-36ed7c6fc9b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:24.414857 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53298345-ff94-4cd7-8838-36ed7c6fc9b5 None admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:24.415173 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c387988-1b17-4819-b051-ba2f2a4fc033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:24.415715 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53298345-ff94-4cd7-8838-36ed7c6fc9b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:24.416102 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c387988-1b17-4819-b051-ba2f2a4fc033 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:24.416216 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53298345-ff94-4cd7-8838-36ed7c6fc9b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:24.416649 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c387988-1b17-4819-b051-ba2f2a4fc033 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:24.417097 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c387988-1b17-4819-b051-ba2f2a4fc033 None admin] PATH_INFO: `/v3/projects` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:24.417930 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c387988-1b17-4819-b051-ba2f2a4fc033 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:24.418071 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53298345-ff94-4cd7-8838-36ed7c6fc9b5 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:24.418533 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c387988-1b17-4819-b051-ba2f2a4fc033 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:24.420392 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c387988-1b17-4819-b051-ba2f2a4fc033 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:24.426560 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:24.434709 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 420/839] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Sep 5 12:04:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:04:24.434913 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 419/839] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 5 12:04:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:04:24.440170 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c387988-1b17-4819-b051-ba2f2a4fc033 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:24.442423 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53298345-ff94-4cd7-8838-36ed7c6fc9b5 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:24.479462 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:24.550432 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c387988-1b17-4819-b051-ba2f2a4fc033 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:24.558963 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53298345-ff94-4cd7-8838-36ed7c6fc9b5 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:24.587119 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb38d662-62b6-477e-8be8-b54f5a879d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:24.587727 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb38d662-62b6-477e-8be8-b54f5a879d23 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:24.588002 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb38d662-62b6-477e-8be8-b54f5a879d23 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:24.588306 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb38d662-62b6-477e-8be8-b54f5a879d23 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:24.589135 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb38d662-62b6-477e-8be8-b54f5a879d23 None admin] RBAC: Adding query filter params (role.id=16e2ccc8bd1b497d8cee780c1c7df0d2, scope.project.id=ae4f8939fcc040bca99783a77e6ede4d, user.id=cb060ff495bc4abb83ff88992fb7be09) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:24.589447 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb38d662-62b6-477e-8be8-b54f5a879d23 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:24.590898 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb38d662-62b6-477e-8be8-b54f5a879d23 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:24.597220 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 421/840] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Sep 5 12:04:24 2022] GET /identity/v3/role_assignments?user.id=cb060ff495bc4abb83ff88992fb7be09&scope.project.id=ae4f8939fcc040bca99783a77e6ede4d&role.id=16e2ccc8bd1b497d8cee780c1c7df0d2 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:04:24.597748 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46365fc1-93ba-4374-acb6-3088e83cd4e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:24.598044 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb38d662-62b6-477e-8be8-b54f5a879d23 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:24.598778 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46365fc1-93ba-4374-acb6-3088e83cd4e7 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:24.599058 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46365fc1-93ba-4374-acb6-3088e83cd4e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:24.599329 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46365fc1-93ba-4374-acb6-3088e83cd4e7 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:24.614913 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46365fc1-93ba-4374-acb6-3088e83cd4e7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:24.616500 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46365fc1-93ba-4374-acb6-3088e83cd4e7 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:24.634346 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-46365fc1-93ba-4374-acb6-3088e83cd4e7 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 05 12:04:24.634346 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:24.634346 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:04:24.634346 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:04:24.634346 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:04:24.634346 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:04:24.634346 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:04:24.634346 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:04:24.634346 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:04:24.634346 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:04:24.634346 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:04:24.634346 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:04:24.634346 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 12:04:24.634346 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 12:04:24.634346 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 12:04:24.634346 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 12:04:24.636076 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:04:24.636076 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:04:24.636076 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 12:04:24.636076 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:04:24.636076 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 12:04:24.636076 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:04:24.636076 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:04:24.636076 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:04:24.636076 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:04:24.636076 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:04:24.636076 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:04:24.636076 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:04:24.636076 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:04:24.636076 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:04:24.636076 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:04:24.636076 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:04:24.636076 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:04:24.636076 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:04:24.637558 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:04:24.637558 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:04:24.637558 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 12:04:24.637558 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 12:04:24.637558 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 12:04:24.637558 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 12:04:24.637558 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 12:04:24.637558 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 12:04:24.637558 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 05 12:04:24.637558 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:04:24.637558 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 420/841] 10.222.0.50 () {56 vars in 1117 bytes} [Mon Sep 5 12:04:24 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:04:24.642098 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46365fc1-93ba-4374-acb6-3088e83cd4e7 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:24.733743 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:24.739056 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb38d662-62b6-477e-8be8-b54f5a879d23 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:24.741844 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:24.785557 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f21d9d5-2b8a-4329-8974-b29e41825007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:24.786231 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f21d9d5-2b8a-4329-8974-b29e41825007 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:24.786514 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f21d9d5-2b8a-4329-8974-b29e41825007 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:24.786790 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f21d9d5-2b8a-4329-8974-b29e41825007 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:24.787395 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f21d9d5-2b8a-4329-8974-b29e41825007 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:24.788807 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f21d9d5-2b8a-4329-8974-b29e41825007 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:24.800464 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application [None req-8f21d9d5-2b8a-4329-8974-b29e41825007 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 05 12:04:24.800464 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:24.800464 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 05 12:04:24.800464 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 05 12:04:24.800464 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 05 12:04:24.800464 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 05 12:04:24.800464 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 05 12:04:24.800464 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 12:04:24.800464 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 05 12:04:24.800464 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:04:24.800464 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 12:04:24.800464 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:04:24.800464 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:24.800464 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:04:24.800464 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:04:24.800464 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:04:24.800464 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:04:24.801570 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:04:24.801570 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:04:24.801570 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:04:24.801570 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:04:24.801570 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:04:24.801570 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:04:24.801570 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 05 12:04:24.801570 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 05 12:04:24.801570 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 05 12:04:24.801570 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 05 12:04:24.801570 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:04:24.801570 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:04:24.801570 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:04:24.801570 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:04:24.801570 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:04:24.801570 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:04:24.802425 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:04:24.802425 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application with Lock( Sep 05 12:04:24.802425 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:04:24.802425 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:04:24.802425 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:04:24.802425 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:04:24.802425 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:04:24.802425 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:04:24.802425 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:04:24.802425 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:04:24.802425 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 05 12:04:24.802425 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 12:04:24.802425 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 05 12:04:24.802425 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:04:24.802425 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 422/842] 10.222.0.50 () {56 vars in 1114 bytes} [Mon Sep 5 12:04:24 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:04:24.805255 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46365fc1-93ba-4374-acb6-3088e83cd4e7 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:24.811813 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f21d9d5-2b8a-4329-8974-b29e41825007 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:24.849922 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4c1c15-0d6e-478b-b2af-06d48ffb9880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:24.850852 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4c1c15-0d6e-478b-b2af-06d48ffb9880 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:24.851242 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4c1c15-0d6e-478b-b2af-06d48ffb9880 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:24.851413 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4c1c15-0d6e-478b-b2af-06d48ffb9880 None admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:24.852154 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4c1c15-0d6e-478b-b2af-06d48ffb9880 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:24.852461 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4c1c15-0d6e-478b-b2af-06d48ffb9880 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:24.855014 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4c1c15-0d6e-478b-b2af-06d48ffb9880 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:24.883327 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 421/843] 10.222.0.50 () {56 vars in 1149 bytes} [Mon Sep 5 12:04:24 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:04:24.889940 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4c1c15-0d6e-478b-b2af-06d48ffb9880 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:24.933069 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f21d9d5-2b8a-4329-8974-b29e41825007 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:24.977213 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28afb523-a116-4f7f-a1de-5d85b7231f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:24.978234 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28afb523-a116-4f7f-a1de-5d85b7231f8d None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:24.979091 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28afb523-a116-4f7f-a1de-5d85b7231f8d None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:24.979541 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28afb523-a116-4f7f-a1de-5d85b7231f8d None admin] PATH_INFO: `/v3/services` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:24.980322 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28afb523-a116-4f7f-a1de-5d85b7231f8d None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:24.981166 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28afb523-a116-4f7f-a1de-5d85b7231f8d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:24.983019 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28afb523-a116-4f7f-a1de-5d85b7231f8d None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:24.989488 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 423/844] 10.222.0.50 () {56 vars in 1114 bytes} [Mon Sep 5 12:04:24 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:04:24.994984 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28afb523-a116-4f7f-a1de-5d85b7231f8d None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:25.012127 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4c1c15-0d6e-478b-b2af-06d48ffb9880 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:25.027681 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:25.032286 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:25.053624 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0439bee3-a6bf-46e2-9dcc-5dce66b2659c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:25.054429 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0439bee3-a6bf-46e2-9dcc-5dce66b2659c None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:25.054639 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0439bee3-a6bf-46e2-9dcc-5dce66b2659c None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:25.054877 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0439bee3-a6bf-46e2-9dcc-5dce66b2659c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:25.114077 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28afb523-a116-4f7f-a1de-5d85b7231f8d None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:25.131045 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0439bee3-a6bf-46e2-9dcc-5dce66b2659c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:25.132496 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0439bee3-a6bf-46e2-9dcc-5dce66b2659c None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:25.154205 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e25059-1e71-4f48-8181-67417519dee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:25.155179 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e25059-1e71-4f48-8181-67417519dee0 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:25.155817 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e25059-1e71-4f48-8181-67417519dee0 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:25.156303 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e25059-1e71-4f48-8181-67417519dee0 None admin] PATH_INFO: `/v3/services` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:25.157342 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e25059-1e71-4f48-8181-67417519dee0 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:25.157871 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e25059-1e71-4f48-8181-67417519dee0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:25.159598 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e25059-1e71-4f48-8181-67417519dee0 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:25.165442 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 424/845] 10.222.0.50 () {56 vars in 1114 bytes} [Mon Sep 5 12:04:24 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:04:25.172924 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dea8f58-8344-463e-9240-f7e62a507b3f None None] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:25.172924 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dea8f58-8344-463e-9240-f7e62a507b3f None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:25.172924 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dea8f58-8344-463e-9240-f7e62a507b3f None None] PATH_INFO: `/` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:25.172924 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 425/846] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:04:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:04:25.177103 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dafb238-1e88-4783-8d32-253f97a6dffc None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:25.177396 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dafb238-1e88-4783-8d32-253f97a6dffc None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:25.177653 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dafb238-1e88-4783-8d32-253f97a6dffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:25.201432 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-4dafb238-1e88-4783-8d32-253f97a6dffc None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:04:25.203046 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-4dafb238-1e88-4783-8d32-253f97a6dffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:04:25.262723 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 422/847] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Sep 5 12:04:24 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 05 12:04:25.263886 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0439bee3-a6bf-46e2-9dcc-5dce66b2659c None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:25.284490 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:25.294229 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 426/848] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:04:25 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 05 12:04:25.387797 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0439bee3-a6bf-46e2-9dcc-5dce66b2659c None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:25.426573 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133ee16e-a623-4868-93d1-dab6dfeb0d7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:25.427480 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133ee16e-a623-4868-93d1-dab6dfeb0d7b None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:25.427955 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133ee16e-a623-4868-93d1-dab6dfeb0d7b None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:25.428396 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133ee16e-a623-4868-93d1-dab6dfeb0d7b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:25.439469 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133ee16e-a623-4868-93d1-dab6dfeb0d7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:25.441185 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133ee16e-a623-4868-93d1-dab6dfeb0d7b None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:25.456731 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-133ee16e-a623-4868-93d1-dab6dfeb0d7b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:04:25.456731 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:25.456731 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:04:25.456731 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:04:25.456731 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:04:25.456731 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:04:25.456731 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:04:25.456731 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:04:25.456731 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:04:25.456731 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:04:25.456731 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:04:25.456731 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:04:25.456731 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:04:25.456731 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:04:25.456731 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:04:25.456731 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:04:25.457960 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:04:25.457960 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:04:25.457960 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:04:25.457960 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:04:25.457960 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:04:25.457960 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:04:25.457960 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:04:25.457960 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:04:25.457960 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:04:25.457960 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:04:25.457960 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:04:25.457960 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:04:25.457960 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:04:25.457960 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:04:25.457960 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:04:25.457960 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:04:25.457960 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:04:25.459060 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:04:25.459060 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:04:25.459060 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:04:25.460819 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 423/849] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 5 12:04:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:04:25.470042 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dafb238-1e88-4783-8d32-253f97a6dffc None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:25.492494 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:25.574286 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133ee16e-a623-4868-93d1-dab6dfeb0d7b None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:25.582838 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dafb238-1e88-4783-8d32-253f97a6dffc None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:25.629737 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff9b6cd-02eb-4b7f-8460-c70d16e49e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:25.630735 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff9b6cd-02eb-4b7f-8460-c70d16e49e81 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:25.631379 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff9b6cd-02eb-4b7f-8460-c70d16e49e81 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:25.631865 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff9b6cd-02eb-4b7f-8460-c70d16e49e81 None admin] PATH_INFO: `/v3/domains` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:25.633563 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff9b6cd-02eb-4b7f-8460-c70d16e49e81 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:25.634262 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff9b6cd-02eb-4b7f-8460-c70d16e49e81 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:25.636659 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff9b6cd-02eb-4b7f-8460-c70d16e49e81 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:25.655471 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 427/850] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 5 12:04:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:04:25.660942 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff9b6cd-02eb-4b7f-8460-c70d16e49e81 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:25.662839 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:25.704043 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133ee16e-a623-4868-93d1-dab6dfeb0d7b None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:25.751712 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a24f28-ce9c-4ccc-bc97-f9086131a12c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:25.753240 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a24f28-ce9c-4ccc-bc97-f9086131a12c None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:25.753523 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a24f28-ce9c-4ccc-bc97-f9086131a12c None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:25.753795 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a24f28-ce9c-4ccc-bc97-f9086131a12c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:25.769119 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:25.771128 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a24f28-ce9c-4ccc-bc97-f9086131a12c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:04:25.777795 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-03a24f28-ce9c-4ccc-bc97-f9086131a12c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 12:04:25.777795 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:25.777795 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:04:25.777795 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:04:25.777795 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:04:25.777795 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:04:25.777795 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:04:25.777795 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:04:25.777795 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:04:25.777795 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:04:25.777795 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:04:25.777795 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:04:25.777795 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:04:25.777795 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:04:25.777795 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:04:25.777795 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:04:25.778798 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:04:25.778798 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:04:25.778798 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:04:25.778798 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:04:25.778798 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:04:25.778798 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:04:25.778798 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:04:25.778798 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:04:25.778798 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:04:25.778798 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:04:25.778798 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:04:25.778798 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:04:25.778798 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:04:25.778798 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:04:25.778798 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:04:25.778798 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:04:25.779640 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:04:25.779640 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:04:25.779640 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:04:25.779640 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:04:25.779640 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:04:25.779640 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:04:25.779640 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:04:25.779640 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:04:25.779640 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:04:25.779640 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:04:25.779640 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 12:04:25.779640 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:04:25.780377 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 424/851] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Sep 5 12:04:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 12:04:25.786407 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a24f28-ce9c-4ccc-bc97-f9086131a12c None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:25.802715 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff9b6cd-02eb-4b7f-8460-c70d16e49e81 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:25.843432 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13eb46e-8b86-4939-84b3-5ae61d74ae23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:25.844444 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13eb46e-8b86-4939-84b3-5ae61d74ae23 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:25.844963 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13eb46e-8b86-4939-84b3-5ae61d74ae23 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:25.845516 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13eb46e-8b86-4939-84b3-5ae61d74ae23 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:25.853448 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13eb46e-8b86-4939-84b3-5ae61d74ae23 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:25.855962 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13eb46e-8b86-4939-84b3-5ae61d74ae23 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:25.872431 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application [None req-e13eb46e-8b86-4939-84b3-5ae61d74ae23 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:04:25.872431 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:25.872431 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:04:25.872431 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:04:25.872431 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:04:25.872431 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:04:25.872431 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:04:25.872431 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:04:25.872431 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:04:25.872431 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:04:25.872431 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:04:25.872431 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:04:25.872431 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 12:04:25.872431 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 12:04:25.872431 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 12:04:25.873440 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 12:04:25.873440 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:04:25.873440 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:04:25.873440 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:04:25.873440 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:04:25.873440 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:04:25.873440 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:04:25.873440 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:04:25.873440 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application with Lock( Sep 05 12:04:25.873440 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:04:25.873440 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:04:25.873440 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:04:25.873440 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:04:25.873440 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:04:25.873440 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:04:25.873440 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:04:25.873440 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:04:25.874326 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 12:04:25.874326 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 12:04:25.874326 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 12:04:25.874326 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 12:04:25.874326 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 12:04:25.874326 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 12:04:25.874326 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:04:25.874326 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:04:25.874326 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 428/852] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Sep 5 12:04:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 12:04:25.880570 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13eb46e-8b86-4939-84b3-5ae61d74ae23 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:25.926322 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a24f28-ce9c-4ccc-bc97-f9086131a12c None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:25.954998 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:25.965344 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6bd8e0-ea69-4d0d-9b2a-26c41382cd02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:25.966256 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6bd8e0-ea69-4d0d-9b2a-26c41382cd02 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:25.966767 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6bd8e0-ea69-4d0d-9b2a-26c41382cd02 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:25.967256 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6bd8e0-ea69-4d0d-9b2a-26c41382cd02 None admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:25.968151 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6bd8e0-ea69-4d0d-9b2a-26c41382cd02 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:25.968695 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6bd8e0-ea69-4d0d-9b2a-26c41382cd02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:25.970281 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6bd8e0-ea69-4d0d-9b2a-26c41382cd02 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:25.979476 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 425/853] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Sep 5 12:04:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:04:25.984753 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6bd8e0-ea69-4d0d-9b2a-26c41382cd02 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:26.014477 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13eb46e-8b86-4939-84b3-5ae61d74ae23 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:26.064781 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1561fd-334a-44a0-863b-dcb4f21189dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:26.065411 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1561fd-334a-44a0-863b-dcb4f21189dc None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:26.065693 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1561fd-334a-44a0-863b-dcb4f21189dc None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:26.065963 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1561fd-334a-44a0-863b-dcb4f21189dc None admin] PATH_INFO: `/v3/projects` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:26.066649 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1561fd-334a-44a0-863b-dcb4f21189dc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:26.066952 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1561fd-334a-44a0-863b-dcb4f21189dc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:26.068371 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1561fd-334a-44a0-863b-dcb4f21189dc None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:26.078813 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:26.087018 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 429/854] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Sep 5 12:04:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:04:26.089559 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1561fd-334a-44a0-863b-dcb4f21189dc None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:26.124425 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6bd8e0-ea69-4d0d-9b2a-26c41382cd02 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:26.171037 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698a1cbb-72a8-4c59-9a20-0ea16b8d30bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:26.172022 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698a1cbb-72a8-4c59-9a20-0ea16b8d30bf None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:26.173129 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698a1cbb-72a8-4c59-9a20-0ea16b8d30bf None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:26.173619 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698a1cbb-72a8-4c59-9a20-0ea16b8d30bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:26.189181 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698a1cbb-72a8-4c59-9a20-0ea16b8d30bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:26.191861 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698a1cbb-72a8-4c59-9a20-0ea16b8d30bf None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:26.200169 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1561fd-334a-44a0-863b-dcb4f21189dc None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:26.212365 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-698a1cbb-72a8-4c59-9a20-0ea16b8d30bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:04:26.212365 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:26.212365 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:04:26.212365 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:04:26.212365 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:04:26.212365 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:04:26.212365 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:04:26.212365 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:04:26.212365 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:04:26.212365 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:04:26.212365 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:04:26.212365 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:04:26.212365 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:04:26.212365 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:04:26.212365 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:04:26.212365 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:04:26.213490 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:04:26.213490 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:04:26.213490 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:04:26.213490 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:04:26.213490 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:04:26.213490 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:04:26.213490 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:04:26.213490 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:04:26.213490 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:04:26.213490 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:04:26.213490 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:04:26.213490 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:04:26.213490 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:04:26.213490 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:04:26.213490 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:04:26.213490 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:04:26.213490 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:04:26.214398 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:04:26.214398 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:04:26.214398 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:04:26.214571 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 426/855] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 5 12:04:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 12:04:26.220969 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698a1cbb-72a8-4c59-9a20-0ea16b8d30bf None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:26.242352 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89686341-08e1-4d94-8fa5-175ac9051767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:26.243419 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89686341-08e1-4d94-8fa5-175ac9051767 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:26.243904 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89686341-08e1-4d94-8fa5-175ac9051767 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:26.244888 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89686341-08e1-4d94-8fa5-175ac9051767 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:26.245878 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89686341-08e1-4d94-8fa5-175ac9051767 None admin] RBAC: Adding query filter params (role.id=fe10209913504171981606bfdf25a9bb, scope.project.id=ae4f8939fcc040bca99783a77e6ede4d, user.id=bacc8ece8df24bf498c1d55ca2918224) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:26.246428 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89686341-08e1-4d94-8fa5-175ac9051767 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:26.248074 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89686341-08e1-4d94-8fa5-175ac9051767 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:26.255128 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 430/856] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Sep 5 12:04:26 2022] GET /identity/v3/role_assignments?user.id=bacc8ece8df24bf498c1d55ca2918224&scope.project.id=ae4f8939fcc040bca99783a77e6ede4d&role.id=fe10209913504171981606bfdf25a9bb => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:04:26.277707 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:26.350092 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698a1cbb-72a8-4c59-9a20-0ea16b8d30bf None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:26.394615 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a93c16f-e30e-4ae4-a1ef-bf7349ddcb47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:26.395252 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a93c16f-e30e-4ae4-a1ef-bf7349ddcb47 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:26.395533 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a93c16f-e30e-4ae4-a1ef-bf7349ddcb47 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:26.395807 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a93c16f-e30e-4ae4-a1ef-bf7349ddcb47 None admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:26.396463 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a93c16f-e30e-4ae4-a1ef-bf7349ddcb47 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:26.396763 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a93c16f-e30e-4ae4-a1ef-bf7349ddcb47 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:26.398440 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a93c16f-e30e-4ae4-a1ef-bf7349ddcb47 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:26.412711 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 427/857] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 5 12:04:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:04:26.419832 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89686341-08e1-4d94-8fa5-175ac9051767 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:26.490886 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:26.533909 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89686341-08e1-4d94-8fa5-175ac9051767 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:26.570900 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd47206d-0b73-4118-adb3-d87219b699ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:26.571569 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd47206d-0b73-4118-adb3-d87219b699ab None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:26.571892 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd47206d-0b73-4118-adb3-d87219b699ab None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:26.572171 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd47206d-0b73-4118-adb3-d87219b699ab None admin] PATH_INFO: `/v3/users/swift` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:26.581229 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd47206d-0b73-4118-adb3-d87219b699ab None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:26.582820 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd47206d-0b73-4118-adb3-d87219b699ab None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:26.595958 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application [None req-cd47206d-0b73-4118-adb3-d87219b699ab None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 05 12:04:26.595958 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:26.595958 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:04:26.595958 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:04:26.595958 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:04:26.595958 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:04:26.595958 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:04:26.595958 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:04:26.595958 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:04:26.595958 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:04:26.595958 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:04:26.595958 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:04:26.595958 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 12:04:26.595958 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 12:04:26.595958 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 12:04:26.595958 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 12:04:26.597016 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:04:26.597016 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:04:26.597016 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 12:04:26.597016 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:04:26.597016 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 12:04:26.597016 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:04:26.597016 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:04:26.597016 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:04:26.597016 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:04:26.597016 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:04:26.597016 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:04:26.597016 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application with Lock( Sep 05 12:04:26.597016 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:04:26.597016 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:04:26.597016 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:04:26.597016 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:04:26.597016 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:04:26.597016 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:04:26.597999 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:04:26.597999 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:04:26.597999 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 12:04:26.597999 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 12:04:26.597999 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 12:04:26.597999 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 12:04:26.597999 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 12:04:26.597999 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 12:04:26.597999 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 05 12:04:26.597999 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:04:26.597999 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 431/858] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Sep 5 12:04:26 2022] GET /identity/v3/users/swift => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:04:26.605683 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a93c16f-e30e-4ae4-a1ef-bf7349ddcb47 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:26.715670 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3196c9eb-2118-44ef-92af-a9b9ed6f1160 None None] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:26.716302 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3196c9eb-2118-44ef-92af-a9b9ed6f1160 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:26.716773 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3196c9eb-2118-44ef-92af-a9b9ed6f1160 None None] PATH_INFO: `/` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:26.718560 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 432/859] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:04:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:04:26.720421 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a93c16f-e30e-4ae4-a1ef-bf7349ddcb47 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:26.720970 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:26.729407 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936ace22-2d8b-4a12-9656-3118d5cbf321 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:26.730863 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936ace22-2d8b-4a12-9656-3118d5cbf321 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:26.731335 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936ace22-2d8b-4a12-9656-3118d5cbf321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:26.759126 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-936ace22-2d8b-4a12-9656-3118d5cbf321 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:04:26.759126 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-936ace22-2d8b-4a12-9656-3118d5cbf321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:04:26.762920 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eba224-5919-4250-9db6-fa67fe6136b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:26.764102 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eba224-5919-4250-9db6-fa67fe6136b5 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:26.764631 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eba224-5919-4250-9db6-fa67fe6136b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:26.765125 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eba224-5919-4250-9db6-fa67fe6136b5 None admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:26.766107 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94eba224-5919-4250-9db6-fa67fe6136b5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:26.766628 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94eba224-5919-4250-9db6-fa67fe6136b5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:26.768239 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94eba224-5919-4250-9db6-fa67fe6136b5 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:26.798901 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 428/860] 10.222.0.50 () {56 vars in 1135 bytes} [Mon Sep 5 12:04:26 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:04:26.800145 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eba224-5919-4250-9db6-fa67fe6136b5 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:26.840928 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 433/861] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:04:26 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 05 12:04:26.915317 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eba224-5919-4250-9db6-fa67fe6136b5 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:26.951630 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a328eb1-c773-4bcc-a7e3-e4ae6eeaf570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:26.952243 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a328eb1-c773-4bcc-a7e3-e4ae6eeaf570 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:26.952522 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a328eb1-c773-4bcc-a7e3-e4ae6eeaf570 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:26.952795 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a328eb1-c773-4bcc-a7e3-e4ae6eeaf570 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:26.986746 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:27.031180 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a328eb1-c773-4bcc-a7e3-e4ae6eeaf570 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:27.033043 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a328eb1-c773-4bcc-a7e3-e4ae6eeaf570 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:27.137972 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936ace22-2d8b-4a12-9656-3118d5cbf321 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:27.140124 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 429/862] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Sep 5 12:04:26 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 05 12:04:27.146170 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a328eb1-c773-4bcc-a7e3-e4ae6eeaf570 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:27.199671 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:27.206928 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:27.250028 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a328eb1-c773-4bcc-a7e3-e4ae6eeaf570 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:27.252464 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936ace22-2d8b-4a12-9656-3118d5cbf321 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:27.288924 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab8ee1d-81df-4e79-987d-2c4cb1e24754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:27.289314 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b3b729-6297-417e-b03f-bf7d63c30ce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:27.289435 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab8ee1d-81df-4e79-987d-2c4cb1e24754 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:27.289718 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab8ee1d-81df-4e79-987d-2c4cb1e24754 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:27.289946 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b3b729-6297-417e-b03f-bf7d63c30ce7 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:27.290060 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab8ee1d-81df-4e79-987d-2c4cb1e24754 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:27.290231 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b3b729-6297-417e-b03f-bf7d63c30ce7 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:27.290510 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b3b729-6297-417e-b03f-bf7d63c30ce7 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:27.291095 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b3b729-6297-417e-b03f-bf7d63c30ce7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:27.292933 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b3b729-6297-417e-b03f-bf7d63c30ce7 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:27.300279 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab8ee1d-81df-4e79-987d-2c4cb1e24754 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:27.301730 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab8ee1d-81df-4e79-987d-2c4cb1e24754 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:27.301893 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application [None req-71b3b729-6297-417e-b03f-bf7d63c30ce7 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 05 12:04:27.301893 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:27.301893 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 05 12:04:27.301893 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 05 12:04:27.301893 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 05 12:04:27.301893 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 05 12:04:27.301893 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 05 12:04:27.301893 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 12:04:27.301893 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 05 12:04:27.301893 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:04:27.301893 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 12:04:27.301893 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:04:27.301893 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:27.301893 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:04:27.301893 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:04:27.301893 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:04:27.302805 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:04:27.302805 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:04:27.302805 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:04:27.302805 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:04:27.302805 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:04:27.302805 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:04:27.302805 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:04:27.302805 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 05 12:04:27.302805 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 05 12:04:27.302805 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 05 12:04:27.302805 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 05 12:04:27.302805 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:04:27.302805 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:04:27.302805 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:04:27.302805 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:04:27.302805 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:04:27.302805 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:04:27.303707 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:04:27.303707 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application with Lock( Sep 05 12:04:27.303707 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:04:27.303707 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:04:27.303707 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:04:27.303707 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:04:27.303707 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:04:27.303707 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:04:27.303707 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:04:27.303707 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:04:27.303707 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 05 12:04:27.303707 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 12:04:27.303707 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 05 12:04:27.303707 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:04:27.303707 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 434/863] 10.222.0.50 () {56 vars in 1132 bytes} [Mon Sep 5 12:04:27 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:04:27.304511 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a863952-302c-407f-b8df-27ba44805d80 None None] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:27.304511 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a863952-302c-407f-b8df-27ba44805d80 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:27.305297 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a863952-302c-407f-b8df-27ba44805d80 None None] PATH_INFO: `/` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:27.310002 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 435/864] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:04:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:04:27.310002 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a863952-302c-407f-b8df-27ba44805d80 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:27.324731 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-2ab8ee1d-81df-4e79-987d-2c4cb1e24754 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:04:27.324731 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:27.324731 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:04:27.324731 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:04:27.324731 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:04:27.324731 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:04:27.324731 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:04:27.324731 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:04:27.324731 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:04:27.324731 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:04:27.324731 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:04:27.324731 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:04:27.324731 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:04:27.324731 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:04:27.324731 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:04:27.324731 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:04:27.325897 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:04:27.325897 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:04:27.325897 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:04:27.325897 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:04:27.325897 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:04:27.325897 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:04:27.325897 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:04:27.325897 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:04:27.325897 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:04:27.325897 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:04:27.325897 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:04:27.325897 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:04:27.325897 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:04:27.325897 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:04:27.325897 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:04:27.325897 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:04:27.325897 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:04:27.326820 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:04:27.326820 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:04:27.326820 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:04:27.326820 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 430/865] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 5 12:04:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 12:04:27.327562 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4fda33-9628-4280-92f7-8b34e643aff8 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:27.327833 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4fda33-9628-4280-92f7-8b34e643aff8 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:27.328111 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4fda33-9628-4280-92f7-8b34e643aff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:27.347670 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-9d4fda33-9628-4280-92f7-8b34e643aff8 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:04:27.348870 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-9d4fda33-9628-4280-92f7-8b34e643aff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:04:27.427859 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 431/866] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:04:27 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 12:04:27.428750 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4fda33-9628-4280-92f7-8b34e643aff8 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:27.438618 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a863952-302c-407f-b8df-27ba44805d80 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:27.459657 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:27.480678 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273e26c2-d64b-4ecd-8109-fc267861844b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:27.481863 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273e26c2-d64b-4ecd-8109-fc267861844b None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:27.482424 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273e26c2-d64b-4ecd-8109-fc267861844b None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:27.482905 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273e26c2-d64b-4ecd-8109-fc267861844b None admin] PATH_INFO: `/v3/services` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:27.483819 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273e26c2-d64b-4ecd-8109-fc267861844b None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:27.484337 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273e26c2-d64b-4ecd-8109-fc267861844b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:27.486160 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273e26c2-d64b-4ecd-8109-fc267861844b None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:27.492175 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 436/867] 10.222.0.50 () {56 vars in 1126 bytes} [Mon Sep 5 12:04:27 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:04:27.493586 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:27.498250 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273e26c2-d64b-4ecd-8109-fc267861844b None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:27.571345 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4fda33-9628-4280-92f7-8b34e643aff8 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:27.614967 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1aca05-effc-470a-9e4c-eabfcbb9b669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:27.615608 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1aca05-effc-470a-9e4c-eabfcbb9b669 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:27.615891 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1aca05-effc-470a-9e4c-eabfcbb9b669 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:27.616162 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1aca05-effc-470a-9e4c-eabfcbb9b669 None admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:27.616805 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1aca05-effc-470a-9e4c-eabfcbb9b669 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:27.617146 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1aca05-effc-470a-9e4c-eabfcbb9b669 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:27.617504 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273e26c2-d64b-4ecd-8109-fc267861844b None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:27.618512 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1aca05-effc-470a-9e4c-eabfcbb9b669 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:27.641178 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 432/868] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 5 12:04:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:04:27.642474 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1aca05-effc-470a-9e4c-eabfcbb9b669 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:27.656063 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3ee088-0199-4851-b829-9acd68fe7658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:27.657056 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3ee088-0199-4851-b829-9acd68fe7658 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:27.657563 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3ee088-0199-4851-b829-9acd68fe7658 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:27.658159 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3ee088-0199-4851-b829-9acd68fe7658 None admin] PATH_INFO: `/v3/services` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:27.659097 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3ee088-0199-4851-b829-9acd68fe7658 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:27.659648 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3ee088-0199-4851-b829-9acd68fe7658 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:27.661340 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3ee088-0199-4851-b829-9acd68fe7658 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:27.666939 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 437/869] 10.222.0.50 () {56 vars in 1126 bytes} [Mon Sep 5 12:04:27 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:04:27.710747 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3ee088-0199-4851-b829-9acd68fe7658 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:27.773548 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:27.784862 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1aca05-effc-470a-9e4c-eabfcbb9b669 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:27.787490 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:27.842313 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3ee088-0199-4851-b829-9acd68fe7658 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:27.843147 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cc431a-c9b9-4c14-80de-f6c5184f1985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:27.843791 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cc431a-c9b9-4c14-80de-f6c5184f1985 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:27.844075 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cc431a-c9b9-4c14-80de-f6c5184f1985 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:27.844349 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cc431a-c9b9-4c14-80de-f6c5184f1985 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:27.851655 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cc431a-c9b9-4c14-80de-f6c5184f1985 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:27.853994 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cc431a-c9b9-4c14-80de-f6c5184f1985 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:27.867956 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-78cc431a-c9b9-4c14-80de-f6c5184f1985 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:04:27.867956 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:27.867956 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:04:27.867956 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:04:27.867956 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:04:27.867956 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:04:27.867956 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:04:27.867956 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:04:27.867956 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:04:27.867956 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:04:27.867956 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:04:27.867956 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:04:27.867956 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 12:04:27.867956 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 12:04:27.867956 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 12:04:27.868940 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 12:04:27.868940 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:04:27.868940 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:04:27.868940 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:04:27.868940 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:04:27.868940 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:04:27.868940 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:04:27.868940 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:04:27.868940 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:04:27.868940 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:04:27.868940 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:04:27.868940 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:04:27.868940 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:04:27.868940 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:04:27.868940 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:04:27.868940 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:04:27.868940 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:04:27.870374 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 12:04:27.870374 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 12:04:27.870374 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 12:04:27.870374 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 12:04:27.870374 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 12:04:27.870374 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 12:04:27.870374 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:04:27.870374 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:04:27.874466 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 433/870] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Sep 5 12:04:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:04:27.875407 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cc431a-c9b9-4c14-80de-f6c5184f1985 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:27.879178 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5eeea4-8986-4509-bd2b-64ae34c235e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:27.879794 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5eeea4-8986-4509-bd2b-64ae34c235e5 None admin] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:27.880076 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5eeea4-8986-4509-bd2b-64ae34c235e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:27.880346 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5eeea4-8986-4509-bd2b-64ae34c235e5 None admin] PATH_INFO: `/v3/services` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:27.881040 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5eeea4-8986-4509-bd2b-64ae34c235e5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:27.882512 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5eeea4-8986-4509-bd2b-64ae34c235e5 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:27.900950 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 438/871] 10.222.0.50 () {60 vars in 1141 bytes} [Mon Sep 5 12:04:27 2022] POST /identity/v3/services => generated 251 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 12:04:28.011261 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cc431a-c9b9-4c14-80de-f6c5184f1985 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:28.062143 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39da48cb-a1dd-41b5-8eb6-de8b7d16949e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:28.062768 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39da48cb-a1dd-41b5-8eb6-de8b7d16949e None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:28.063045 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39da48cb-a1dd-41b5-8eb6-de8b7d16949e None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:28.063318 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39da48cb-a1dd-41b5-8eb6-de8b7d16949e None admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:28.064020 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39da48cb-a1dd-41b5-8eb6-de8b7d16949e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:28.064325 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39da48cb-a1dd-41b5-8eb6-de8b7d16949e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:28.065811 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39da48cb-a1dd-41b5-8eb6-de8b7d16949e None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:28.079498 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 434/872] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Sep 5 12:04:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:04:28.086036 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5eeea4-8986-4509-bd2b-64ae34c235e5 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:28.204567 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5eeea4-8986-4509-bd2b-64ae34c235e5 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:28.212990 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:28.245823 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44ff280-d125-43e4-9233-8cf58b7b090e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:28.246870 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44ff280-d125-43e4-9233-8cf58b7b090e None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:28.247336 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44ff280-d125-43e4-9233-8cf58b7b090e None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:28.247786 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44ff280-d125-43e4-9233-8cf58b7b090e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:28.248766 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44ff280-d125-43e4-9233-8cf58b7b090e None admin] RBAC: Adding query filter params (role.id=16e2ccc8bd1b497d8cee780c1c7df0d2, scope.project.id=ae4f8939fcc040bca99783a77e6ede4d, user.id=ea2b32d58d964585a24e7c5784a8355f) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:28.249283 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44ff280-d125-43e4-9233-8cf58b7b090e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:28.250978 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44ff280-d125-43e4-9233-8cf58b7b090e None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:28.257775 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 439/873] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Sep 5 12:04:28 2022] GET /identity/v3/role_assignments?user.id=ea2b32d58d964585a24e7c5784a8355f&scope.project.id=ae4f8939fcc040bca99783a77e6ede4d&role.id=16e2ccc8bd1b497d8cee780c1c7df0d2 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:04:28.348067 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f8c5ab-ff24-44b3-aa15-a2722c900c6f None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:28.348847 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f8c5ab-ff24-44b3-aa15-a2722c900c6f None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:28.349444 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f8c5ab-ff24-44b3-aa15-a2722c900c6f None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:28.351433 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 435/874] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:04:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:04:28.358089 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcc68e9-8d33-4714-85e9-ff3fd1411598 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:28.358711 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcc68e9-8d33-4714-85e9-ff3fd1411598 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:28.359190 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcc68e9-8d33-4714-85e9-ff3fd1411598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:28.380128 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-1dcc68e9-8d33-4714-85e9-ff3fd1411598 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:04:28.381813 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-1dcc68e9-8d33-4714-85e9-ff3fd1411598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:04:28.465970 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 440/875] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:04:28 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 12:04:28.753127 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f8c5ab-ff24-44b3-aa15-a2722c900c6f None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:28.775866 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:28.876638 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f8c5ab-ff24-44b3-aa15-a2722c900c6f None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:28.915911 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85340438-ec2b-4dd0-bd6e-f80463306121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:28.917134 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85340438-ec2b-4dd0-bd6e-f80463306121 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:28.917416 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85340438-ec2b-4dd0-bd6e-f80463306121 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:28.917678 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85340438-ec2b-4dd0-bd6e-f80463306121 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:28.929633 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85340438-ec2b-4dd0-bd6e-f80463306121 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:04:28.935255 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-85340438-ec2b-4dd0-bd6e-f80463306121 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 05 12:04:28.935255 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:28.935255 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:04:28.935255 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:04:28.935255 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:04:28.935255 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:04:28.935255 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:04:28.935255 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:04:28.935255 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:04:28.935255 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:04:28.935255 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:04:28.935255 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:04:28.935255 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:04:28.935255 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:04:28.935255 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:04:28.935255 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:04:28.936273 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:04:28.936273 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:04:28.936273 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:04:28.936273 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:04:28.936273 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:04:28.936273 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:04:28.936273 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:04:28.936273 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:04:28.936273 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:04:28.936273 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:04:28.936273 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:04:28.936273 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:04:28.936273 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:04:28.936273 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:04:28.936273 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:04:28.936273 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:04:28.937170 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:04:28.937170 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:04:28.937170 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:04:28.937170 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:04:28.937170 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:04:28.937170 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:04:28.937170 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:04:28.937170 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:04:28.937170 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:04:28.937170 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:04:28.937170 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 05 12:04:28.937170 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:04:28.937170 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 436/876] 10.222.0.50 () {56 vars in 1120 bytes} [Mon Sep 5 12:04:28 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:04:28.942852 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcc68e9-8d33-4714-85e9-ff3fd1411598 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:29.063025 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:29.067343 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcc68e9-8d33-4714-85e9-ff3fd1411598 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:29.115486 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b562fcde-7aac-4679-949e-a7fa681f4095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:29.116478 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b562fcde-7aac-4679-949e-a7fa681f4095 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:29.116993 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b562fcde-7aac-4679-949e-a7fa681f4095 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:29.117467 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b562fcde-7aac-4679-949e-a7fa681f4095 None admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:29.118435 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b562fcde-7aac-4679-949e-a7fa681f4095 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:29.118935 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b562fcde-7aac-4679-949e-a7fa681f4095 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:29.120641 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b562fcde-7aac-4679-949e-a7fa681f4095 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:29.130115 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 441/877] 10.222.0.50 () {56 vars in 1115 bytes} [Mon Sep 5 12:04:28 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:04:29.135928 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85340438-ec2b-4dd0-bd6e-f80463306121 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:29.225484 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:29.245307 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85340438-ec2b-4dd0-bd6e-f80463306121 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:29.282048 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89187292-7b15-4015-9c4f-3d3143f1c6d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:29.283021 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89187292-7b15-4015-9c4f-3d3143f1c6d4 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:29.283485 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89187292-7b15-4015-9c4f-3d3143f1c6d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:29.283955 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89187292-7b15-4015-9c4f-3d3143f1c6d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:29.295988 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89187292-7b15-4015-9c4f-3d3143f1c6d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:29.297710 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89187292-7b15-4015-9c4f-3d3143f1c6d4 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:29.312926 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-89187292-7b15-4015-9c4f-3d3143f1c6d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:04:29.312926 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:29.312926 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:04:29.312926 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:04:29.312926 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:04:29.312926 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:04:29.312926 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:04:29.312926 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:04:29.312926 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:04:29.312926 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:04:29.312926 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:04:29.312926 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:04:29.312926 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:04:29.312926 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:04:29.312926 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:04:29.312926 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:04:29.313997 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:04:29.313997 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:04:29.313997 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:04:29.313997 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:04:29.313997 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:04:29.313997 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:04:29.313997 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:04:29.313997 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:04:29.313997 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:04:29.313997 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:04:29.313997 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:04:29.313997 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:04:29.313997 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:04:29.313997 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:04:29.313997 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:04:29.313997 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:04:29.313997 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:04:29.314901 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:04:29.314901 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:04:29.314901 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:04:29.316703 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 437/878] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 5 12:04:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:04:29.322850 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b562fcde-7aac-4679-949e-a7fa681f4095 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:29.436131 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b562fcde-7aac-4679-949e-a7fa681f4095 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:29.475760 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fc98b2-0f34-4cc3-bc4f-f6e00b6a740c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:29.476680 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fc98b2-0f34-4cc3-bc4f-f6e00b6a740c None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:29.477148 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fc98b2-0f34-4cc3-bc4f-f6e00b6a740c None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:29.477571 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fc98b2-0f34-4cc3-bc4f-f6e00b6a740c None admin] PATH_INFO: `/v3/domains` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:29.478380 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fc98b2-0f34-4cc3-bc4f-f6e00b6a740c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:29.478884 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fc98b2-0f34-4cc3-bc4f-f6e00b6a740c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:29.480710 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fc98b2-0f34-4cc3-bc4f-f6e00b6a740c None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:29.495134 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 442/879] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 5 12:04:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:04:29.500933 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89187292-7b15-4015-9c4f-3d3143f1c6d4 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:29.609610 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89187292-7b15-4015-9c4f-3d3143f1c6d4 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:29.639788 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:29.645873 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea55c6c-92ef-4158-a4c3-55195116e853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:29.646541 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea55c6c-92ef-4158-a4c3-55195116e853 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:29.646877 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea55c6c-92ef-4158-a4c3-55195116e853 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:29.647220 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea55c6c-92ef-4158-a4c3-55195116e853 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:29.656467 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea55c6c-92ef-4158-a4c3-55195116e853 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:29.658060 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea55c6c-92ef-4158-a4c3-55195116e853 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:29.670429 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-8ea55c6c-92ef-4158-a4c3-55195116e853 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 05 12:04:29.670429 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:29.670429 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:04:29.670429 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:04:29.670429 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:04:29.670429 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:04:29.670429 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:04:29.670429 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:04:29.670429 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:04:29.670429 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:04:29.670429 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:04:29.670429 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:04:29.670429 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 12:04:29.670429 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 12:04:29.670429 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 12:04:29.670429 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 12:04:29.671424 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:04:29.671424 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:04:29.671424 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 12:04:29.671424 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:04:29.671424 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 12:04:29.671424 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:04:29.671424 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:04:29.671424 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:04:29.671424 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:04:29.671424 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:04:29.671424 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:04:29.671424 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:04:29.671424 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:04:29.671424 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:04:29.671424 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:04:29.671424 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:04:29.671424 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:04:29.671424 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:04:29.672378 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:04:29.672378 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:04:29.672378 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 12:04:29.672378 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 12:04:29.672378 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 12:04:29.672378 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 12:04:29.672378 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 12:04:29.672378 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 12:04:29.672378 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 05 12:04:29.672378 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:04:29.672378 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 438/880] 10.222.0.50 () {56 vars in 1117 bytes} [Mon Sep 5 12:04:29 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:04:29.677650 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fc98b2-0f34-4cc3-bc4f-f6e00b6a740c None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:29.699044 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5e49b6-445b-4590-8235-f82a16d938f2 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:29.699362 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5e49b6-445b-4590-8235-f82a16d938f2 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:29.699595 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5e49b6-445b-4590-8235-f82a16d938f2 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:29.701194 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 439/881] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:04:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 12:04:29.705132 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:29.706086 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f614a0b2-4e08-4eb4-b31f-c1050c2813cf None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:29.706375 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f614a0b2-4e08-4eb4-b31f-c1050c2813cf None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:29.706652 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f614a0b2-4e08-4eb4-b31f-c1050c2813cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:29.725345 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-f614a0b2-4e08-4eb4-b31f-c1050c2813cf None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:04:29.726640 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-f614a0b2-4e08-4eb4-b31f-c1050c2813cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:04:29.799734 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fc98b2-0f34-4cc3-bc4f-f6e00b6a740c None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:29.829259 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 440/882] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:04:29 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 12:04:29.847183 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4459c68-3c37-4c95-b4ad-8f0bb37f46f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:29.847883 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4459c68-3c37-4c95-b4ad-8f0bb37f46f5 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:29.848177 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4459c68-3c37-4c95-b4ad-8f0bb37f46f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:29.848453 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4459c68-3c37-4c95-b4ad-8f0bb37f46f5 None admin] PATH_INFO: `/v3/users` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:29.849226 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4459c68-3c37-4c95-b4ad-8f0bb37f46f5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:29.849535 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4459c68-3c37-4c95-b4ad-8f0bb37f46f5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:29.851033 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4459c68-3c37-4c95-b4ad-8f0bb37f46f5 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:29.870313 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 443/883] 10.222.0.50 () {56 vars in 1149 bytes} [Mon Sep 5 12:04:29 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:04:29.876006 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f614a0b2-4e08-4eb4-b31f-c1050c2813cf None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:29.926309 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08636f6d-dea9-430a-bc5a-44440d91c7e9 None None] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:29.926787 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08636f6d-dea9-430a-bc5a-44440d91c7e9 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:29.927072 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08636f6d-dea9-430a-bc5a-44440d91c7e9 None None] PATH_INFO: `/` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:29.929372 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 444/884] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:04:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 12:04:29.935240 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b4b577-79d6-4825-bdeb-45b7e6edb17e None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:29.935537 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b4b577-79d6-4825-bdeb-45b7e6edb17e None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:29.935789 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b4b577-79d6-4825-bdeb-45b7e6edb17e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:29.956161 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-01b4b577-79d6-4825-bdeb-45b7e6edb17e None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:04:29.957676 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-01b4b577-79d6-4825-bdeb-45b7e6edb17e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:04:29.994692 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f614a0b2-4e08-4eb4-b31f-c1050c2813cf None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:30.019230 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:30.037922 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c0c9d3-c243-4aa3-ad44-6928067241cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:30.038726 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c0c9d3-c243-4aa3-ad44-6928067241cf None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:30.039085 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c0c9d3-c243-4aa3-ad44-6928067241cf None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:30.039369 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c0c9d3-c243-4aa3-ad44-6928067241cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:30.056988 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 445/885] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:04:29 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 05 12:04:30.116028 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c0c9d3-c243-4aa3-ad44-6928067241cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:30.117541 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c0c9d3-c243-4aa3-ad44-6928067241cf None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:30.125621 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b4b577-79d6-4825-bdeb-45b7e6edb17e None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:30.138256 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:30.234978 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b4b577-79d6-4825-bdeb-45b7e6edb17e None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:30.248940 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 441/886] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Sep 5 12:04:29 2022] GET /identity/v3/auth/tokens => generated 1262 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 05 12:04:30.253735 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c0c9d3-c243-4aa3-ad44-6928067241cf None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:30.277266 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:30.288406 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5837379-1f1a-44f7-90d3-245c2c27958d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:30.289594 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5837379-1f1a-44f7-90d3-245c2c27958d None admin] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:30.290086 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5837379-1f1a-44f7-90d3-245c2c27958d None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:30.290539 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5837379-1f1a-44f7-90d3-245c2c27958d None admin] PATH_INFO: `/v3/services` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:30.292167 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5837379-1f1a-44f7-90d3-245c2c27958d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:30.294472 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5837379-1f1a-44f7-90d3-245c2c27958d None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:30.315203 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 446/887] 10.222.0.50 () {60 vars in 1141 bytes} [Mon Sep 5 12:04:30 2022] POST /identity/v3/services => generated 269 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 12:04:30.334502 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6809c4d8-9bb0-45b0-b731-ff83128fb86d None None] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:30.335185 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6809c4d8-9bb0-45b0-b731-ff83128fb86d None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:30.335185 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6809c4d8-9bb0-45b0-b731-ff83128fb86d None None] PATH_INFO: `/` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:30.337260 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 447/888] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:04:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:04:30.343731 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a9fa26-2a2a-4c76-8899-964c02a7a5c9 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:30.344216 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a9fa26-2a2a-4c76-8899-964c02a7a5c9 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:30.344613 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a9fa26-2a2a-4c76-8899-964c02a7a5c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:30.364778 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-73a9fa26-2a2a-4c76-8899-964c02a7a5c9 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:04:30.366091 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-73a9fa26-2a2a-4c76-8899-964c02a7a5c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:04:30.391924 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c0c9d3-c243-4aa3-ad44-6928067241cf None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:30.439084 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d69237-3a5e-4086-b097-0bd85ffd910f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:30.439738 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d69237-3a5e-4086-b097-0bd85ffd910f None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:30.440017 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d69237-3a5e-4086-b097-0bd85ffd910f None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:30.440286 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d69237-3a5e-4086-b097-0bd85ffd910f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:30.442015 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:30.453078 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d69237-3a5e-4086-b097-0bd85ffd910f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:30.454950 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d69237-3a5e-4086-b097-0bd85ffd910f None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:30.457312 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 448/889] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:04:30 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 05 12:04:30.458219 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a9fa26-2a2a-4c76-8899-964c02a7a5c9 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:30.473910 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-b3d69237-3a5e-4086-b097-0bd85ffd910f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:04:30.473910 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:30.473910 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:04:30.473910 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:04:30.473910 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:04:30.473910 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:04:30.473910 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:04:30.473910 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:04:30.473910 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:04:30.473910 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:04:30.473910 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:04:30.473910 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:04:30.473910 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:04:30.473910 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:04:30.473910 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:04:30.473910 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:04:30.474947 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:04:30.474947 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:04:30.474947 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:04:30.474947 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:04:30.474947 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:04:30.474947 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:04:30.474947 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:04:30.474947 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:04:30.474947 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:04:30.474947 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:04:30.474947 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:04:30.474947 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:04:30.474947 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:04:30.474947 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:04:30.474947 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:04:30.474947 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:04:30.474947 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:04:30.475862 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:04:30.475862 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:04:30.475862 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:04:30.475862 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 442/890] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 5 12:04:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:04:30.481256 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d69237-3a5e-4086-b097-0bd85ffd910f None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:30.568707 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:30.574536 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a9fa26-2a2a-4c76-8899-964c02a7a5c9 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:30.609246 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d69237-3a5e-4086-b097-0bd85ffd910f None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:30.610426 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e02e0b-d573-4ddc-be05-51f44dfff926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:30.611073 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e02e0b-d573-4ddc-be05-51f44dfff926 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:30.611354 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e02e0b-d573-4ddc-be05-51f44dfff926 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:30.611680 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e02e0b-d573-4ddc-be05-51f44dfff926 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:30.612283 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e02e0b-d573-4ddc-be05-51f44dfff926 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:30.613893 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e02e0b-d573-4ddc-be05-51f44dfff926 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:30.622958 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application [None req-83e02e0b-d573-4ddc-be05-51f44dfff926 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 05 12:04:30.622958 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:30.622958 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 05 12:04:30.622958 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 05 12:04:30.622958 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 05 12:04:30.622958 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 05 12:04:30.622958 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 05 12:04:30.622958 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 12:04:30.622958 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 05 12:04:30.622958 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:04:30.622958 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 12:04:30.622958 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:04:30.622958 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:30.622958 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:04:30.622958 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:04:30.622958 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:04:30.622958 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:04:30.624049 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:04:30.624049 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:04:30.624049 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:04:30.624049 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:04:30.624049 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:04:30.624049 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:04:30.624049 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 05 12:04:30.624049 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 05 12:04:30.624049 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 05 12:04:30.624049 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 05 12:04:30.624049 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:04:30.624049 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:04:30.624049 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:04:30.624049 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:04:30.624049 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:04:30.624049 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:04:30.624916 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:04:30.624916 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application with Lock( Sep 05 12:04:30.624916 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:04:30.624916 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:04:30.624916 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:04:30.624916 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:04:30.624916 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:04:30.624916 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:04:30.624916 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:04:30.624916 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:04:30.624916 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 05 12:04:30.624916 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 12:04:30.624916 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 05 12:04:30.624916 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:04:30.624916 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 449/891] 10.222.0.50 () {56 vars in 1114 bytes} [Mon Sep 5 12:04:30 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:04:30.629861 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e02e0b-d573-4ddc-be05-51f44dfff926 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:30.655141 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819dfde9-2759-43f3-a257-de1a4bd7430d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:30.655672 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819dfde9-2759-43f3-a257-de1a4bd7430d None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:30.656030 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819dfde9-2759-43f3-a257-de1a4bd7430d None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:30.656296 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819dfde9-2759-43f3-a257-de1a4bd7430d None admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:30.657099 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819dfde9-2759-43f3-a257-de1a4bd7430d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:30.657413 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819dfde9-2759-43f3-a257-de1a4bd7430d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:30.659151 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819dfde9-2759-43f3-a257-de1a4bd7430d None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:30.675394 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 443/892] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 5 12:04:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:04:30.680493 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819dfde9-2759-43f3-a257-de1a4bd7430d None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:30.719574 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:30.761489 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e02e0b-d573-4ddc-be05-51f44dfff926 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:30.804770 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819dfde9-2759-43f3-a257-de1a4bd7430d None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:30.805845 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85fa128-53a8-409a-8c6e-5922f9b182b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:30.806464 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85fa128-53a8-409a-8c6e-5922f9b182b0 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:30.806745 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85fa128-53a8-409a-8c6e-5922f9b182b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:30.807050 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85fa128-53a8-409a-8c6e-5922f9b182b0 None admin] PATH_INFO: `/v3/services` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:30.807701 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85fa128-53a8-409a-8c6e-5922f9b182b0 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:30.808006 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85fa128-53a8-409a-8c6e-5922f9b182b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:30.809420 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85fa128-53a8-409a-8c6e-5922f9b182b0 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:30.814423 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 450/893] 10.222.0.50 () {56 vars in 1114 bytes} [Mon Sep 5 12:04:30 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:04:30.815237 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85fa128-53a8-409a-8c6e-5922f9b182b0 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:30.839142 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:30.851224 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce9b00a-1df3-4803-8f06-097d069865a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:30.851888 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce9b00a-1df3-4803-8f06-097d069865a3 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:30.852425 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce9b00a-1df3-4803-8f06-097d069865a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:30.852714 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce9b00a-1df3-4803-8f06-097d069865a3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:30.862241 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce9b00a-1df3-4803-8f06-097d069865a3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:30.863724 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce9b00a-1df3-4803-8f06-097d069865a3 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:30.879482 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-0ce9b00a-1df3-4803-8f06-097d069865a3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:04:30.879482 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:30.879482 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:04:30.879482 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:04:30.879482 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:04:30.879482 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:04:30.879482 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:04:30.879482 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:04:30.879482 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:04:30.879482 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:04:30.879482 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:04:30.879482 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:04:30.879482 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 12:04:30.879482 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 12:04:30.879482 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 12:04:30.880433 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 12:04:30.880433 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:04:30.880433 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:04:30.880433 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:04:30.880433 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:04:30.880433 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:04:30.880433 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:04:30.880433 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:04:30.880433 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:04:30.880433 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:04:30.880433 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:04:30.880433 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:04:30.880433 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:04:30.880433 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:04:30.880433 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:04:30.880433 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:04:30.880433 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:04:30.881421 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 12:04:30.881421 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 12:04:30.881421 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 12:04:30.881421 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 12:04:30.881421 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 12:04:30.881421 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 12:04:30.881421 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:04:30.881421 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:04:30.881421 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 444/894] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Sep 5 12:04:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 12:04:30.881941 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce9b00a-1df3-4803-8f06-097d069865a3 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:30.939083 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85fa128-53a8-409a-8c6e-5922f9b182b0 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:30.977825 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:30.987342 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976c7a7d-339e-47ac-a10e-34eadd5e7a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:30.987986 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976c7a7d-339e-47ac-a10e-34eadd5e7a90 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:30.988260 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976c7a7d-339e-47ac-a10e-34eadd5e7a90 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:30.988527 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976c7a7d-339e-47ac-a10e-34eadd5e7a90 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:30.989140 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976c7a7d-339e-47ac-a10e-34eadd5e7a90 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:30.990490 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976c7a7d-339e-47ac-a10e-34eadd5e7a90 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:30.999509 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application [None req-976c7a7d-339e-47ac-a10e-34eadd5e7a90 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 05 12:04:30.999509 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:30.999509 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 05 12:04:30.999509 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 05 12:04:30.999509 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 05 12:04:30.999509 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 05 12:04:30.999509 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 05 12:04:30.999509 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 12:04:30.999509 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 05 12:04:30.999509 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:04:30.999509 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 12:04:30.999509 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:04:30.999509 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:30.999509 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:04:30.999509 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:04:30.999509 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:04:30.999509 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:04:31.000515 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:04:31.000515 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:04:31.000515 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:04:31.000515 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:04:31.000515 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:04:31.000515 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:04:31.000515 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 05 12:04:31.000515 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 05 12:04:31.000515 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 05 12:04:31.000515 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 05 12:04:31.000515 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:04:31.000515 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:04:31.000515 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:04:31.000515 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:04:31.000515 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:04:31.000515 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:04:31.001488 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:04:31.001488 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application with Lock( Sep 05 12:04:31.001488 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:04:31.001488 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:04:31.001488 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:04:31.001488 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:04:31.001488 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:04:31.001488 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:04:31.001488 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:04:31.001488 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:04:31.001488 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 05 12:04:31.001488 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 12:04:31.001488 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 05 12:04:31.001488 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:04:31.001488 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 451/895] 10.222.0.50 () {56 vars in 1126 bytes} [Mon Sep 5 12:04:30 2022] GET /identity/v3/services/object-store => generated 93 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:04:31.002798 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976c7a7d-339e-47ac-a10e-34eadd5e7a90 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:31.007959 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce9b00a-1df3-4803-8f06-097d069865a3 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:31.046660 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ded0d63-8b7b-4217-a82c-82c2515fb469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:31.047531 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ded0d63-8b7b-4217-a82c-82c2515fb469 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:31.047963 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ded0d63-8b7b-4217-a82c-82c2515fb469 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:31.048384 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ded0d63-8b7b-4217-a82c-82c2515fb469 None admin] PATH_INFO: `/v3/services` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:31.049102 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ded0d63-8b7b-4217-a82c-82c2515fb469 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:31.049535 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ded0d63-8b7b-4217-a82c-82c2515fb469 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:31.052706 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ded0d63-8b7b-4217-a82c-82c2515fb469 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:31.059142 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 445/896] 10.222.0.50 () {56 vars in 1114 bytes} [Mon Sep 5 12:04:30 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:04:31.061480 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ded0d63-8b7b-4217-a82c-82c2515fb469 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:31.120584 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:31.123120 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976c7a7d-339e-47ac-a10e-34eadd5e7a90 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:31.165578 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532a9e18-e440-4fe5-b05c-4dd2bc44b807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:31.166819 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532a9e18-e440-4fe5-b05c-4dd2bc44b807 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:31.167110 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532a9e18-e440-4fe5-b05c-4dd2bc44b807 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:31.167603 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532a9e18-e440-4fe5-b05c-4dd2bc44b807 None admin] PATH_INFO: `/v3/projects` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:31.168055 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532a9e18-e440-4fe5-b05c-4dd2bc44b807 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:31.168361 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532a9e18-e440-4fe5-b05c-4dd2bc44b807 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:31.169861 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532a9e18-e440-4fe5-b05c-4dd2bc44b807 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:31.174179 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ded0d63-8b7b-4217-a82c-82c2515fb469 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:31.186853 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 452/897] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Sep 5 12:04:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:04:31.186853 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532a9e18-e440-4fe5-b05c-4dd2bc44b807 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:31.218928 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa76455f-8729-404e-89c6-719ffb695c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:31.219439 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa76455f-8729-404e-89c6-719ffb695c5a None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:31.219716 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa76455f-8729-404e-89c6-719ffb695c5a None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:31.220132 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa76455f-8729-404e-89c6-719ffb695c5a None admin] PATH_INFO: `/v3/services` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:31.220617 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa76455f-8729-404e-89c6-719ffb695c5a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:31.222004 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa76455f-8729-404e-89c6-719ffb695c5a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:31.222330 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa76455f-8729-404e-89c6-719ffb695c5a None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:31.227619 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 446/898] 10.222.0.50 () {56 vars in 1122 bytes} [Mon Sep 5 12:04:31 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:04:31.233631 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa76455f-8729-404e-89c6-719ffb695c5a None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:31.243278 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:31.298053 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532a9e18-e440-4fe5-b05c-4dd2bc44b807 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:31.336265 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79479700-cf6b-49ba-b627-db9d98087a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:31.336957 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79479700-cf6b-49ba-b627-db9d98087a04 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:31.337186 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79479700-cf6b-49ba-b627-db9d98087a04 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:31.337449 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79479700-cf6b-49ba-b627-db9d98087a04 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:31.338699 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79479700-cf6b-49ba-b627-db9d98087a04 None admin] RBAC: Adding query filter params (interface=public, service_id=c093c180bbf343bd8a125b9c134e53c1, region_id=RegionOne) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:31.339020 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79479700-cf6b-49ba-b627-db9d98087a04 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:31.340650 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79479700-cf6b-49ba-b627-db9d98087a04 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:31.346334 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa76455f-8729-404e-89c6-719ffb695c5a None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:31.349251 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 453/899] 10.222.0.50 () {56 vars in 1251 bytes} [Mon Sep 5 12:04:31 2022] GET /identity/v3/endpoints?service_id=c093c180bbf343bd8a125b9c134e53c1&interface=public®ion_id=RegionOne => generated 194 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:04:31.350036 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79479700-cf6b-49ba-b627-db9d98087a04 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:31.367558 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:31.390561 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f334ed4-be67-4ef8-afcb-7a30bb16f336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:31.391249 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f334ed4-be67-4ef8-afcb-7a30bb16f336 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:31.391542 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f334ed4-be67-4ef8-afcb-7a30bb16f336 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:31.391815 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f334ed4-be67-4ef8-afcb-7a30bb16f336 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:31.392821 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f334ed4-be67-4ef8-afcb-7a30bb16f336 None admin] RBAC: Adding query filter params (role.id=2ca407f96a3e417eac20298c6e80384e, scope.project.id=ae4f8939fcc040bca99783a77e6ede4d, user.id=bacc8ece8df24bf498c1d55ca2918224) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:31.393239 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f334ed4-be67-4ef8-afcb-7a30bb16f336 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:31.394911 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f334ed4-be67-4ef8-afcb-7a30bb16f336 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:31.402026 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 447/900] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Sep 5 12:04:31 2022] GET /identity/v3/role_assignments?user.id=bacc8ece8df24bf498c1d55ca2918224&scope.project.id=ae4f8939fcc040bca99783a77e6ede4d&role.id=2ca407f96a3e417eac20298c6e80384e => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:04:31.403225 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f334ed4-be67-4ef8-afcb-7a30bb16f336 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:31.491657 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79479700-cf6b-49ba-b627-db9d98087a04 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:31.512715 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:31.538108 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638d2774-aa07-4298-858c-ce02be7cd8d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:31.539080 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638d2774-aa07-4298-858c-ce02be7cd8d7 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:31.539546 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638d2774-aa07-4298-858c-ce02be7cd8d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:31.539990 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638d2774-aa07-4298-858c-ce02be7cd8d7 None admin] PATH_INFO: `/v3/services` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:31.540807 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638d2774-aa07-4298-858c-ce02be7cd8d7 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:31.541857 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638d2774-aa07-4298-858c-ce02be7cd8d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:31.543532 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638d2774-aa07-4298-858c-ce02be7cd8d7 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:31.557423 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 454/901] 10.222.0.50 () {56 vars in 1122 bytes} [Mon Sep 5 12:04:31 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:04:31.558785 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f334ed4-be67-4ef8-afcb-7a30bb16f336 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:31.599769 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc45c6f2-a9db-4e07-a369-080f4a805de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:31.600408 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc45c6f2-a9db-4e07-a369-080f4a805de5 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:31.600690 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc45c6f2-a9db-4e07-a369-080f4a805de5 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:31.601125 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc45c6f2-a9db-4e07-a369-080f4a805de5 None admin] PATH_INFO: `/v3/services` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:31.601759 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc45c6f2-a9db-4e07-a369-080f4a805de5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:31.603187 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc45c6f2-a9db-4e07-a369-080f4a805de5 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:31.610774 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 448/902] 10.222.0.50 () {56 vars in 1087 bytes} [Mon Sep 5 12:04:31 2022] GET /identity/v3/services => generated 1268 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:04:32.299938 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a6cd09-fe03-48c9-aa18-b28219f0985d None None] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:32.300352 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a6cd09-fe03-48c9-aa18-b28219f0985d None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:32.300466 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a6cd09-fe03-48c9-aa18-b28219f0985d None None] PATH_INFO: `/` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:32.302131 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 455/903] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:04:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:04:32.308006 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8f347f-2ebb-43e1-b849-93aae6ec3076 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:32.308506 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8f347f-2ebb-43e1-b849-93aae6ec3076 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:32.308592 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8f347f-2ebb-43e1-b849-93aae6ec3076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:32.327874 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-4b8f347f-2ebb-43e1-b849-93aae6ec3076 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:04:32.329094 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-4b8f347f-2ebb-43e1-b849-93aae6ec3076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:04:32.370354 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:32.402026 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 449/904] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:04:32 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 05 12:04:32.674030 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a6cd09-fe03-48c9-aa18-b28219f0985d None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:32.788051 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a6cd09-fe03-48c9-aa18-b28219f0985d None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:32.824488 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d080f424-2afc-42e4-b5e9-4dccc94bdc97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:32.825196 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d080f424-2afc-42e4-b5e9-4dccc94bdc97 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:32.825493 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d080f424-2afc-42e4-b5e9-4dccc94bdc97 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:32.825766 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d080f424-2afc-42e4-b5e9-4dccc94bdc97 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:32.826355 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d080f424-2afc-42e4-b5e9-4dccc94bdc97 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:32.827721 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d080f424-2afc-42e4-b5e9-4dccc94bdc97 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:32.837061 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application [None req-d080f424-2afc-42e4-b5e9-4dccc94bdc97 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 05 12:04:32.837061 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:32.837061 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 05 12:04:32.837061 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 05 12:04:32.837061 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 05 12:04:32.837061 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 05 12:04:32.837061 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 05 12:04:32.837061 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 12:04:32.837061 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 05 12:04:32.837061 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:04:32.837061 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 12:04:32.837061 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:04:32.837061 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:32.837061 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:04:32.837061 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:04:32.837061 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:04:32.838619 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:04:32.838619 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:04:32.838619 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:04:32.838619 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:04:32.838619 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:04:32.838619 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:04:32.838619 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:04:32.838619 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 05 12:04:32.838619 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 05 12:04:32.838619 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 05 12:04:32.838619 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 05 12:04:32.838619 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:04:32.838619 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:04:32.838619 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:04:32.838619 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:04:32.838619 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:04:32.838619 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:04:32.839596 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:04:32.839596 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application with Lock( Sep 05 12:04:32.839596 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:04:32.839596 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:04:32.839596 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:04:32.839596 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:04:32.839596 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:04:32.839596 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:04:32.839596 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:04:32.839596 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:04:32.839596 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 05 12:04:32.839596 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 12:04:32.839596 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 05 12:04:32.839596 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:04:32.839596 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 456/905] 10.222.0.50 () {56 vars in 1132 bytes} [Mon Sep 5 12:04:32 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:04:32.845118 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8f347f-2ebb-43e1-b849-93aae6ec3076 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:32.950904 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8f347f-2ebb-43e1-b849-93aae6ec3076 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:32.987352 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9b00ae-02e6-4657-9a6c-314342b924ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:32.988017 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9b00ae-02e6-4657-9a6c-314342b924ea None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:32.988304 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9b00ae-02e6-4657-9a6c-314342b924ea None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:32.988576 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9b00ae-02e6-4657-9a6c-314342b924ea None admin] PATH_INFO: `/v3/services` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:32.989248 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9b00ae-02e6-4657-9a6c-314342b924ea None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:32.989553 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9b00ae-02e6-4657-9a6c-314342b924ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:32.990939 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9b00ae-02e6-4657-9a6c-314342b924ea None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:32.996360 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 450/906] 10.222.0.50 () {56 vars in 1126 bytes} [Mon Sep 5 12:04:32 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:04:33.001773 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d080f424-2afc-42e4-b5e9-4dccc94bdc97 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:33.052737 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:33.111277 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d080f424-2afc-42e4-b5e9-4dccc94bdc97 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:33.148159 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11db8ffc-6d7d-406d-bd22-316542172d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:33.148790 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11db8ffc-6d7d-406d-bd22-316542172d56 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:33.149109 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11db8ffc-6d7d-406d-bd22-316542172d56 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:33.149382 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11db8ffc-6d7d-406d-bd22-316542172d56 None admin] PATH_INFO: `/v3/services` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:33.150023 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11db8ffc-6d7d-406d-bd22-316542172d56 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:33.150324 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11db8ffc-6d7d-406d-bd22-316542172d56 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:33.152272 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11db8ffc-6d7d-406d-bd22-316542172d56 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:33.157977 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 457/907] 10.222.0.50 () {56 vars in 1126 bytes} [Mon Sep 5 12:04:33 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:04:33.163730 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9b00ae-02e6-4657-9a6c-314342b924ea None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:33.211957 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:33.278757 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9b00ae-02e6-4657-9a6c-314342b924ea None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:33.314258 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59d7bd3-013e-49cc-ba74-dad12ae3727b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:33.315033 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59d7bd3-013e-49cc-ba74-dad12ae3727b None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:33.315215 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59d7bd3-013e-49cc-ba74-dad12ae3727b None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:33.315437 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59d7bd3-013e-49cc-ba74-dad12ae3727b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:33.316177 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59d7bd3-013e-49cc-ba74-dad12ae3727b None admin] RBAC: Adding query filter params (interface=public, service_id=d7d25e8aa8c343dd893e61da8f7316a3, region_id=RegionOne) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:33.316483 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59d7bd3-013e-49cc-ba74-dad12ae3727b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:33.317878 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59d7bd3-013e-49cc-ba74-dad12ae3727b None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:33.323827 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 451/908] 10.222.0.50 () {56 vars in 1251 bytes} [Mon Sep 5 12:04:33 2022] GET /identity/v3/endpoints?service_id=d7d25e8aa8c343dd893e61da8f7316a3&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:04:33.329100 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11db8ffc-6d7d-406d-bd22-316542172d56 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:33.439769 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11db8ffc-6d7d-406d-bd22-316542172d56 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:33.449996 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:33.481995 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebb0a4e-0c42-4fb6-b81e-9ae9de8a2ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:33.482592 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb0a4e-0c42-4fb6-b81e-9ae9de8a2ed4 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:33.482872 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb0a4e-0c42-4fb6-b81e-9ae9de8a2ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:33.483142 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb0a4e-0c42-4fb6-b81e-9ae9de8a2ed4 None admin] PATH_INFO: `/v3/services` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:33.483751 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebb0a4e-0c42-4fb6-b81e-9ae9de8a2ed4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:33.485153 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebb0a4e-0c42-4fb6-b81e-9ae9de8a2ed4 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:33.491940 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 458/909] 10.222.0.50 () {56 vars in 1087 bytes} [Mon Sep 5 12:04:33 2022] GET /identity/v3/services => generated 1268 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:04:33.498571 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edc8c5d-9e0c-4562-bfba-e76bf29dcc5b None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:33.499229 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edc8c5d-9e0c-4562-bfba-e76bf29dcc5b None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:33.499709 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edc8c5d-9e0c-4562-bfba-e76bf29dcc5b None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:33.501731 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 452/910] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:04:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:04:33.507700 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812226d6-cefe-4a19-ba7b-e82fc9c9c2a0 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:33.508371 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812226d6-cefe-4a19-ba7b-e82fc9c9c2a0 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:33.508865 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812226d6-cefe-4a19-ba7b-e82fc9c9c2a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:33.529676 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-812226d6-cefe-4a19-ba7b-e82fc9c9c2a0 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:04:33.531252 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-812226d6-cefe-4a19-ba7b-e82fc9c9c2a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:04:33.609897 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971e7a05-5694-402d-bc81-273936a69baa None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:33.610583 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971e7a05-5694-402d-bc81-273936a69baa None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:33.611062 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971e7a05-5694-402d-bc81-273936a69baa None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:33.616958 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 453/911] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:04:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 12:04:33.618419 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 459/912] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:04:33 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 12:04:33.619201 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259bf8a2-9b44-468d-b7cf-1aa4c3bd0cf3 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:33.619734 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259bf8a2-9b44-468d-b7cf-1aa4c3bd0cf3 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:33.620220 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259bf8a2-9b44-468d-b7cf-1aa4c3bd0cf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:33.640414 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-259bf8a2-9b44-468d-b7cf-1aa4c3bd0cf3 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:04:33.641987 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-259bf8a2-9b44-468d-b7cf-1aa4c3bd0cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:04:33.661412 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9409b544-8685-401d-8636-224a9c0897e0 None None] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:33.662048 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9409b544-8685-401d-8636-224a9c0897e0 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:33.662533 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9409b544-8685-401d-8636-224a9c0897e0 None None] PATH_INFO: `/` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:33.664048 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 460/913] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:04:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 12:04:33.669627 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634fe93c-ed71-46a0-88fd-2619f7a074e3 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:33.670149 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634fe93c-ed71-46a0-88fd-2619f7a074e3 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:33.670636 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634fe93c-ed71-46a0-88fd-2619f7a074e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:33.691773 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-634fe93c-ed71-46a0-88fd-2619f7a074e3 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:04:33.693006 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-634fe93c-ed71-46a0-88fd-2619f7a074e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:04:33.733472 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 454/914] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:04:33 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 12:04:33.779087 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 461/915] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:04:33 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 05 12:04:33.902098 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259bf8a2-9b44-468d-b7cf-1aa4c3bd0cf3 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:33.934419 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:34.002644 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634fe93c-ed71-46a0-88fd-2619f7a074e3 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:34.008071 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259bf8a2-9b44-468d-b7cf-1aa4c3bd0cf3 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:34.038593 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:34.048791 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceb4528-3ff1-44d6-84d0-f4df46d1958e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:34.049462 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceb4528-3ff1-44d6-84d0-f4df46d1958e None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:34.049741 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceb4528-3ff1-44d6-84d0-f4df46d1958e None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:34.050014 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceb4528-3ff1-44d6-84d0-f4df46d1958e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:34.062240 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dceb4528-3ff1-44d6-84d0-f4df46d1958e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:04:34.067181 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-dceb4528-3ff1-44d6-84d0-f4df46d1958e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 05 12:04:34.067181 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:34.067181 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:04:34.067181 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:04:34.067181 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:04:34.067181 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:04:34.067181 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:04:34.067181 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:04:34.067181 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:04:34.067181 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:04:34.067181 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:04:34.067181 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:04:34.067181 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:04:34.067181 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:04:34.067181 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:04:34.067181 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:04:34.068334 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:04:34.068334 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:04:34.068334 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:04:34.068334 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:04:34.068334 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:04:34.068334 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:04:34.068334 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:04:34.068334 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:04:34.068334 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:04:34.068334 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:04:34.068334 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:04:34.068334 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:04:34.068334 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:04:34.068334 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:04:34.068334 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:04:34.068334 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:04:34.069406 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:04:34.069406 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:04:34.069406 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:04:34.069406 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:04:34.069406 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:04:34.069406 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:04:34.069406 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:04:34.069406 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:04:34.069406 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:04:34.069406 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:04:34.069406 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 05 12:04:34.069406 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:04:34.073804 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 455/916] 10.222.0.50 () {56 vars in 1120 bytes} [Mon Sep 5 12:04:33 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:04:34.074884 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceb4528-3ff1-44d6-84d0-f4df46d1958e None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:34.129418 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634fe93c-ed71-46a0-88fd-2619f7a074e3 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:34.170081 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:34.175868 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f626c4-9de5-4758-a772-5ae725975d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:34.176941 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f626c4-9de5-4758-a772-5ae725975d6a None admin] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:34.177351 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f626c4-9de5-4758-a772-5ae725975d6a None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:34.177625 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f626c4-9de5-4758-a772-5ae725975d6a None admin] PATH_INFO: `/v3/services` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:34.178298 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f626c4-9de5-4758-a772-5ae725975d6a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:34.178885 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceb4528-3ff1-44d6-84d0-f4df46d1958e None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:34.179668 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f626c4-9de5-4758-a772-5ae725975d6a None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:34.196181 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 462/917] 10.222.0.50 () {60 vars in 1141 bytes} [Mon Sep 5 12:04:34 2022] POST /identity/v3/services => generated 241 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 12:04:34.197106 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f626c4-9de5-4758-a772-5ae725975d6a None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:34.230428 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d630ef9-5d10-460a-a5f2-9c1f3ccb567c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:34.231457 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d630ef9-5d10-460a-a5f2-9c1f3ccb567c None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:34.231939 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d630ef9-5d10-460a-a5f2-9c1f3ccb567c None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:34.232496 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d630ef9-5d10-460a-a5f2-9c1f3ccb567c None admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:34.233543 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d630ef9-5d10-460a-a5f2-9c1f3ccb567c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:34.234059 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d630ef9-5d10-460a-a5f2-9c1f3ccb567c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:34.235722 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d630ef9-5d10-460a-a5f2-9c1f3ccb567c None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:34.246703 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 456/918] 10.222.0.50 () {56 vars in 1115 bytes} [Mon Sep 5 12:04:34 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:04:34.261011 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d630ef9-5d10-460a-a5f2-9c1f3ccb567c None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:34.329727 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:34.342398 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f626c4-9de5-4758-a772-5ae725975d6a None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:34.379493 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d630ef9-5d10-460a-a5f2-9c1f3ccb567c None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:34.381759 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1875ce6c-11bf-42c0-9ba1-6d954e7f3645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:34.383459 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1875ce6c-11bf-42c0-9ba1-6d954e7f3645 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:34.383806 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1875ce6c-11bf-42c0-9ba1-6d954e7f3645 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:34.384145 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1875ce6c-11bf-42c0-9ba1-6d954e7f3645 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:34.384806 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1875ce6c-11bf-42c0-9ba1-6d954e7f3645 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:34.386910 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1875ce6c-11bf-42c0-9ba1-6d954e7f3645 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:34.397403 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application [None req-1875ce6c-11bf-42c0-9ba1-6d954e7f3645 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 05 12:04:34.397403 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:34.397403 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 05 12:04:34.397403 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 05 12:04:34.397403 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 05 12:04:34.397403 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 05 12:04:34.397403 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 05 12:04:34.397403 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 12:04:34.397403 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 05 12:04:34.397403 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:04:34.397403 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 12:04:34.397403 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:04:34.397403 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:34.397403 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:04:34.397403 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:04:34.397403 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:04:34.397403 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:04:34.398752 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:04:34.398752 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:04:34.398752 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:04:34.398752 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:04:34.398752 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:04:34.398752 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:04:34.398752 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 05 12:04:34.398752 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 05 12:04:34.398752 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 05 12:04:34.398752 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 05 12:04:34.398752 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:04:34.398752 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:04:34.398752 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:04:34.398752 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:04:34.398752 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:04:34.398752 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:04:34.399644 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:04:34.399644 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application with Lock( Sep 05 12:04:34.399644 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:04:34.399644 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:04:34.399644 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:04:34.399644 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:04:34.399644 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:04:34.399644 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:04:34.399644 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:04:34.399644 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:04:34.399644 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 05 12:04:34.399644 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 12:04:34.399644 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 05 12:04:34.399644 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:04:34.399644 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 463/919] 10.222.0.50 () {56 vars in 1114 bytes} [Mon Sep 5 12:04:34 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:04:34.404525 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1875ce6c-11bf-42c0-9ba1-6d954e7f3645 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:34.435093 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb60f1c-c5dc-46e5-a2f4-45febac11571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:34.435854 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb60f1c-c5dc-46e5-a2f4-45febac11571 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:34.436140 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb60f1c-c5dc-46e5-a2f4-45febac11571 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:34.436463 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb60f1c-c5dc-46e5-a2f4-45febac11571 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:34.453765 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb60f1c-c5dc-46e5-a2f4-45febac11571 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:34.455298 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb60f1c-c5dc-46e5-a2f4-45febac11571 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:34.471679 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-0fb60f1c-c5dc-46e5-a2f4-45febac11571 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:04:34.471679 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:34.471679 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:04:34.471679 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:04:34.471679 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:04:34.471679 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:04:34.471679 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:04:34.471679 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:04:34.471679 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:04:34.471679 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:04:34.471679 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:04:34.471679 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:04:34.471679 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:04:34.471679 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:04:34.471679 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:04:34.471679 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:04:34.472740 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:04:34.472740 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:04:34.472740 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:04:34.472740 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:04:34.472740 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:04:34.472740 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:04:34.472740 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:04:34.472740 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:04:34.472740 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:04:34.472740 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:04:34.472740 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:04:34.472740 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:04:34.472740 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:04:34.472740 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:04:34.472740 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:04:34.472740 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:04:34.472740 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:04:34.473709 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:04:34.473709 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:04:34.473709 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:04:34.477692 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 457/920] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 5 12:04:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:04:34.478725 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb60f1c-c5dc-46e5-a2f4-45febac11571 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:34.481756 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:34.523218 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1875ce6c-11bf-42c0-9ba1-6d954e7f3645 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:34.559125 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46aae7b-e1ce-4245-94c2-adcdf0e68df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:34.559742 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46aae7b-e1ce-4245-94c2-adcdf0e68df8 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:34.560022 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46aae7b-e1ce-4245-94c2-adcdf0e68df8 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:34.560296 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46aae7b-e1ce-4245-94c2-adcdf0e68df8 None admin] PATH_INFO: `/v3/services` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:34.560957 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46aae7b-e1ce-4245-94c2-adcdf0e68df8 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:34.561267 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46aae7b-e1ce-4245-94c2-adcdf0e68df8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:34.562655 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46aae7b-e1ce-4245-94c2-adcdf0e68df8 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:34.568041 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 464/921] 10.222.0.50 () {56 vars in 1114 bytes} [Mon Sep 5 12:04:34 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:04:34.574244 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46aae7b-e1ce-4245-94c2-adcdf0e68df8 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:34.593326 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb60f1c-c5dc-46e5-a2f4-45febac11571 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:34.598191 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:34.632150 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c144c9-8ee9-432b-8a3a-a6b6ad99fe3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:34.632831 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c144c9-8ee9-432b-8a3a-a6b6ad99fe3c None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:34.633146 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c144c9-8ee9-432b-8a3a-a6b6ad99fe3c None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:34.633583 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c144c9-8ee9-432b-8a3a-a6b6ad99fe3c None admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:34.634090 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c144c9-8ee9-432b-8a3a-a6b6ad99fe3c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:34.634398 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c144c9-8ee9-432b-8a3a-a6b6ad99fe3c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:34.636464 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c144c9-8ee9-432b-8a3a-a6b6ad99fe3c None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:34.655323 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 458/922] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 5 12:04:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:04:34.656187 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c144c9-8ee9-432b-8a3a-a6b6ad99fe3c None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:34.689751 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46aae7b-e1ce-4245-94c2-adcdf0e68df8 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:34.721170 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:34.726184 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f5967f-b933-4a92-95f4-cd139282199f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:34.726807 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f5967f-b933-4a92-95f4-cd139282199f None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:34.727094 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f5967f-b933-4a92-95f4-cd139282199f None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:34.727510 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f5967f-b933-4a92-95f4-cd139282199f None admin] PATH_INFO: `/v3/services` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:34.728008 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f5967f-b933-4a92-95f4-cd139282199f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:34.728379 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f5967f-b933-4a92-95f4-cd139282199f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:34.730550 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f5967f-b933-4a92-95f4-cd139282199f None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:34.741008 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 465/923] 10.222.0.50 () {56 vars in 1114 bytes} [Mon Sep 5 12:04:34 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:04:34.741947 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f5967f-b933-4a92-95f4-cd139282199f None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:34.766363 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c144c9-8ee9-432b-8a3a-a6b6ad99fe3c None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:34.803718 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73da84fd-aa72-4ce1-9300-d143e4bbee6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:34.804381 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73da84fd-aa72-4ce1-9300-d143e4bbee6b None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:34.804703 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73da84fd-aa72-4ce1-9300-d143e4bbee6b None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:34.805009 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73da84fd-aa72-4ce1-9300-d143e4bbee6b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:34.814212 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73da84fd-aa72-4ce1-9300-d143e4bbee6b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:34.815809 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73da84fd-aa72-4ce1-9300-d143e4bbee6b None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:34.829241 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-73da84fd-aa72-4ce1-9300-d143e4bbee6b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 05 12:04:34.829241 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:34.829241 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:04:34.829241 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:04:34.829241 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:04:34.829241 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:04:34.829241 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:04:34.829241 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:04:34.829241 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:04:34.829241 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:04:34.829241 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:04:34.829241 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:04:34.829241 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 12:04:34.829241 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 12:04:34.829241 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 12:04:34.829241 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 12:04:34.830315 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:04:34.830315 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:04:34.830315 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 12:04:34.830315 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:04:34.830315 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 12:04:34.830315 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:04:34.830315 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:04:34.830315 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:04:34.830315 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:04:34.830315 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:04:34.830315 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:04:34.830315 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:04:34.830315 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:04:34.830315 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:04:34.830315 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:04:34.830315 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:04:34.830315 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:04:34.830315 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:04:34.831308 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:04:34.831308 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:04:34.831308 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 12:04:34.831308 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 12:04:34.831308 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 12:04:34.831308 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 12:04:34.831308 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 12:04:34.831308 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 12:04:34.831308 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 05 12:04:34.831308 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:04:34.835350 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 459/924] 10.222.0.50 () {56 vars in 1117 bytes} [Mon Sep 5 12:04:34 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 12:04:34.836335 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73da84fd-aa72-4ce1-9300-d143e4bbee6b None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:34.865323 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:34.873098 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f5967f-b933-4a92-95f4-cd139282199f None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:34.937941 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f5a73a-ed8a-47b5-b812-3e17f10660b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:34.939094 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f5a73a-ed8a-47b5-b812-3e17f10660b3 None admin] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:34.939947 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f5a73a-ed8a-47b5-b812-3e17f10660b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:34.940370 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f5a73a-ed8a-47b5-b812-3e17f10660b3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:34.941248 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f5a73a-ed8a-47b5-b812-3e17f10660b3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:34.942787 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f5a73a-ed8a-47b5-b812-3e17f10660b3 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:34.956690 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73da84fd-aa72-4ce1-9300-d143e4bbee6b None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:34.969725 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 466/925] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 5 12:04:34 2022] POST /identity/v3/endpoints => generated 346 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:04:34.993226 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:35.020441 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833edf77-67f3-44be-85c3-ba47e770c8b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:35.021342 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833edf77-67f3-44be-85c3-ba47e770c8b4 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:35.021753 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833edf77-67f3-44be-85c3-ba47e770c8b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:35.022177 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833edf77-67f3-44be-85c3-ba47e770c8b4 None admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:35.023365 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833edf77-67f3-44be-85c3-ba47e770c8b4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:35.023856 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833edf77-67f3-44be-85c3-ba47e770c8b4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:35.026190 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833edf77-67f3-44be-85c3-ba47e770c8b4 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:35.049460 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 460/926] 10.222.0.50 () {56 vars in 1149 bytes} [Mon Sep 5 12:04:34 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:04:35.056304 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f5a73a-ed8a-47b5-b812-3e17f10660b3 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:35.182816 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f5a73a-ed8a-47b5-b812-3e17f10660b3 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:35.220429 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52889e6-dc7a-4ffd-a2e9-b68e0b84442c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:35.221113 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52889e6-dc7a-4ffd-a2e9-b68e0b84442c None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:35.221398 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52889e6-dc7a-4ffd-a2e9-b68e0b84442c None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:35.221675 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52889e6-dc7a-4ffd-a2e9-b68e0b84442c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:35.232657 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:35.235726 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52889e6-dc7a-4ffd-a2e9-b68e0b84442c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:35.237291 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52889e6-dc7a-4ffd-a2e9-b68e0b84442c None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:35.256199 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application [None req-f52889e6-dc7a-4ffd-a2e9-b68e0b84442c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:04:35.256199 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:35.256199 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:04:35.256199 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:04:35.256199 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:04:35.256199 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:04:35.256199 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:04:35.256199 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:04:35.256199 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:04:35.256199 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:04:35.256199 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:04:35.256199 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:04:35.256199 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:04:35.256199 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:04:35.256199 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:04:35.256199 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:04:35.257244 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:04:35.257244 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:04:35.257244 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:04:35.257244 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:04:35.257244 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:04:35.257244 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:04:35.257244 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:04:35.257244 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application with Lock( Sep 05 12:04:35.257244 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:04:35.257244 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:04:35.257244 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:04:35.257244 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:04:35.257244 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:04:35.257244 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:04:35.257244 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:04:35.257244 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:04:35.257244 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:04:35.258139 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:04:35.258139 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:04:35.258139 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:04:35.258139 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 467/927] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 5 12:04:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:04:35.264435 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833edf77-67f3-44be-85c3-ba47e770c8b4 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:35.370607 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833edf77-67f3-44be-85c3-ba47e770c8b4 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:35.407336 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaec45f2-ed5b-4183-9837-e26f621c31a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:35.408001 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaec45f2-ed5b-4183-9837-e26f621c31a9 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:35.408214 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaec45f2-ed5b-4183-9837-e26f621c31a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:35.408493 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaec45f2-ed5b-4183-9837-e26f621c31a9 None admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:35.409174 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaec45f2-ed5b-4183-9837-e26f621c31a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:35.409481 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaec45f2-ed5b-4183-9837-e26f621c31a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:35.410870 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaec45f2-ed5b-4183-9837-e26f621c31a9 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:35.423149 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 461/928] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 5 12:04:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:04:35.428853 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52889e6-dc7a-4ffd-a2e9-b68e0b84442c None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:35.495525 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80d1437-55ce-4121-b42b-05b6262357dc None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:35.495872 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80d1437-55ce-4121-b42b-05b6262357dc None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:35.496121 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80d1437-55ce-4121-b42b-05b6262357dc None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:35.498849 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 462/929] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:04:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 12:04:35.503279 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b49b42f-71ab-4764-a279-cf6e464a6753 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:35.503565 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b49b42f-71ab-4764-a279-cf6e464a6753 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:35.503848 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b49b42f-71ab-4764-a279-cf6e464a6753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:35.524146 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-8b49b42f-71ab-4764-a279-cf6e464a6753 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:04:35.525395 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-8b49b42f-71ab-4764-a279-cf6e464a6753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:04:35.541658 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52889e6-dc7a-4ffd-a2e9-b68e0b84442c None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:35.565469 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:35.580249 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6bb79c-16c2-4515-9b35-047b8d792f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:35.580907 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6bb79c-16c2-4515-9b35-047b8d792f2e None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:35.581208 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6bb79c-16c2-4515-9b35-047b8d792f2e None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:35.581482 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6bb79c-16c2-4515-9b35-047b8d792f2e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:35.589529 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6bb79c-16c2-4515-9b35-047b8d792f2e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:35.590988 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6bb79c-16c2-4515-9b35-047b8d792f2e None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:35.605987 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application [None req-5e6bb79c-16c2-4515-9b35-047b8d792f2e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:04:35.605987 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:35.605987 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:04:35.605987 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:04:35.605987 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:04:35.605987 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:04:35.605987 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:04:35.605987 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:04:35.605987 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:04:35.605987 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:04:35.605987 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:04:35.605987 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:04:35.605987 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 12:04:35.605987 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 12:04:35.605987 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 12:04:35.607146 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 12:04:35.607146 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:04:35.607146 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:04:35.607146 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:04:35.607146 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:04:35.607146 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:04:35.607146 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:04:35.607146 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:04:35.607146 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application with Lock( Sep 05 12:04:35.607146 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:04:35.607146 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:04:35.607146 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:04:35.607146 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:04:35.607146 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:04:35.607146 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:04:35.607146 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:04:35.607146 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:04:35.608177 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 12:04:35.608177 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 12:04:35.608177 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 12:04:35.608177 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 12:04:35.608177 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 12:04:35.608177 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 12:04:35.608177 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:04:35.608177 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:04:35.608177 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 468/930] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Sep 5 12:04:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:04:35.612974 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 463/931] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:04:35 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 05 12:04:35.622143 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6bb79c-16c2-4515-9b35-047b8d792f2e None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:35.682662 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:35.733160 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6bb79c-16c2-4515-9b35-047b8d792f2e None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:35.775033 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28174769-f12d-4ca2-8016-b6300d43b919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:35.776537 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28174769-f12d-4ca2-8016-b6300d43b919 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:35.777009 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28174769-f12d-4ca2-8016-b6300d43b919 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:35.777438 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28174769-f12d-4ca2-8016-b6300d43b919 None admin] PATH_INFO: `/v3/projects` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:35.778298 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28174769-f12d-4ca2-8016-b6300d43b919 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:35.778755 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28174769-f12d-4ca2-8016-b6300d43b919 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:35.780426 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28174769-f12d-4ca2-8016-b6300d43b919 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:35.794298 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 469/932] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Sep 5 12:04:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:04:35.799924 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b49b42f-71ab-4764-a279-cf6e464a6753 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:35.902828 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28174769-f12d-4ca2-8016-b6300d43b919 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:35.904491 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b49b42f-71ab-4764-a279-cf6e464a6753 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:35.942346 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b593959-f0ae-4c0a-b02b-075190bffb23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:35.943022 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b593959-f0ae-4c0a-b02b-075190bffb23 None admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:35.943303 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b593959-f0ae-4c0a-b02b-075190bffb23 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:35.943578 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b593959-f0ae-4c0a-b02b-075190bffb23 None admin] PATH_INFO: `/v3/projects/ae4f8939fcc040bca99783a77e6ede4d/users/bacc8ece8df24bf498c1d55ca2918224/roles/2ca407f96a3e417eac20298c6e80384e` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:35.945856 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b593959-f0ae-4c0a-b02b-075190bffb23 None admin] RBAC: Authorizing `identity:create_grant(project_id=ae4f8939fcc040bca99783a77e6ede4d, user_id=bacc8ece8df24bf498c1d55ca2918224, role_id=2ca407f96a3e417eac20298c6e80384e)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:35.947986 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b593959-f0ae-4c0a-b02b-075190bffb23 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:35.969955 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 464/933] 10.222.0.50 () {58 vars in 1439 bytes} [Mon Sep 5 12:04:35 2022] PUT /identity/v3/projects/ae4f8939fcc040bca99783a77e6ede4d/users/bacc8ece8df24bf498c1d55ca2918224/roles/2ca407f96a3e417eac20298c6e80384e => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:04:36.038705 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28174769-f12d-4ca2-8016-b6300d43b919 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:36.056532 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:36.084576 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfd8017-6028-4dcd-89dd-fd49ab63115a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:36.085327 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfd8017-6028-4dcd-89dd-fd49ab63115a None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:36.085641 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfd8017-6028-4dcd-89dd-fd49ab63115a None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:36.085939 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfd8017-6028-4dcd-89dd-fd49ab63115a None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:36.086641 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfd8017-6028-4dcd-89dd-fd49ab63115a None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:36.088374 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfd8017-6028-4dcd-89dd-fd49ab63115a None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:36.099500 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application [None req-3cfd8017-6028-4dcd-89dd-fd49ab63115a None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 05 12:04:36.099500 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:36.099500 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 05 12:04:36.099500 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 05 12:04:36.099500 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 05 12:04:36.099500 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 05 12:04:36.099500 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 05 12:04:36.099500 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 12:04:36.099500 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 05 12:04:36.099500 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:04:36.099500 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 12:04:36.099500 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:04:36.099500 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:36.099500 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:04:36.099500 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:04:36.099500 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:04:36.100516 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:04:36.100516 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:04:36.100516 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:04:36.100516 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:04:36.100516 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:04:36.100516 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:04:36.100516 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:04:36.100516 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 05 12:04:36.100516 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 05 12:04:36.100516 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 05 12:04:36.100516 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 05 12:04:36.100516 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:04:36.100516 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:04:36.100516 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:04:36.100516 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:04:36.100516 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:04:36.100516 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:04:36.101473 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:04:36.101473 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application with Lock( Sep 05 12:04:36.101473 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:04:36.101473 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:04:36.101473 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:04:36.101473 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:04:36.101473 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:04:36.101473 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:04:36.101473 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:04:36.101473 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:04:36.101473 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 05 12:04:36.101473 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 12:04:36.101473 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 05 12:04:36.101473 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:04:36.105116 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 470/934] 10.222.0.50 () {56 vars in 1132 bytes} [Mon Sep 5 12:04:35 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:04:36.107601 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b593959-f0ae-4c0a-b02b-075190bffb23 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:36.140877 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:36.223795 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b593959-f0ae-4c0a-b02b-075190bffb23 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:36.265221 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a3e501-6b20-4781-ba3a-3967208f21f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:36.265883 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a3e501-6b20-4781-ba3a-3967208f21f3 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:36.266164 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a3e501-6b20-4781-ba3a-3967208f21f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:36.266440 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a3e501-6b20-4781-ba3a-3967208f21f3 None admin] PATH_INFO: `/v3/services` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:36.267077 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a3e501-6b20-4781-ba3a-3967208f21f3 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:36.267382 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a3e501-6b20-4781-ba3a-3967208f21f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:36.268824 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a3e501-6b20-4781-ba3a-3967208f21f3 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:36.279111 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 465/935] 10.222.0.50 () {56 vars in 1126 bytes} [Mon Sep 5 12:04:36 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:04:36.280612 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfd8017-6028-4dcd-89dd-fd49ab63115a None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:36.388506 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfd8017-6028-4dcd-89dd-fd49ab63115a None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:36.431161 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9642e33a-1f2f-4731-aeb1-573dfdb56796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:36.431161 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9642e33a-1f2f-4731-aeb1-573dfdb56796 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:36.431477 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9642e33a-1f2f-4731-aeb1-573dfdb56796 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:36.431811 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9642e33a-1f2f-4731-aeb1-573dfdb56796 None admin] PATH_INFO: `/v3/services` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:36.432988 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9642e33a-1f2f-4731-aeb1-573dfdb56796 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:36.433301 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9642e33a-1f2f-4731-aeb1-573dfdb56796 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:36.434784 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9642e33a-1f2f-4731-aeb1-573dfdb56796 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:36.445088 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 471/936] 10.222.0.50 () {56 vars in 1126 bytes} [Mon Sep 5 12:04:36 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:04:36.446528 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a3e501-6b20-4781-ba3a-3967208f21f3 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:36.552570 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:36.560625 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9488f17a-dbda-47e3-a6f2-1458d45b7c38 None None] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:36.561194 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9488f17a-dbda-47e3-a6f2-1458d45b7c38 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:36.561755 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9488f17a-dbda-47e3-a6f2-1458d45b7c38 None None] PATH_INFO: `/` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:36.562624 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a3e501-6b20-4781-ba3a-3967208f21f3 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:36.563901 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 472/937] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:04:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 12:04:36.570844 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbc5302-6f4f-430d-aebf-d9025df9a9ef None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:36.571429 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbc5302-6f4f-430d-aebf-d9025df9a9ef None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:36.571816 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbc5302-6f4f-430d-aebf-d9025df9a9ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:36.600935 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d20abc-884a-4050-840e-e078be67b1bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:36.601550 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d20abc-884a-4050-840e-e078be67b1bf None admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:36.601873 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d20abc-884a-4050-840e-e078be67b1bf None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:36.602141 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d20abc-884a-4050-840e-e078be67b1bf None admin] PATH_INFO: `/v3/endpoints` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:36.602372 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-2bbc5302-6f4f-430d-aebf-d9025df9a9ef None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:04:36.602830 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d20abc-884a-4050-840e-e078be67b1bf None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:36.604237 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-2bbc5302-6f4f-430d-aebf-d9025df9a9ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:04:36.604829 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d20abc-884a-4050-840e-e078be67b1bf None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:36.633966 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 466/938] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 5 12:04:36 2022] POST /identity/v3/endpoints => generated 347 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:04:36.659521 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:36.706961 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 473/939] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:04:36 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 12:04:36.993263 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d20abc-884a-4050-840e-e078be67b1bf None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:37.045159 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f64b4e-a9d0-437c-bb53-1451613e44de None None] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:37.045672 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f64b4e-a9d0-437c-bb53-1451613e44de None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:37.045672 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f64b4e-a9d0-437c-bb53-1451613e44de None None] PATH_INFO: `/` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:37.047281 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 474/940] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:04:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 12:04:37.052236 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e02d8be-579a-4e75-9bad-cde1a3916627 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:37.052518 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e02d8be-579a-4e75-9bad-cde1a3916627 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:37.052794 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e02d8be-579a-4e75-9bad-cde1a3916627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:37.074196 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-8e02d8be-579a-4e75-9bad-cde1a3916627 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:04:37.076371 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-8e02d8be-579a-4e75-9bad-cde1a3916627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:04:37.122562 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d20abc-884a-4050-840e-e078be67b1bf None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:37.168945 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 475/941] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:04:37 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 05 12:04:37.188888 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4842d509-f858-4f12-8c8d-c4f9cc6beb48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:37.189916 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4842d509-f858-4f12-8c8d-c4f9cc6beb48 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:37.190390 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4842d509-f858-4f12-8c8d-c4f9cc6beb48 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:37.190858 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4842d509-f858-4f12-8c8d-c4f9cc6beb48 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:37.191629 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4842d509-f858-4f12-8c8d-c4f9cc6beb48 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:37.193640 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4842d509-f858-4f12-8c8d-c4f9cc6beb48 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:37.206961 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-4842d509-f858-4f12-8c8d-c4f9cc6beb48 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 05 12:04:37.206961 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:37.206961 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 05 12:04:37.206961 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 05 12:04:37.206961 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 05 12:04:37.206961 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 05 12:04:37.206961 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 05 12:04:37.206961 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 12:04:37.206961 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 05 12:04:37.206961 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:04:37.206961 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 12:04:37.206961 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:04:37.206961 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:37.206961 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:04:37.206961 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:04:37.206961 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:04:37.206961 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:04:37.208080 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:04:37.208080 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:04:37.208080 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:04:37.208080 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:04:37.208080 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:04:37.208080 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:04:37.208080 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 05 12:04:37.208080 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 05 12:04:37.208080 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 05 12:04:37.208080 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 05 12:04:37.208080 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:04:37.208080 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:04:37.208080 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:04:37.208080 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:04:37.208080 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:04:37.208080 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:04:37.209039 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:04:37.209039 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:04:37.209039 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:04:37.209039 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:04:37.209039 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:04:37.209039 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:04:37.209039 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:04:37.209039 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:04:37.209039 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:04:37.209039 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:04:37.209039 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 05 12:04:37.209039 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 12:04:37.209039 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 05 12:04:37.209039 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:04:37.212058 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 467/942] 10.222.0.50 () {56 vars in 1126 bytes} [Mon Sep 5 12:04:36 2022] GET /identity/v3/services/object-store => generated 93 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:04:37.219207 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e02d8be-579a-4e75-9bad-cde1a3916627 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:37.388793 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:37.394069 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e02d8be-579a-4e75-9bad-cde1a3916627 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:37.429989 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e39cde-d265-40e4-a1d5-fcb4d9de2591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:37.430600 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e39cde-d265-40e4-a1d5-fcb4d9de2591 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:37.430874 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e39cde-d265-40e4-a1d5-fcb4d9de2591 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:37.431141 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e39cde-d265-40e4-a1d5-fcb4d9de2591 None admin] PATH_INFO: `/v3/services` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:37.432290 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e39cde-d265-40e4-a1d5-fcb4d9de2591 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:37.432591 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e39cde-d265-40e4-a1d5-fcb4d9de2591 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:37.433978 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e39cde-d265-40e4-a1d5-fcb4d9de2591 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:37.439222 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 476/943] 10.222.0.50 () {56 vars in 1122 bytes} [Mon Sep 5 12:04:37 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:04:37.448665 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4842d509-f858-4f12-8c8d-c4f9cc6beb48 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:37.471874 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:37.510870 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e39cde-d265-40e4-a1d5-fcb4d9de2591 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:37.608730 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4842d509-f858-4f12-8c8d-c4f9cc6beb48 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:37.641948 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e39cde-d265-40e4-a1d5-fcb4d9de2591 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:37.649560 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7f4e79-9e04-4a57-bbc7-ed168753448d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:37.650465 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7f4e79-9e04-4a57-bbc7-ed168753448d None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:37.650967 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7f4e79-9e04-4a57-bbc7-ed168753448d None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:37.651450 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7f4e79-9e04-4a57-bbc7-ed168753448d None admin] PATH_INFO: `/v3/services` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:37.652324 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7f4e79-9e04-4a57-bbc7-ed168753448d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:37.652830 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7f4e79-9e04-4a57-bbc7-ed168753448d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:37.654553 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7f4e79-9e04-4a57-bbc7-ed168753448d None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:37.665974 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 468/944] 10.222.0.50 () {56 vars in 1122 bytes} [Mon Sep 5 12:04:37 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:04:37.668044 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7f4e79-9e04-4a57-bbc7-ed168753448d None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:37.699634 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d2e0d8-8bd2-4a00-96ea-c16fccd033a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:37.701238 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d2e0d8-8bd2-4a00-96ea-c16fccd033a8 None admin] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:37.701719 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d2e0d8-8bd2-4a00-96ea-c16fccd033a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:37.702201 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d2e0d8-8bd2-4a00-96ea-c16fccd033a8 None admin] PATH_INFO: `/v3/projects` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:37.703739 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d2e0d8-8bd2-4a00-96ea-c16fccd033a8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:37.706178 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d2e0d8-8bd2-4a00-96ea-c16fccd033a8 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:37.712753 dv-cinder-855189-1-smb devstack@keystone.service[81719]: WARNING keystone.server.flask.common [None req-41d2e0d8-8bd2-4a00-96ea-c16fccd033a8 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 05 12:04:37.753289 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.sql.core [None req-41d2e0d8-8bd2-4a00-96ea-c16fccd033a8 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 05 12:04:37.753289 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 05 12:04:37.753289 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [parameters: {'id': '37ebf50db26e4e51a6ded4a38d38f9d6', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 05 12:04:37.753289 dv-cinder-855189-1-smb devstack@keystone.service[81719]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81719) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 05 12:04:37.774725 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application [None req-41d2e0d8-8bd2-4a00-96ea-c16fccd033a8 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 37ebf50db26e4e51a6ded4a38d38f9d6.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 37ebf50db26e4e51a6ded4a38d38f9d6. Sep 05 12:04:37.774725 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:37.774725 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 05 12:04:37.774725 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 05 12:04:37.774725 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 05 12:04:37.774725 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 05 12:04:37.774725 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 05 12:04:37.774725 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application result = self._query(query) Sep 05 12:04:37.774725 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 05 12:04:37.774725 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application conn.query(q) Sep 05 12:04:37.774725 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 05 12:04:37.774725 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 05 12:04:37.774725 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 05 12:04:37.775846 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application result.read() Sep 05 12:04:37.775846 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 05 12:04:37.775846 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 05 12:04:37.775846 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 05 12:04:37.775846 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 05 12:04:37.775846 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 05 12:04:37.775846 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 05 12:04:37.775846 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 05 12:04:37.775846 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 05 12:04:37.775846 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 05 12:04:37.775846 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:04:37.775846 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 05 12:04:37.775846 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:04:37.775846 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:37.775846 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 05 12:04:37.775846 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 05 12:04:37.775846 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 05 12:04:37.775846 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 05 12:04:37.776860 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 05 12:04:37.776860 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application next(self.gen) Sep 05 12:04:37.776860 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 05 12:04:37.776860 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application yield resource Sep 05 12:04:37.776860 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 05 12:04:37.776860 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application next(self.gen) Sep 05 12:04:37.776860 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 05 12:04:37.776860 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application self.session.rollback() Sep 05 12:04:37.776860 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 05 12:04:37.776860 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application self.force_reraise() Sep 05 12:04:37.776860 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 05 12:04:37.776860 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise self.value Sep 05 12:04:37.776860 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 05 12:04:37.776860 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 05 12:04:37.776860 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 05 12:04:37.776860 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application session.commit() Sep 05 12:04:37.776860 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 05 12:04:37.777945 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 05 12:04:37.777945 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 05 12:04:37.777945 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application self._prepare_impl() Sep 05 12:04:37.777945 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 05 12:04:37.777945 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application self.session.flush() Sep 05 12:04:37.777945 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 05 12:04:37.777945 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application self._flush(objects) Sep 05 12:04:37.777945 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 05 12:04:37.777945 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 05 12:04:37.777945 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 05 12:04:37.777945 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application compat.raise_( Sep 05 12:04:37.777945 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 05 12:04:37.777945 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception Sep 05 12:04:37.777945 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 05 12:04:37.777945 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application flush_context.execute() Sep 05 12:04:37.777945 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 05 12:04:37.777945 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application rec.execute(self) Sep 05 12:04:37.778892 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 05 12:04:37.778892 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 05 12:04:37.778892 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 05 12:04:37.778892 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 05 12:04:37.778892 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 05 12:04:37.778892 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 05 12:04:37.778892 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 05 12:04:37.778892 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 05 12:04:37.778892 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 05 12:04:37.778892 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 05 12:04:37.778892 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 05 12:04:37.778892 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 05 12:04:37.778892 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 05 12:04:37.778892 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 05 12:04:37.778892 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 05 12:04:37.779706 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 05 12:04:37.779706 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 05 12:04:37.779706 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception Sep 05 12:04:37.779706 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 05 12:04:37.779706 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 05 12:04:37.779706 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 05 12:04:37.779706 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 05 12:04:37.779706 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 05 12:04:37.779706 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application result = self._query(query) Sep 05 12:04:37.779706 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 05 12:04:37.779706 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application conn.query(q) Sep 05 12:04:37.779706 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 05 12:04:37.779706 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 05 12:04:37.779706 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 05 12:04:37.779706 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application result.read() Sep 05 12:04:37.779706 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 05 12:04:37.779706 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 05 12:04:37.780615 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 05 12:04:37.780615 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 05 12:04:37.780615 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 05 12:04:37.780615 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 05 12:04:37.780615 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 05 12:04:37.780615 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 05 12:04:37.780615 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 05 12:04:37.780615 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 05 12:04:37.780615 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application [parameters: {'id': '37ebf50db26e4e51a6ded4a38d38f9d6', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 05 12:04:37.780615 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 05 12:04:37.780615 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:04:37.780615 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 12:04:37.780615 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:04:37.780615 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:37.780615 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 05 12:04:37.781465 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 05 12:04:37.781465 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 05 12:04:37.781465 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 05 12:04:37.781465 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 05 12:04:37.781465 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:04:37.781465 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 12:04:37.781465 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:04:37.781465 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:37.781465 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:04:37.781465 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:04:37.781465 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:04:37.781465 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:04:37.781465 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:04:37.781465 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:04:37.781465 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:04:37.781465 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:04:37.781465 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:04:37.782392 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:04:37.782392 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 05 12:04:37.782392 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 05 12:04:37.782392 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:04:37.782392 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:04:37.782392 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 05 12:04:37.782392 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 05 12:04:37.782392 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 37ebf50db26e4e51a6ded4a38d38f9d6. Sep 05 12:04:37.782392 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:04:37.784322 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 477/945] 10.222.0.50 () {60 vars in 1140 bytes} [Mon Sep 5 12:04:37 2022] POST /identity/v3/projects => generated 262 bytes in 267 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:04:37.785934 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:37.792261 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d2e0d8-8bd2-4a00-96ea-c16fccd033a8 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:37.813746 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:37.821431 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7f4e79-9e04-4a57-bbc7-ed168753448d None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:37.864869 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb302f6-c972-4d3b-a318-8a1f057cfa44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:37.865766 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb302f6-c972-4d3b-a318-8a1f057cfa44 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:37.866212 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb302f6-c972-4d3b-a318-8a1f057cfa44 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:37.866962 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb302f6-c972-4d3b-a318-8a1f057cfa44 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:37.868119 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb302f6-c972-4d3b-a318-8a1f057cfa44 None admin] RBAC: Adding query filter params (interface=public, service_id=cdc3de5518ce46e8ba73e5c416e67fe7, region_id=RegionOne) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:37.868594 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb302f6-c972-4d3b-a318-8a1f057cfa44 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:37.870911 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb302f6-c972-4d3b-a318-8a1f057cfa44 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:37.882107 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 469/946] 10.222.0.50 () {56 vars in 1251 bytes} [Mon Sep 5 12:04:37 2022] GET /identity/v3/endpoints?service_id=cdc3de5518ce46e8ba73e5c416e67fe7&interface=public®ion_id=RegionOne => generated 194 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:04:37.883309 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb302f6-c972-4d3b-a318-8a1f057cfa44 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:37.914562 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d2e0d8-8bd2-4a00-96ea-c16fccd033a8 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:37.954082 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db51b9f6-77c6-45e9-9e96-166186a342c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:37.954732 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db51b9f6-77c6-45e9-9e96-166186a342c9 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:37.955006 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db51b9f6-77c6-45e9-9e96-166186a342c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:37.955276 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db51b9f6-77c6-45e9-9e96-166186a342c9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:37.963122 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db51b9f6-77c6-45e9-9e96-166186a342c9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:37.964789 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db51b9f6-77c6-45e9-9e96-166186a342c9 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:37.977446 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application [None req-db51b9f6-77c6-45e9-9e96-166186a342c9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:04:37.977446 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:37.977446 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:04:37.977446 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:04:37.977446 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:04:37.977446 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:04:37.977446 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:04:37.977446 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:04:37.977446 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:04:37.977446 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:04:37.977446 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:04:37.977446 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:04:37.977446 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 12:04:37.977446 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 12:04:37.977446 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 12:04:37.979158 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 12:04:37.979158 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:04:37.979158 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:04:37.979158 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:04:37.979158 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:04:37.979158 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:04:37.979158 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:04:37.979158 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:04:37.979158 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application with Lock( Sep 05 12:04:37.979158 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:04:37.979158 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:04:37.979158 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:04:37.979158 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:04:37.979158 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:04:37.979158 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:04:37.979158 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:04:37.979158 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:04:37.980070 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 12:04:37.980070 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 12:04:37.980070 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 12:04:37.980070 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 12:04:37.980070 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 12:04:37.980070 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 12:04:37.980070 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:04:37.980070 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:04:37.984553 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 478/947] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Sep 5 12:04:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:04:37.985555 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db51b9f6-77c6-45e9-9e96-166186a342c9 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:38.005045 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb302f6-c972-4d3b-a318-8a1f057cfa44 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:38.046160 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb02af97-1c4f-476a-bce4-209ec649cc9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:38.047222 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb02af97-1c4f-476a-bce4-209ec649cc9d None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:38.047659 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb02af97-1c4f-476a-bce4-209ec649cc9d None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:38.048108 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb02af97-1c4f-476a-bce4-209ec649cc9d None admin] PATH_INFO: `/v3/services` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:38.048930 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb02af97-1c4f-476a-bce4-209ec649cc9d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:38.050793 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb02af97-1c4f-476a-bce4-209ec649cc9d None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:38.058460 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 470/948] 10.222.0.50 () {56 vars in 1087 bytes} [Mon Sep 5 12:04:37 2022] GET /identity/v3/services => generated 1497 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:04:38.075882 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:38.087684 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45f0d4b-cc48-4f07-9f65-9731a633973d None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:38.088786 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45f0d4b-cc48-4f07-9f65-9731a633973d None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:38.089474 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45f0d4b-cc48-4f07-9f65-9731a633973d None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:38.094076 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 471/949] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:04:38 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:04:38.100091 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff620e47-dae5-451b-99fe-3ba3adc4c57d None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:38.100518 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff620e47-dae5-451b-99fe-3ba3adc4c57d None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:38.100919 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff620e47-dae5-451b-99fe-3ba3adc4c57d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:38.108473 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:38.118140 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db51b9f6-77c6-45e9-9e96-166186a342c9 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:38.124948 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-ff620e47-dae5-451b-99fe-3ba3adc4c57d None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:04:38.126378 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-ff620e47-dae5-451b-99fe-3ba3adc4c57d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:04:38.186384 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04ba2b9-48c4-4b76-b194-b8fb56a7e175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:38.187504 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04ba2b9-48c4-4b76-b194-b8fb56a7e175 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:38.187941 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04ba2b9-48c4-4b76-b194-b8fb56a7e175 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:38.188396 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04ba2b9-48c4-4b76-b194-b8fb56a7e175 None admin] PATH_INFO: `/v3/projects` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:38.189664 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04ba2b9-48c4-4b76-b194-b8fb56a7e175 None admin] RBAC: Adding query filter params (name=service) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:38.190361 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04ba2b9-48c4-4b76-b194-b8fb56a7e175 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:38.193545 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04ba2b9-48c4-4b76-b194-b8fb56a7e175 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:38.217080 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 472/950] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:04:38 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 12:04:38.229758 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 479/951] 10.222.0.50 () {56 vars in 1112 bytes} [Mon Sep 5 12:04:37 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:04:38.500472 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff620e47-dae5-451b-99fe-3ba3adc4c57d None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:38.652929 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff620e47-dae5-451b-99fe-3ba3adc4c57d None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:38.678432 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a52473-20e9-4a5d-9273-da5f3a9a5774 None None] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:38.678801 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a52473-20e9-4a5d-9273-da5f3a9a5774 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:38.678999 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a52473-20e9-4a5d-9273-da5f3a9a5774 None None] PATH_INFO: `/` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:38.684703 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 480/952] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:04:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:04:38.686474 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3ad5d7-041c-48a6-b721-f7a78f50fb40 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:38.686763 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3ad5d7-041c-48a6-b721-f7a78f50fb40 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:38.687037 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3ad5d7-041c-48a6-b721-f7a78f50fb40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:38.707935 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:38.711482 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-ff3ad5d7-041c-48a6-b721-f7a78f50fb40 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:04:38.713836 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6af9145-25e1-451f-aca9-e04e02c0d5a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:38.714445 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-ff3ad5d7-041c-48a6-b721-f7a78f50fb40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:04:38.714733 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6af9145-25e1-451f-aca9-e04e02c0d5a5 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:38.715201 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6af9145-25e1-451f-aca9-e04e02c0d5a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:38.715531 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6af9145-25e1-451f-aca9-e04e02c0d5a5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:38.730398 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6af9145-25e1-451f-aca9-e04e02c0d5a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:04:38.736627 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-f6af9145-25e1-451f-aca9-e04e02c0d5a5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 05 12:04:38.736627 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:38.736627 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:04:38.736627 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:04:38.736627 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:04:38.736627 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:04:38.736627 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:04:38.736627 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:04:38.736627 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:04:38.736627 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:04:38.736627 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:04:38.736627 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:04:38.736627 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:04:38.736627 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:04:38.736627 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:04:38.736627 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:04:38.738774 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:04:38.738774 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:04:38.738774 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:04:38.738774 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:04:38.738774 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:04:38.738774 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:04:38.738774 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:04:38.738774 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:04:38.738774 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:04:38.738774 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:04:38.738774 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:04:38.738774 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:04:38.738774 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:04:38.738774 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:04:38.738774 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:04:38.738774 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:04:38.739937 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:04:38.739937 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:04:38.739937 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:04:38.739937 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:04:38.739937 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:04:38.739937 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:04:38.739937 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:04:38.739937 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:04:38.739937 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:04:38.739937 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:04:38.739937 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 05 12:04:38.739937 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:04:38.739937 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 473/953] 10.222.0.50 () {56 vars in 1120 bytes} [Mon Sep 5 12:04:38 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:04:38.747556 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6af9145-25e1-451f-aca9-e04e02c0d5a5 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:38.820114 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 481/954] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:04:38 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 05 12:04:38.954256 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6af9145-25e1-451f-aca9-e04e02c0d5a5 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:39.023249 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7a7eca-5e9a-4d50-a1c0-9f1e74a7cc34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:39.024412 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7a7eca-5e9a-4d50-a1c0-9f1e74a7cc34 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:39.025003 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7a7eca-5e9a-4d50-a1c0-9f1e74a7cc34 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:39.025620 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7a7eca-5e9a-4d50-a1c0-9f1e74a7cc34 None admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:39.026947 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7a7eca-5e9a-4d50-a1c0-9f1e74a7cc34 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:39.027616 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7a7eca-5e9a-4d50-a1c0-9f1e74a7cc34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:39.030345 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7a7eca-5e9a-4d50-a1c0-9f1e74a7cc34 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:39.046945 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 474/955] 10.222.0.50 () {56 vars in 1115 bytes} [Mon Sep 5 12:04:38 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:04:39.054049 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3ad5d7-041c-48a6-b721-f7a78f50fb40 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:39.143781 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:39.208762 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3ad5d7-041c-48a6-b721-f7a78f50fb40 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:39.238716 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7a7eca-5e9a-4d50-a1c0-9f1e74a7cc34 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:39.268921 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a16f49-363e-4bfb-9dc5-49d233f711fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:39.270004 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a16f49-363e-4bfb-9dc5-49d233f711fa None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:39.270537 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a16f49-363e-4bfb-9dc5-49d233f711fa None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:39.271022 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a16f49-363e-4bfb-9dc5-49d233f711fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:39.289906 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a16f49-363e-4bfb-9dc5-49d233f711fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:39.293207 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a16f49-363e-4bfb-9dc5-49d233f711fa None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:39.315810 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:39.321637 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application [None req-08a16f49-363e-4bfb-9dc5-49d233f711fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:04:39.321637 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:39.321637 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:04:39.321637 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:04:39.321637 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:04:39.321637 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:04:39.321637 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:04:39.321637 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:04:39.321637 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:04:39.321637 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:04:39.321637 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:04:39.321637 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:04:39.321637 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:04:39.321637 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:04:39.321637 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:04:39.321637 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:04:39.323018 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:04:39.323018 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:04:39.323018 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:04:39.323018 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:04:39.323018 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:04:39.323018 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:04:39.323018 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:04:39.323018 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application with Lock( Sep 05 12:04:39.323018 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:04:39.323018 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:04:39.323018 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:04:39.323018 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:04:39.323018 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:04:39.323018 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:04:39.323018 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:04:39.323018 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:04:39.323018 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:04:39.324046 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:04:39.324046 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:04:39.324046 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:04:39.324236 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 482/956] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 5 12:04:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:04:39.330523 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a16f49-363e-4bfb-9dc5-49d233f711fa None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:39.402889 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7a7eca-5e9a-4d50-a1c0-9f1e74a7cc34 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:39.443607 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a16f49-363e-4bfb-9dc5-49d233f711fa None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:39.463909 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:39.465083 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df1c786-3c0b-4101-9770-c90a70490edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:39.466274 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df1c786-3c0b-4101-9770-c90a70490edf None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:39.466927 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df1c786-3c0b-4101-9770-c90a70490edf None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:39.467458 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df1c786-3c0b-4101-9770-c90a70490edf None admin] PATH_INFO: `/v3/services/compute` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:39.468665 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df1c786-3c0b-4101-9770-c90a70490edf None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:39.471257 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df1c786-3c0b-4101-9770-c90a70490edf None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:39.485750 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11966d7c-c2a3-4f50-abe0-8a0dc680af50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:39.486627 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11966d7c-c2a3-4f50-abe0-8a0dc680af50 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:39.487068 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11966d7c-c2a3-4f50-abe0-8a0dc680af50 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:39.487492 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11966d7c-c2a3-4f50-abe0-8a0dc680af50 None admin] PATH_INFO: `/v3/domains` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:39.488293 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11966d7c-c2a3-4f50-abe0-8a0dc680af50 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:39.488750 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11966d7c-c2a3-4f50-abe0-8a0dc680af50 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:39.490288 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11966d7c-c2a3-4f50-abe0-8a0dc680af50 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:39.491688 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-8df1c786-3c0b-4101-9770-c90a70490edf None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 05 12:04:39.491688 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:39.491688 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 05 12:04:39.491688 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 05 12:04:39.491688 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 05 12:04:39.491688 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 05 12:04:39.491688 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 05 12:04:39.491688 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 12:04:39.491688 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 05 12:04:39.491688 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:04:39.491688 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 12:04:39.491688 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:04:39.491688 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:39.491688 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:04:39.491688 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:04:39.491688 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:04:39.491688 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:04:39.493007 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:04:39.493007 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:04:39.493007 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:04:39.493007 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:04:39.493007 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:04:39.493007 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:04:39.493007 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 05 12:04:39.493007 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 05 12:04:39.493007 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 05 12:04:39.493007 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 05 12:04:39.493007 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:04:39.493007 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:04:39.493007 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:04:39.493007 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:04:39.493007 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:04:39.493007 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:04:39.494001 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:04:39.494001 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:04:39.494001 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:04:39.494001 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:04:39.494001 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:04:39.494001 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:04:39.494001 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:04:39.494001 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:04:39.494001 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:04:39.494001 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:04:39.494001 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 05 12:04:39.494001 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 12:04:39.494001 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 05 12:04:39.494001 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:04:39.502703 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 475/957] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Sep 5 12:04:39 2022] GET /identity/v3/services/compute => generated 88 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:04:39.505971 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df1c786-3c0b-4101-9770-c90a70490edf None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:39.520929 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 483/958] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 5 12:04:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:04:39.523265 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11966d7c-c2a3-4f50-abe0-8a0dc680af50 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:39.634942 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11966d7c-c2a3-4f50-abe0-8a0dc680af50 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:39.674138 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4424ddc-956c-4c68-a2a4-8f922c86eb59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:39.675411 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4424ddc-956c-4c68-a2a4-8f922c86eb59 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:39.675903 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4424ddc-956c-4c68-a2a4-8f922c86eb59 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:39.676373 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4424ddc-956c-4c68-a2a4-8f922c86eb59 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:39.685253 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4424ddc-956c-4c68-a2a4-8f922c86eb59 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:39.687191 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4424ddc-956c-4c68-a2a4-8f922c86eb59 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:39.702053 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application [None req-e4424ddc-956c-4c68-a2a4-8f922c86eb59 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 05 12:04:39.702053 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:39.702053 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:04:39.702053 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:04:39.702053 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:04:39.702053 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:04:39.702053 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:04:39.702053 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:04:39.702053 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:04:39.702053 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:04:39.702053 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:04:39.702053 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:04:39.702053 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 12:04:39.702053 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 12:04:39.702053 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 12:04:39.702053 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 12:04:39.703077 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:04:39.703077 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:04:39.703077 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 12:04:39.703077 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:04:39.703077 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 12:04:39.703077 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:04:39.703077 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:04:39.703077 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:04:39.703077 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:04:39.703077 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:04:39.703077 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:04:39.703077 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application with Lock( Sep 05 12:04:39.703077 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:04:39.703077 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:04:39.703077 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:04:39.703077 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:04:39.703077 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:04:39.703077 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:04:39.704079 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:04:39.704079 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:04:39.704079 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 12:04:39.704079 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 12:04:39.704079 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 12:04:39.704079 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 12:04:39.704079 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 12:04:39.704079 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 12:04:39.704079 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 05 12:04:39.704079 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:04:39.704662 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df1c786-3c0b-4101-9770-c90a70490edf None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:39.711606 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 484/959] 10.222.0.50 () {56 vars in 1117 bytes} [Mon Sep 5 12:04:39 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 12:04:39.713499 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4424ddc-956c-4c68-a2a4-8f922c86eb59 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:39.739142 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:39.768272 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:39.772378 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fe25f2-5e88-4de7-9520-2ced14cafc88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:39.774076 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fe25f2-5e88-4de7-9520-2ced14cafc88 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:39.775055 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fe25f2-5e88-4de7-9520-2ced14cafc88 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:39.776021 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fe25f2-5e88-4de7-9520-2ced14cafc88 None admin] PATH_INFO: `/v3/services` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:39.778825 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fe25f2-5e88-4de7-9520-2ced14cafc88 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:39.779612 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fe25f2-5e88-4de7-9520-2ced14cafc88 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:39.782426 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fe25f2-5e88-4de7-9520-2ced14cafc88 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:39.794487 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 476/960] 10.222.0.50 () {56 vars in 1112 bytes} [Mon Sep 5 12:04:39 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:04:39.801218 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fe25f2-5e88-4de7-9520-2ced14cafc88 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:39.856016 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4424ddc-956c-4c68-a2a4-8f922c86eb59 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:39.895594 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb25b8b-2367-4d32-9c9b-b185a6b19efd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:39.895851 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb25b8b-2367-4d32-9c9b-b185a6b19efd None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:39.896174 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb25b8b-2367-4d32-9c9b-b185a6b19efd None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:39.896358 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb25b8b-2367-4d32-9c9b-b185a6b19efd None admin] PATH_INFO: `/v3/users` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:39.897133 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb25b8b-2367-4d32-9c9b-b185a6b19efd None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:39.897438 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb25b8b-2367-4d32-9c9b-b185a6b19efd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:39.899135 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb25b8b-2367-4d32-9c9b-b185a6b19efd None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:39.926898 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 485/961] 10.222.0.50 () {56 vars in 1149 bytes} [Mon Sep 5 12:04:39 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:04:39.929521 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb25b8b-2367-4d32-9c9b-b185a6b19efd None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:39.981670 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fe25f2-5e88-4de7-9520-2ced14cafc88 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:40.034594 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14aeec0-d055-46bd-90cc-e31bd954030f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:40.036111 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14aeec0-d055-46bd-90cc-e31bd954030f None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:40.036880 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14aeec0-d055-46bd-90cc-e31bd954030f None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:40.037837 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14aeec0-d055-46bd-90cc-e31bd954030f None admin] PATH_INFO: `/v3/services` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:40.039307 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14aeec0-d055-46bd-90cc-e31bd954030f None admin] RBAC: Adding query filter params (type=compute) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:40.040286 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14aeec0-d055-46bd-90cc-e31bd954030f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:40.043316 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14aeec0-d055-46bd-90cc-e31bd954030f None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:40.053448 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 477/962] 10.222.0.50 () {56 vars in 1112 bytes} [Mon Sep 5 12:04:39 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:04:40.090810 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:40.097501 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb25b8b-2367-4d32-9c9b-b185a6b19efd None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:40.138291 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc46440-d5cb-42a6-9046-399ea9d32768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:40.138921 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc46440-d5cb-42a6-9046-399ea9d32768 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:40.139261 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc46440-d5cb-42a6-9046-399ea9d32768 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:40.139532 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc46440-d5cb-42a6-9046-399ea9d32768 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:40.185894 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7c5e6d-07fe-4d3d-a470-7d31e9b4d489 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:40.186881 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7c5e6d-07fe-4d3d-a470-7d31e9b4d489 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:40.187638 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7c5e6d-07fe-4d3d-a470-7d31e9b4d489 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:40.190970 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 478/963] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:04:40 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:04:40.196940 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d213325b-8ca5-4124-9df0-509e96d857cf None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:40.196940 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d213325b-8ca5-4124-9df0-509e96d857cf None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:40.197881 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d213325b-8ca5-4124-9df0-509e96d857cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:40.221236 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc46440-d5cb-42a6-9046-399ea9d32768 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:40.222723 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc46440-d5cb-42a6-9046-399ea9d32768 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:40.223851 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-d213325b-8ca5-4124-9df0-509e96d857cf None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:04:40.226791 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-d213325b-8ca5-4124-9df0-509e96d857cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:04:40.320689 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:40.355461 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 479/964] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:04:40 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 12:04:40.377310 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:40.384227 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 486/965] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Sep 5 12:04:39 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 05 12:04:40.393385 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d213325b-8ca5-4124-9df0-509e96d857cf None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:40.580678 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d213325b-8ca5-4124-9df0-509e96d857cf None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:40.633340 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc46440-d5cb-42a6-9046-399ea9d32768 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:40.647022 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff8d943-7ab4-4ffd-b7f0-eae8ec9945d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:40.647022 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff8d943-7ab4-4ffd-b7f0-eae8ec9945d9 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:40.647022 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff8d943-7ab4-4ffd-b7f0-eae8ec9945d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:40.647022 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff8d943-7ab4-4ffd-b7f0-eae8ec9945d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:40.665479 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff8d943-7ab4-4ffd-b7f0-eae8ec9945d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:40.668761 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff8d943-7ab4-4ffd-b7f0-eae8ec9945d9 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:40.698870 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-8ff8d943-7ab4-4ffd-b7f0-eae8ec9945d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:04:40.698870 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:40.698870 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:04:40.698870 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:04:40.698870 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:04:40.698870 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:04:40.698870 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:04:40.698870 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:04:40.698870 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:04:40.698870 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:04:40.698870 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:04:40.698870 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:04:40.698870 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:04:40.698870 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:04:40.698870 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:04:40.698870 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:04:40.699948 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:04:40.699948 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:04:40.699948 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:04:40.699948 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:04:40.699948 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:04:40.699948 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:04:40.699948 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:04:40.699948 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:04:40.699948 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:04:40.699948 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:04:40.699948 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:04:40.699948 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:04:40.699948 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:04:40.699948 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:04:40.699948 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:04:40.699948 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:04:40.699948 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:04:40.700914 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:04:40.700914 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:04:40.700914 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:04:40.701528 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 480/966] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 5 12:04:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 12:04:40.711153 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff8d943-7ab4-4ffd-b7f0-eae8ec9945d9 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:40.762157 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:40.796917 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc46440-d5cb-42a6-9046-399ea9d32768 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:40.853240 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e8cfaf-ec3e-4bb9-8f9a-f67713c1b1e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:40.855322 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e8cfaf-ec3e-4bb9-8f9a-f67713c1b1e6 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:40.856244 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e8cfaf-ec3e-4bb9-8f9a-f67713c1b1e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:40.857351 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e8cfaf-ec3e-4bb9-8f9a-f67713c1b1e6 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:40.858623 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e8cfaf-ec3e-4bb9-8f9a-f67713c1b1e6 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:40.867345 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e8cfaf-ec3e-4bb9-8f9a-f67713c1b1e6 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:40.878232 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application [None req-70e8cfaf-ec3e-4bb9-8f9a-f67713c1b1e6 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 05 12:04:40.878232 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:40.878232 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 05 12:04:40.878232 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 05 12:04:40.878232 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 05 12:04:40.878232 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 05 12:04:40.878232 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 05 12:04:40.878232 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 12:04:40.878232 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 05 12:04:40.878232 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:04:40.878232 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 12:04:40.878232 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:04:40.878232 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:40.878232 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:04:40.878232 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:04:40.878232 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:04:40.878232 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:04:40.880458 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:04:40.880458 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:04:40.880458 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:04:40.880458 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:04:40.880458 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:04:40.880458 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:04:40.880458 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 05 12:04:40.880458 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 05 12:04:40.880458 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 05 12:04:40.880458 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 05 12:04:40.880458 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:04:40.880458 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:04:40.880458 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:04:40.880458 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:04:40.880458 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:04:40.880458 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:04:40.883014 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:04:40.883014 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application with Lock( Sep 05 12:04:40.883014 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:04:40.883014 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:04:40.883014 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:04:40.883014 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:04:40.883014 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:04:40.883014 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:04:40.883014 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:04:40.883014 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:04:40.883014 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 05 12:04:40.883014 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 12:04:40.883014 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 05 12:04:40.883014 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:04:40.886050 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 487/967] 10.222.0.50 () {56 vars in 1126 bytes} [Mon Sep 5 12:04:40 2022] GET /identity/v3/services/object-store => generated 93 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 12:04:40.887056 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e8cfaf-ec3e-4bb9-8f9a-f67713c1b1e6 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:40.902445 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff8d943-7ab4-4ffd-b7f0-eae8ec9945d9 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:40.956557 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:40.977356 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0422f8a0-928f-4306-a2bf-76f286df48db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:40.979482 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0422f8a0-928f-4306-a2bf-76f286df48db None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:40.980399 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0422f8a0-928f-4306-a2bf-76f286df48db None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:40.981185 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0422f8a0-928f-4306-a2bf-76f286df48db None admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:40.983565 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0422f8a0-928f-4306-a2bf-76f286df48db None admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:40.984567 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0422f8a0-928f-4306-a2bf-76f286df48db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:40.987626 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0422f8a0-928f-4306-a2bf-76f286df48db None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:41.005805 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e8cfaf-ec3e-4bb9-8f9a-f67713c1b1e6 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:41.013832 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 481/968] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 5 12:04:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:04:41.025117 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0422f8a0-928f-4306-a2bf-76f286df48db None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:41.045148 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfd557d-f8fb-449f-b528-4f284e86f0e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:41.045765 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd557d-f8fb-449f-b528-4f284e86f0e6 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:41.046052 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd557d-f8fb-449f-b528-4f284e86f0e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:41.047238 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd557d-f8fb-449f-b528-4f284e86f0e6 None admin] PATH_INFO: `/v3/services` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:41.047897 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfd557d-f8fb-449f-b528-4f284e86f0e6 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:41.048204 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfd557d-f8fb-449f-b528-4f284e86f0e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:41.049747 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfd557d-f8fb-449f-b528-4f284e86f0e6 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:41.060113 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 488/969] 10.222.0.50 () {56 vars in 1122 bytes} [Mon Sep 5 12:04:40 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:04:41.061328 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfd557d-f8fb-449f-b528-4f284e86f0e6 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:41.163866 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:41.195673 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0422f8a0-928f-4306-a2bf-76f286df48db None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:41.242517 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfd557d-f8fb-449f-b528-4f284e86f0e6 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:41.243333 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c808c9-4e0d-4f18-94f3-1b709f3d1740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:41.243995 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c808c9-4e0d-4f18-94f3-1b709f3d1740 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:41.244324 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c808c9-4e0d-4f18-94f3-1b709f3d1740 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:41.244601 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c808c9-4e0d-4f18-94f3-1b709f3d1740 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:41.252764 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c808c9-4e0d-4f18-94f3-1b709f3d1740 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:41.254310 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c808c9-4e0d-4f18-94f3-1b709f3d1740 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:41.267091 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-81c808c9-4e0d-4f18-94f3-1b709f3d1740 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:04:41.267091 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:41.267091 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:04:41.267091 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:04:41.267091 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:04:41.267091 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:04:41.267091 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:04:41.267091 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:04:41.267091 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:04:41.267091 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:04:41.267091 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:04:41.267091 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:04:41.267091 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 12:04:41.267091 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 12:04:41.267091 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 12:04:41.269174 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 12:04:41.269174 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:04:41.269174 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:04:41.269174 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:04:41.269174 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:04:41.269174 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:04:41.269174 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:04:41.269174 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:04:41.269174 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:04:41.269174 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:04:41.269174 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:04:41.269174 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:04:41.269174 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:04:41.269174 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:04:41.269174 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:04:41.269174 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:04:41.269174 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:04:41.271170 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 12:04:41.271170 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 12:04:41.271170 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 12:04:41.271170 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 12:04:41.271170 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 12:04:41.271170 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 12:04:41.271170 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:04:41.271170 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:04:41.273653 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 482/970] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Sep 5 12:04:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:04:41.274612 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c808c9-4e0d-4f18-94f3-1b709f3d1740 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:41.314560 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:41.338653 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a764c4c-c194-4be4-8bfa-dfe6ccbc968a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:41.339292 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a764c4c-c194-4be4-8bfa-dfe6ccbc968a None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:41.339572 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a764c4c-c194-4be4-8bfa-dfe6ccbc968a None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:41.339841 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a764c4c-c194-4be4-8bfa-dfe6ccbc968a None admin] PATH_INFO: `/v3/services` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:41.340489 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a764c4c-c194-4be4-8bfa-dfe6ccbc968a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:41.340792 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a764c4c-c194-4be4-8bfa-dfe6ccbc968a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:41.342264 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a764c4c-c194-4be4-8bfa-dfe6ccbc968a None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:41.349570 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 489/971] 10.222.0.50 () {56 vars in 1122 bytes} [Mon Sep 5 12:04:41 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:04:41.357756 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a764c4c-c194-4be4-8bfa-dfe6ccbc968a None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:41.469727 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c808c9-4e0d-4f18-94f3-1b709f3d1740 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:41.505210 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a764c4c-c194-4be4-8bfa-dfe6ccbc968a None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:41.532033 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394b3ca9-7899-46e4-879f-dc19e8247302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:41.533114 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394b3ca9-7899-46e4-879f-dc19e8247302 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:41.533614 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394b3ca9-7899-46e4-879f-dc19e8247302 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:41.534111 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394b3ca9-7899-46e4-879f-dc19e8247302 None admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:41.535389 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394b3ca9-7899-46e4-879f-dc19e8247302 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:41.535947 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394b3ca9-7899-46e4-879f-dc19e8247302 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:41.538616 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394b3ca9-7899-46e4-879f-dc19e8247302 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:41.560952 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 483/972] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Sep 5 12:04:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:04:41.560952 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7742d173-8451-45a3-8f67-583b33e855d1 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:41.560952 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7742d173-8451-45a3-8f67-583b33e855d1 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:41.560952 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7742d173-8451-45a3-8f67-583b33e855d1 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:41.560952 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 484/973] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:04:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:04:41.563563 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344d1261-6979-4073-a382-dd4a94dcdeaa None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:41.563845 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344d1261-6979-4073-a382-dd4a94dcdeaa None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:41.564123 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344d1261-6979-4073-a382-dd4a94dcdeaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:41.578447 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38d2a07-b070-4d4d-b386-1256291d6f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:41.579128 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38d2a07-b070-4d4d-b386-1256291d6f46 None admin] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:41.579567 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38d2a07-b070-4d4d-b386-1256291d6f46 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:41.579843 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38d2a07-b070-4d4d-b386-1256291d6f46 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:41.580531 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38d2a07-b070-4d4d-b386-1256291d6f46 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:41.581952 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38d2a07-b070-4d4d-b386-1256291d6f46 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:41.586222 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-344d1261-6979-4073-a382-dd4a94dcdeaa None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:04:41.589416 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-344d1261-6979-4073-a382-dd4a94dcdeaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:04:41.592024 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:41.632939 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 490/974] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 5 12:04:41 2022] POST /identity/v3/endpoints => generated 349 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 12:04:41.632939 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38d2a07-b070-4d4d-b386-1256291d6f46 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:41.729936 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:41.745440 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 485/975] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:04:41 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 05 12:04:41.860875 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38d2a07-b070-4d4d-b386-1256291d6f46 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:41.939482 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26fc22f-5afe-46ca-97e9-173c3b3a831b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:41.940514 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26fc22f-5afe-46ca-97e9-173c3b3a831b None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:41.941042 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26fc22f-5afe-46ca-97e9-173c3b3a831b None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:41.941522 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26fc22f-5afe-46ca-97e9-173c3b3a831b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:41.942885 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26fc22f-5afe-46ca-97e9-173c3b3a831b None admin] RBAC: Adding query filter params (role.id=2ca407f96a3e417eac20298c6e80384e, scope.project.id=ae4f8939fcc040bca99783a77e6ede4d, user.id=bacc8ece8df24bf498c1d55ca2918224) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:41.943424 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26fc22f-5afe-46ca-97e9-173c3b3a831b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:41.946241 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26fc22f-5afe-46ca-97e9-173c3b3a831b None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:41.959337 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 491/976] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Sep 5 12:04:41 2022] GET /identity/v3/role_assignments?user.id=bacc8ece8df24bf498c1d55ca2918224&scope.project.id=ae4f8939fcc040bca99783a77e6ede4d&role.id=2ca407f96a3e417eac20298c6e80384e => generated 608 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:04:42.276475 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344d1261-6979-4073-a382-dd4a94dcdeaa None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:42.471824 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344d1261-6979-4073-a382-dd4a94dcdeaa None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:42.508101 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a1ca60-9352-4b40-a31d-a9a1772f850d None None] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:42.508957 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a1ca60-9352-4b40-a31d-a9a1772f850d None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:42.509108 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a1ca60-9352-4b40-a31d-a9a1772f850d None None] PATH_INFO: `/` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:42.517417 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 492/977] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:04:42 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 12:04:42.520410 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d110d3-9f96-47d2-b2a4-a8f97f93f874 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:42.520886 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d110d3-9f96-47d2-b2a4-a8f97f93f874 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:42.521388 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d110d3-9f96-47d2-b2a4-a8f97f93f874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:42.539585 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec30be3-922f-4184-8947-1cab5260e02d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:42.540439 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec30be3-922f-4184-8947-1cab5260e02d None admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:42.540913 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec30be3-922f-4184-8947-1cab5260e02d None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:42.541965 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec30be3-922f-4184-8947-1cab5260e02d None admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:42.543224 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec30be3-922f-4184-8947-1cab5260e02d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:42.546015 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec30be3-922f-4184-8947-1cab5260e02d None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:42.550624 dv-cinder-855189-1-smb devstack@keystone.service[81720]: WARNING keystone.server.flask.common [None req-dec30be3-922f-4184-8947-1cab5260e02d None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 05 12:04:42.553686 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-93d110d3-9f96-47d2-b2a4-a8f97f93f874 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:04:42.555583 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-93d110d3-9f96-47d2-b2a4-a8f97f93f874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:04:42.562501 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:42.574264 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.sql.core [None req-dec30be3-922f-4184-8947-1cab5260e02d None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 05 12:04:42.574264 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 05 12:04:42.574264 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [parameters: {'user_id': 'f718d92cea684493870c6c8af927aa9f', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 05 12:04:42.574264 dv-cinder-855189-1-smb devstack@keystone.service[81720]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81720) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 05 12:04:42.614651 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-dec30be3-922f-4184-8947-1cab5260e02d None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 05 12:04:42.614651 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:42.614651 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 05 12:04:42.614651 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 05 12:04:42.614651 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 05 12:04:42.614651 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 05 12:04:42.614651 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 05 12:04:42.614651 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application result = self._query(query) Sep 05 12:04:42.614651 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 05 12:04:42.614651 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application conn.query(q) Sep 05 12:04:42.614651 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 05 12:04:42.614651 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 05 12:04:42.614651 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 05 12:04:42.614651 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application result.read() Sep 05 12:04:42.614651 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 05 12:04:42.618022 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 05 12:04:42.618022 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 05 12:04:42.618022 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 05 12:04:42.618022 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 05 12:04:42.618022 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 05 12:04:42.618022 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 05 12:04:42.618022 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 05 12:04:42.618022 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 05 12:04:42.618022 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:04:42.618022 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 05 12:04:42.618022 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:04:42.618022 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:42.618022 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 05 12:04:42.618022 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 05 12:04:42.618022 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 05 12:04:42.618022 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 05 12:04:42.618022 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 05 12:04:42.618022 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application next(self.gen) Sep 05 12:04:42.620506 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 05 12:04:42.620506 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application yield resource Sep 05 12:04:42.620506 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 05 12:04:42.620506 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application next(self.gen) Sep 05 12:04:42.620506 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 05 12:04:42.620506 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application self.session.rollback() Sep 05 12:04:42.620506 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 05 12:04:42.620506 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application self.force_reraise() Sep 05 12:04:42.620506 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 05 12:04:42.620506 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise self.value Sep 05 12:04:42.620506 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 05 12:04:42.620506 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 05 12:04:42.620506 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 05 12:04:42.620506 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application session.commit() Sep 05 12:04:42.620506 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 05 12:04:42.620506 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 05 12:04:42.620506 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 05 12:04:42.622463 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application self._prepare_impl() Sep 05 12:04:42.622463 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 05 12:04:42.622463 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application self.session.flush() Sep 05 12:04:42.622463 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 05 12:04:42.622463 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application self._flush(objects) Sep 05 12:04:42.622463 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 05 12:04:42.622463 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 05 12:04:42.622463 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 05 12:04:42.622463 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application compat.raise_( Sep 05 12:04:42.622463 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 05 12:04:42.622463 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception Sep 05 12:04:42.622463 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 05 12:04:42.622463 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application flush_context.execute() Sep 05 12:04:42.622463 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 05 12:04:42.622463 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rec.execute(self) Sep 05 12:04:42.622463 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 05 12:04:42.622463 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 05 12:04:42.624376 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 05 12:04:42.624376 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 05 12:04:42.624376 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 05 12:04:42.624376 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 05 12:04:42.624376 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 05 12:04:42.624376 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 05 12:04:42.624376 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 05 12:04:42.624376 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 05 12:04:42.624376 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 05 12:04:42.624376 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 05 12:04:42.624376 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 05 12:04:42.624376 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 05 12:04:42.624376 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 05 12:04:42.624376 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 05 12:04:42.624376 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 05 12:04:42.624376 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception Sep 05 12:04:42.632939 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 05 12:04:42.632939 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 05 12:04:42.632939 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 05 12:04:42.632939 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 05 12:04:42.632939 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 05 12:04:42.632939 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application result = self._query(query) Sep 05 12:04:42.632939 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 05 12:04:42.632939 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application conn.query(q) Sep 05 12:04:42.632939 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 05 12:04:42.632939 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 05 12:04:42.632939 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 05 12:04:42.632939 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application result.read() Sep 05 12:04:42.632939 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 05 12:04:42.632939 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 05 12:04:42.632939 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 05 12:04:42.632939 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 05 12:04:42.636198 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 05 12:04:42.636198 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 05 12:04:42.636198 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 05 12:04:42.636198 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 05 12:04:42.636198 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 05 12:04:42.636198 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 05 12:04:42.636198 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [parameters: {'user_id': 'f718d92cea684493870c6c8af927aa9f', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 05 12:04:42.636198 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 05 12:04:42.636198 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:04:42.636198 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 12:04:42.636198 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:04:42.636198 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:42.636198 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:04:42.636198 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:04:42.636198 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:04:42.639155 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:04:42.639155 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:04:42.639155 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:04:42.639155 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:04:42.639155 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:04:42.639155 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:04:42.639155 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:04:42.639155 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 05 12:04:42.639155 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 05 12:04:42.639155 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:04:42.639155 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:04:42.639155 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 12:04:42.639155 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:04:42.639155 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 12:04:42.639155 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:04:42.639155 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 05 12:04:42.639155 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 05 12:04:42.642469 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 05 12:04:42.642469 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 05 12:04:42.642469 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 05 12:04:42.642469 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 05 12:04:42.642469 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 05 12:04:42.642469 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:04:42.642469 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 486/978] 10.222.0.50 () {60 vars in 1131 bytes} [Mon Sep 5 12:04:42 2022] POST /identity/v3/users => generated 160 bytes in 342 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:04:42.642469 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec30be3-922f-4184-8947-1cab5260e02d None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:42.701228 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 493/979] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:04:42 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 05 12:04:42.839582 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec30be3-922f-4184-8947-1cab5260e02d None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:42.909545 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb9d400-7c16-42c9-81fb-a5a588cb9a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:42.910529 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb9d400-7c16-42c9-81fb-a5a588cb9a53 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:42.910949 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb9d400-7c16-42c9-81fb-a5a588cb9a53 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:42.911356 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb9d400-7c16-42c9-81fb-a5a588cb9a53 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:42.926314 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb9d400-7c16-42c9-81fb-a5a588cb9a53 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:42.929515 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb9d400-7c16-42c9-81fb-a5a588cb9a53 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:42.954058 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-ecb9d400-7c16-42c9-81fb-a5a588cb9a53 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 05 12:04:42.954058 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:42.954058 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:04:42.954058 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:04:42.954058 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:04:42.954058 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:04:42.954058 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:04:42.954058 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:04:42.954058 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:04:42.954058 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:04:42.954058 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:04:42.954058 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:04:42.954058 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 12:04:42.954058 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 12:04:42.954058 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 12:04:42.954058 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 12:04:42.956061 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:04:42.956061 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:04:42.956061 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 12:04:42.956061 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:04:42.956061 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 12:04:42.956061 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:04:42.956061 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:04:42.956061 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:04:42.956061 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:04:42.956061 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:04:42.956061 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:04:42.956061 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:04:42.956061 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:04:42.956061 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:04:42.956061 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:04:42.956061 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:04:42.956061 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:04:42.956061 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:04:42.959540 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:04:42.959540 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:04:42.959540 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 12:04:42.959540 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 12:04:42.959540 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 12:04:42.959540 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 12:04:42.959540 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 12:04:42.959540 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 12:04:42.959540 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 05 12:04:42.959540 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:04:42.959540 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 487/980] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Sep 5 12:04:42 2022] GET /identity/v3/users/cinder => generated 84 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 12:04:42.972617 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d110d3-9f96-47d2-b2a4-a8f97f93f874 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:43.049101 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:43.080625 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb9d400-7c16-42c9-81fb-a5a588cb9a53 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:43.165435 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d110d3-9f96-47d2-b2a4-a8f97f93f874 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:43.178520 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:43.244530 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173a5fef-2ffb-4f23-8f43-68b7d7f68d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:43.245188 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173a5fef-2ffb-4f23-8f43-68b7d7f68d0e None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:43.245468 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173a5fef-2ffb-4f23-8f43-68b7d7f68d0e None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:43.245738 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173a5fef-2ffb-4f23-8f43-68b7d7f68d0e None admin] PATH_INFO: `/v3/users` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:43.246461 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173a5fef-2ffb-4f23-8f43-68b7d7f68d0e None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:43.246762 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173a5fef-2ffb-4f23-8f43-68b7d7f68d0e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:43.248235 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173a5fef-2ffb-4f23-8f43-68b7d7f68d0e None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:43.262459 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb9d400-7c16-42c9-81fb-a5a588cb9a53 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:43.297747 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 494/981] 10.222.0.50 () {56 vars in 1101 bytes} [Mon Sep 5 12:04:42 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:04:43.321649 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a38ce1-fead-44a9-af09-283ea982a9a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:43.323270 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a38ce1-fead-44a9-af09-283ea982a9a0 None admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:43.323763 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a38ce1-fead-44a9-af09-283ea982a9a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:43.324228 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a38ce1-fead-44a9-af09-283ea982a9a0 None admin] PATH_INFO: `/v3/services` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:43.325529 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a38ce1-fead-44a9-af09-283ea982a9a0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:43.328102 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a38ce1-fead-44a9-af09-283ea982a9a0 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:43.366746 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 488/982] 10.222.0.50 () {60 vars in 1141 bytes} [Mon Sep 5 12:04:43 2022] POST /identity/v3/services => generated 242 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:04:44.351933 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69961e5d-45c7-4a67-9f13-6ded09ef1f39 None None] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:44.352979 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69961e5d-45c7-4a67-9f13-6ded09ef1f39 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:44.354071 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69961e5d-45c7-4a67-9f13-6ded09ef1f39 None None] PATH_INFO: `/` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:44.355604 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 495/983] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:04:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:04:44.361985 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80f8993-d706-4abf-98b2-0aff4f7553bf None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:44.363909 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80f8993-d706-4abf-98b2-0aff4f7553bf None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:44.363909 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80f8993-d706-4abf-98b2-0aff4f7553bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:44.382900 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-c80f8993-d706-4abf-98b2-0aff4f7553bf None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:04:44.385466 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-c80f8993-d706-4abf-98b2-0aff4f7553bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:04:44.468599 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d422f0fd-9177-48bb-b2f7-433f87c007d3 None None] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:44.468962 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d422f0fd-9177-48bb-b2f7-433f87c007d3 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:44.469213 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d422f0fd-9177-48bb-b2f7-433f87c007d3 None None] PATH_INFO: `/` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:44.470928 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 496/984] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:04:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 12:04:44.473868 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 489/985] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:04:44 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 12:04:44.476788 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b5e018-587e-4323-9240-c838cc42ef89 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:44.477106 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b5e018-587e-4323-9240-c838cc42ef89 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:44.477384 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b5e018-587e-4323-9240-c838cc42ef89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:44.496757 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-32b5e018-587e-4323-9240-c838cc42ef89 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:04:44.499622 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-32b5e018-587e-4323-9240-c838cc42ef89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:04:44.601083 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 497/986] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:04:44 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 12:04:44.740629 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80f8993-d706-4abf-98b2-0aff4f7553bf None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:44.791480 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:44.856206 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80f8993-d706-4abf-98b2-0aff4f7553bf None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:44.863784 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b5e018-587e-4323-9240-c838cc42ef89 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:44.895039 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:44.898484 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500295ef-4c7f-4d38-b7aa-c066b2f71e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:44.899129 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500295ef-4c7f-4d38-b7aa-c066b2f71e8d None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:44.899430 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500295ef-4c7f-4d38-b7aa-c066b2f71e8d None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:44.899703 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500295ef-4c7f-4d38-b7aa-c066b2f71e8d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:44.900294 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500295ef-4c7f-4d38-b7aa-c066b2f71e8d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:44.901718 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500295ef-4c7f-4d38-b7aa-c066b2f71e8d None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:44.916590 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-500295ef-4c7f-4d38-b7aa-c066b2f71e8d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 05 12:04:44.916590 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:44.916590 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 05 12:04:44.916590 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 05 12:04:44.916590 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 05 12:04:44.916590 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 05 12:04:44.916590 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 05 12:04:44.916590 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 12:04:44.916590 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 05 12:04:44.916590 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:04:44.916590 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 12:04:44.916590 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:04:44.916590 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:44.916590 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:04:44.916590 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:04:44.916590 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:04:44.916590 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:04:44.917748 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:04:44.917748 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:04:44.917748 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:04:44.917748 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:04:44.917748 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:04:44.917748 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:04:44.917748 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 05 12:04:44.917748 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 05 12:04:44.917748 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 05 12:04:44.917748 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 05 12:04:44.917748 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:04:44.917748 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:04:44.917748 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:04:44.917748 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:04:44.917748 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:04:44.917748 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:04:44.918625 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:04:44.918625 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:04:44.918625 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:04:44.918625 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:04:44.918625 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:04:44.918625 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:04:44.918625 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:04:44.918625 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:04:44.918625 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:04:44.918625 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:04:44.918625 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 05 12:04:44.918625 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 12:04:44.918625 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 05 12:04:44.918625 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:04:44.920960 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 490/987] 10.222.0.50 () {56 vars in 1126 bytes} [Mon Sep 5 12:04:44 2022] GET /identity/v3/services/object-store => generated 93 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:04:44.925562 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500295ef-4c7f-4d38-b7aa-c066b2f71e8d None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:44.979192 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b5e018-587e-4323-9240-c838cc42ef89 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:45.016350 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8e321a-c289-40b3-9848-db6ce460faaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:45.016865 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8e321a-c289-40b3-9848-db6ce460faaf None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:45.017191 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8e321a-c289-40b3-9848-db6ce460faaf None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:45.017468 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8e321a-c289-40b3-9848-db6ce460faaf None admin] PATH_INFO: `/v3/services/image` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:45.018063 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8e321a-c289-40b3-9848-db6ce460faaf None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:45.019582 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8e321a-c289-40b3-9848-db6ce460faaf None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:45.030756 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application [None req-cb8e321a-c289-40b3-9848-db6ce460faaf None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 05 12:04:45.030756 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:45.030756 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 05 12:04:45.030756 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 05 12:04:45.030756 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 05 12:04:45.030756 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 05 12:04:45.030756 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 05 12:04:45.030756 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 12:04:45.030756 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 05 12:04:45.030756 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:04:45.030756 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 12:04:45.030756 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:04:45.030756 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:45.030756 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:04:45.030756 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:04:45.030756 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:04:45.030756 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:04:45.031808 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:04:45.031808 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:04:45.031808 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:04:45.031808 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:04:45.031808 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:04:45.031808 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:04:45.031808 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 05 12:04:45.031808 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 05 12:04:45.031808 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 05 12:04:45.031808 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 05 12:04:45.031808 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:04:45.031808 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:04:45.031808 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:04:45.031808 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:04:45.031808 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:04:45.031808 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:04:45.032687 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:04:45.032687 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application with Lock( Sep 05 12:04:45.032687 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:04:45.032687 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:04:45.032687 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:04:45.032687 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:04:45.032687 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:04:45.032687 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:04:45.032687 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:04:45.032687 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:04:45.032687 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 05 12:04:45.032687 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 12:04:45.032687 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 05 12:04:45.032687 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:04:45.034026 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500295ef-4c7f-4d38-b7aa-c066b2f71e8d None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:45.037217 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 498/988] 10.222.0.50 () {56 vars in 1105 bytes} [Mon Sep 5 12:04:44 2022] GET /identity/v3/services/image => generated 86 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:04:45.037975 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8e321a-c289-40b3-9848-db6ce460faaf None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:45.040639 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:45.071170 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85a8cc8-8a95-4ceb-87fd-65fab9a5115a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:45.071780 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85a8cc8-8a95-4ceb-87fd-65fab9a5115a None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:45.072065 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85a8cc8-8a95-4ceb-87fd-65fab9a5115a None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:45.072881 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85a8cc8-8a95-4ceb-87fd-65fab9a5115a None admin] PATH_INFO: `/v3/services` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:45.073545 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85a8cc8-8a95-4ceb-87fd-65fab9a5115a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:45.073836 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85a8cc8-8a95-4ceb-87fd-65fab9a5115a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:45.075215 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85a8cc8-8a95-4ceb-87fd-65fab9a5115a None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:45.080061 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 491/989] 10.222.0.50 () {56 vars in 1122 bytes} [Mon Sep 5 12:04:44 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:04:45.085852 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85a8cc8-8a95-4ceb-87fd-65fab9a5115a None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:45.142961 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:45.154279 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8e321a-c289-40b3-9848-db6ce460faaf None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:45.189959 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09deacf5-7f5b-4306-9b48-e8692193bab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:45.190568 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09deacf5-7f5b-4306-9b48-e8692193bab1 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:45.190847 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09deacf5-7f5b-4306-9b48-e8692193bab1 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:45.191118 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09deacf5-7f5b-4306-9b48-e8692193bab1 None admin] PATH_INFO: `/v3/services` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:45.191646 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85a8cc8-8a95-4ceb-87fd-65fab9a5115a None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:45.191749 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09deacf5-7f5b-4306-9b48-e8692193bab1 None admin] RBAC: Adding query filter params (name=image) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:45.192045 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09deacf5-7f5b-4306-9b48-e8692193bab1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:45.193525 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09deacf5-7f5b-4306-9b48-e8692193bab1 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:45.201153 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 499/990] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 5 12:04:45 2022] GET /identity/v3/services?name=image => generated 122 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:04:45.204286 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09deacf5-7f5b-4306-9b48-e8692193bab1 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:45.234452 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cede464-39f4-4bf9-9460-3b34d73a9898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:45.235412 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cede464-39f4-4bf9-9460-3b34d73a9898 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:45.235906 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cede464-39f4-4bf9-9460-3b34d73a9898 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:45.236337 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cede464-39f4-4bf9-9460-3b34d73a9898 None admin] PATH_INFO: `/v3/services` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:45.237020 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cede464-39f4-4bf9-9460-3b34d73a9898 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:45.237333 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cede464-39f4-4bf9-9460-3b34d73a9898 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:45.238751 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cede464-39f4-4bf9-9460-3b34d73a9898 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:45.250104 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 492/991] 10.222.0.50 () {56 vars in 1122 bytes} [Mon Sep 5 12:04:45 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:04:45.251155 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cede464-39f4-4bf9-9460-3b34d73a9898 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:45.286890 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:45.316130 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09deacf5-7f5b-4306-9b48-e8692193bab1 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:45.349949 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7198d26b-1ad4-41e8-9bbb-4ca26aeafb66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:45.350570 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7198d26b-1ad4-41e8-9bbb-4ca26aeafb66 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:45.350855 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7198d26b-1ad4-41e8-9bbb-4ca26aeafb66 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:45.351131 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7198d26b-1ad4-41e8-9bbb-4ca26aeafb66 None admin] PATH_INFO: `/v3/services` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:45.351799 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7198d26b-1ad4-41e8-9bbb-4ca26aeafb66 None admin] RBAC: Adding query filter params (type=image) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:45.352113 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7198d26b-1ad4-41e8-9bbb-4ca26aeafb66 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:45.354068 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7198d26b-1ad4-41e8-9bbb-4ca26aeafb66 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:45.358872 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 500/992] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 5 12:04:45 2022] GET /identity/v3/services?type=image => generated 122 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:04:45.373738 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cede464-39f4-4bf9-9460-3b34d73a9898 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:45.414517 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91bbe1e-d8fe-4542-b418-2a4b341e0246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:45.415160 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91bbe1e-d8fe-4542-b418-2a4b341e0246 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:45.415442 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91bbe1e-d8fe-4542-b418-2a4b341e0246 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:45.415716 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91bbe1e-d8fe-4542-b418-2a4b341e0246 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:45.417050 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91bbe1e-d8fe-4542-b418-2a4b341e0246 None admin] RBAC: Adding query filter params (interface=admin, service_id=cdc3de5518ce46e8ba73e5c416e67fe7, region_id=RegionOne) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:45.417354 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91bbe1e-d8fe-4542-b418-2a4b341e0246 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:45.418776 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91bbe1e-d8fe-4542-b418-2a4b341e0246 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:45.425143 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 493/993] 10.222.0.50 () {56 vars in 1249 bytes} [Mon Sep 5 12:04:45 2022] GET /identity/v3/endpoints?service_id=cdc3de5518ce46e8ba73e5c416e67fe7&interface=admin®ion_id=RegionOne => generated 193 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:04:45.430533 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7198d26b-1ad4-41e8-9bbb-4ca26aeafb66 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:45.453218 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:45.547086 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7198d26b-1ad4-41e8-9bbb-4ca26aeafb66 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:45.583075 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c0a0d6-5007-4f5f-8043-f8ec5fef58d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:45.584081 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c0a0d6-5007-4f5f-8043-f8ec5fef58d4 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:45.584549 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c0a0d6-5007-4f5f-8043-f8ec5fef58d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:45.585101 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c0a0d6-5007-4f5f-8043-f8ec5fef58d4 None admin] PATH_INFO: `/v3/services` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:45.585877 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c0a0d6-5007-4f5f-8043-f8ec5fef58d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:45.587398 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c0a0d6-5007-4f5f-8043-f8ec5fef58d4 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:45.595112 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 501/994] 10.222.0.50 () {56 vars in 1087 bytes} [Mon Sep 5 12:04:45 2022] GET /identity/v3/services => generated 1727 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:04:45.686437 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2182cb-37ed-447a-8727-49459884d065 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:45.686810 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2182cb-37ed-447a-8727-49459884d065 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:45.687163 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2182cb-37ed-447a-8727-49459884d065 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:45.688646 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 494/995] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:04:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:04:45.694590 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7b396f-9b9c-40fa-bfa0-e0129acfced7 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:45.694889 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7b396f-9b9c-40fa-bfa0-e0129acfced7 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:45.695148 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7b396f-9b9c-40fa-bfa0-e0129acfced7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:45.715248 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-ca7b396f-9b9c-40fa-bfa0-e0129acfced7 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:04:45.716877 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-ca7b396f-9b9c-40fa-bfa0-e0129acfced7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:04:45.804142 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 502/996] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:04:45 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 12:04:46.081140 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2182cb-37ed-447a-8727-49459884d065 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:46.193737 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:46.199867 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2182cb-37ed-447a-8727-49459884d065 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:46.242443 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d663425a-539e-462a-b41d-84fd9957a24e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:46.243103 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d663425a-539e-462a-b41d-84fd9957a24e None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:46.243384 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d663425a-539e-462a-b41d-84fd9957a24e None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:46.243659 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d663425a-539e-462a-b41d-84fd9957a24e None admin] PATH_INFO: `/v3/services/compute` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:46.244295 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d663425a-539e-462a-b41d-84fd9957a24e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:46.245735 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d663425a-539e-462a-b41d-84fd9957a24e None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:46.255457 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-d663425a-539e-462a-b41d-84fd9957a24e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 05 12:04:46.255457 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:46.255457 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 05 12:04:46.255457 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 05 12:04:46.255457 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 05 12:04:46.255457 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 05 12:04:46.255457 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 05 12:04:46.255457 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 12:04:46.255457 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 05 12:04:46.255457 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:04:46.255457 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 12:04:46.255457 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:04:46.255457 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:46.255457 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:04:46.255457 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:04:46.255457 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:04:46.255457 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:04:46.261890 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:04:46.261890 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:04:46.261890 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:04:46.261890 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:04:46.261890 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:04:46.261890 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:04:46.261890 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 05 12:04:46.261890 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 05 12:04:46.261890 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 05 12:04:46.261890 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 05 12:04:46.261890 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:04:46.261890 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:04:46.261890 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:04:46.261890 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:04:46.261890 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:04:46.261890 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:04:46.262930 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:04:46.262930 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:04:46.262930 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:04:46.262930 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:04:46.262930 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:04:46.262930 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:04:46.262930 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:04:46.262930 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:04:46.262930 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:04:46.262930 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:04:46.262930 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 05 12:04:46.262930 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 12:04:46.262930 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 05 12:04:46.262930 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:04:46.262930 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 495/997] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Sep 5 12:04:46 2022] GET /identity/v3/services/compute => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:04:46.279724 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7b396f-9b9c-40fa-bfa0-e0129acfced7 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:46.309965 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:46.428825 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7b396f-9b9c-40fa-bfa0-e0129acfced7 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:46.481613 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e7dedc-983b-4b2e-8295-160dc9654806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:46.482590 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e7dedc-983b-4b2e-8295-160dc9654806 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:46.483077 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e7dedc-983b-4b2e-8295-160dc9654806 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:46.483560 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e7dedc-983b-4b2e-8295-160dc9654806 None admin] PATH_INFO: `/v3/services` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:46.484695 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e7dedc-983b-4b2e-8295-160dc9654806 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:46.485234 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e7dedc-983b-4b2e-8295-160dc9654806 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:46.487695 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e7dedc-983b-4b2e-8295-160dc9654806 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:46.500946 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 503/998] 10.222.0.50 () {56 vars in 1112 bytes} [Mon Sep 5 12:04:46 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:04:46.503668 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d663425a-539e-462a-b41d-84fd9957a24e None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:46.667298 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d663425a-539e-462a-b41d-84fd9957a24e None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:46.708858 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c171f6c8-807e-4a29-a8a1-c201a744a481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:46.710025 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c171f6c8-807e-4a29-a8a1-c201a744a481 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:46.710313 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c171f6c8-807e-4a29-a8a1-c201a744a481 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:46.710590 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c171f6c8-807e-4a29-a8a1-c201a744a481 None admin] PATH_INFO: `/v3/services` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:46.711312 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c171f6c8-807e-4a29-a8a1-c201a744a481 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:46.711625 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c171f6c8-807e-4a29-a8a1-c201a744a481 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:46.713250 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c171f6c8-807e-4a29-a8a1-c201a744a481 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:46.719948 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 496/999] 10.222.0.50 () {56 vars in 1112 bytes} [Mon Sep 5 12:04:46 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:04:46.726365 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e7dedc-983b-4b2e-8295-160dc9654806 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:46.825644 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:46.851379 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e7dedc-983b-4b2e-8295-160dc9654806 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:46.896034 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c3f45f-20fe-4733-b02c-ff8efa08c07d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:46.896651 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c3f45f-20fe-4733-b02c-ff8efa08c07d None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:46.896966 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c3f45f-20fe-4733-b02c-ff8efa08c07d None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:46.897247 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c3f45f-20fe-4733-b02c-ff8efa08c07d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:46.898220 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c3f45f-20fe-4733-b02c-ff8efa08c07d None admin] RBAC: Adding query filter params (interface=public, service_id=0404fec870844ae9874a7afd74787d00, region_id=RegionOne) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:46.898529 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c3f45f-20fe-4733-b02c-ff8efa08c07d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:46.899900 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c3f45f-20fe-4733-b02c-ff8efa08c07d None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:46.910643 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 504/1000] 10.222.0.50 () {56 vars in 1251 bytes} [Mon Sep 5 12:04:46 2022] GET /identity/v3/endpoints?service_id=0404fec870844ae9874a7afd74787d00&interface=public®ion_id=RegionOne => generated 194 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:04:46.913325 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c171f6c8-807e-4a29-a8a1-c201a744a481 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:46.953841 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:47.049839 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c171f6c8-807e-4a29-a8a1-c201a744a481 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:47.091823 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9a0910-e0c3-49c4-b135-1ebdc94690a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:47.092774 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9a0910-e0c3-49c4-b135-1ebdc94690a6 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:47.093255 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9a0910-e0c3-49c4-b135-1ebdc94690a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:47.093677 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9a0910-e0c3-49c4-b135-1ebdc94690a6 None admin] PATH_INFO: `/v3/services` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:47.094530 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9a0910-e0c3-49c4-b135-1ebdc94690a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:47.096156 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9a0910-e0c3-49c4-b135-1ebdc94690a6 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:47.104609 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 497/1001] 10.222.0.50 () {56 vars in 1087 bytes} [Mon Sep 5 12:04:46 2022] GET /identity/v3/services => generated 1727 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:04:47.341913 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fd96a7-8217-4c86-b46a-8a830b0758ef None None] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:47.342103 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fd96a7-8217-4c86-b46a-8a830b0758ef None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:47.342342 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fd96a7-8217-4c86-b46a-8a830b0758ef None None] PATH_INFO: `/` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:47.343955 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 505/1002] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:04:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:04:47.349837 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6287efb3-06b1-4611-a911-a714d5a3069a None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:47.350128 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6287efb3-06b1-4611-a911-a714d5a3069a None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:47.350398 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6287efb3-06b1-4611-a911-a714d5a3069a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:47.370932 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-6287efb3-06b1-4611-a911-a714d5a3069a None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:04:47.372171 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-6287efb3-06b1-4611-a911-a714d5a3069a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:04:47.446998 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 498/1003] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:04:47 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 12:04:47.583743 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf2a10d-c2a5-4cfe-9784-58bbea8002cd None None] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:47.584247 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf2a10d-c2a5-4cfe-9784-58bbea8002cd None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:47.584353 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf2a10d-c2a5-4cfe-9784-58bbea8002cd None None] PATH_INFO: `/` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:47.588397 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 506/1004] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:04:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:04:47.592043 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9deb8d3-6dd9-4af1-a3c4-cbcd46094c57 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:47.592712 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9deb8d3-6dd9-4af1-a3c4-cbcd46094c57 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:47.592712 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9deb8d3-6dd9-4af1-a3c4-cbcd46094c57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:47.611115 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-f9deb8d3-6dd9-4af1-a3c4-cbcd46094c57 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:04:47.612317 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-f9deb8d3-6dd9-4af1-a3c4-cbcd46094c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:04:47.627351 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:47.684538 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 499/1005] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:04:47 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 12:04:47.715673 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf2a10d-c2a5-4cfe-9784-58bbea8002cd None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:47.827011 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf2a10d-c2a5-4cfe-9784-58bbea8002cd None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:47.861207 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1581ba-b73c-466a-9ee0-5d690cea5a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:47.861830 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1581ba-b73c-466a-9ee0-5d690cea5a88 None admin] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:47.862113 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1581ba-b73c-466a-9ee0-5d690cea5a88 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:47.862394 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1581ba-b73c-466a-9ee0-5d690cea5a88 None admin] PATH_INFO: `/v3/services` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:47.863078 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1581ba-b73c-466a-9ee0-5d690cea5a88 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:47.864409 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1581ba-b73c-466a-9ee0-5d690cea5a88 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:47.876227 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:47.885246 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 507/1006] 10.222.0.50 () {60 vars in 1141 bytes} [Mon Sep 5 12:04:47 2022] POST /identity/v3/services => generated 242 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:04:47.960834 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9deb8d3-6dd9-4af1-a3c4-cbcd46094c57 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:48.071911 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9deb8d3-6dd9-4af1-a3c4-cbcd46094c57 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:48.114600 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c135d624-5f30-4b6c-bc42-67d7f5f3a24d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:48.115200 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c135d624-5f30-4b6c-bc42-67d7f5f3a24d None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:48.115481 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c135d624-5f30-4b6c-bc42-67d7f5f3a24d None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:48.115746 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c135d624-5f30-4b6c-bc42-67d7f5f3a24d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:48.116318 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c135d624-5f30-4b6c-bc42-67d7f5f3a24d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:48.117730 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c135d624-5f30-4b6c-bc42-67d7f5f3a24d None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:48.127253 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-c135d624-5f30-4b6c-bc42-67d7f5f3a24d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 05 12:04:48.127253 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:48.127253 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 05 12:04:48.127253 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 05 12:04:48.127253 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 05 12:04:48.127253 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 05 12:04:48.127253 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 05 12:04:48.127253 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 12:04:48.127253 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 05 12:04:48.127253 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:04:48.127253 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 12:04:48.127253 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:04:48.127253 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:48.127253 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:04:48.127253 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:04:48.127253 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:04:48.127253 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:04:48.128352 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:04:48.128352 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:04:48.128352 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:04:48.128352 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:04:48.128352 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:04:48.128352 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:04:48.128352 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 05 12:04:48.128352 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 05 12:04:48.128352 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 05 12:04:48.128352 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 05 12:04:48.128352 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:04:48.128352 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:04:48.128352 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:04:48.128352 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:04:48.128352 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:04:48.128352 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:04:48.129253 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:04:48.129253 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:04:48.129253 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:04:48.129253 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:04:48.129253 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:04:48.129253 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:04:48.129253 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:04:48.129253 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:04:48.129253 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:04:48.129253 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:04:48.129253 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 05 12:04:48.129253 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 12:04:48.129253 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 05 12:04:48.129253 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:04:48.129253 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 500/1007] 10.222.0.50 () {56 vars in 1126 bytes} [Mon Sep 5 12:04:47 2022] GET /identity/v3/services/object-store => generated 93 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:04:48.135331 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1581ba-b73c-466a-9ee0-5d690cea5a88 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:48.247371 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1581ba-b73c-466a-9ee0-5d690cea5a88 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:48.281470 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a26a39-5f76-40a3-bab3-c96f4022947a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:48.282085 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a26a39-5f76-40a3-bab3-c96f4022947a None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:48.282362 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a26a39-5f76-40a3-bab3-c96f4022947a None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:48.282631 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a26a39-5f76-40a3-bab3-c96f4022947a None admin] PATH_INFO: `/v3/services` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:48.283255 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a26a39-5f76-40a3-bab3-c96f4022947a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:48.283553 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a26a39-5f76-40a3-bab3-c96f4022947a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:48.284905 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a26a39-5f76-40a3-bab3-c96f4022947a None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:48.295078 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 508/1008] 10.222.0.50 () {56 vars in 1122 bytes} [Mon Sep 5 12:04:48 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:04:48.296331 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c135d624-5f30-4b6c-bc42-67d7f5f3a24d None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:48.310450 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:48.408876 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c135d624-5f30-4b6c-bc42-67d7f5f3a24d None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:48.443305 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7d3056-4baf-49c1-be73-58889b3db813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:48.443921 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7d3056-4baf-49c1-be73-58889b3db813 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:48.444202 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7d3056-4baf-49c1-be73-58889b3db813 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:48.444478 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7d3056-4baf-49c1-be73-58889b3db813 None admin] PATH_INFO: `/v3/services` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:48.445140 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7d3056-4baf-49c1-be73-58889b3db813 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:48.445447 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7d3056-4baf-49c1-be73-58889b3db813 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:48.446831 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7d3056-4baf-49c1-be73-58889b3db813 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:48.452133 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 501/1009] 10.222.0.50 () {56 vars in 1122 bytes} [Mon Sep 5 12:04:48 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:04:48.457654 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a26a39-5f76-40a3-bab3-c96f4022947a None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:48.521611 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:48.562700 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a26a39-5f76-40a3-bab3-c96f4022947a None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:48.596662 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de53c95-f685-46bc-b484-8a4e1ce41eab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:48.597322 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de53c95-f685-46bc-b484-8a4e1ce41eab None admin] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:48.597570 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de53c95-f685-46bc-b484-8a4e1ce41eab None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:48.597847 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de53c95-f685-46bc-b484-8a4e1ce41eab None admin] PATH_INFO: `/v3/endpoints` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:48.598529 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de53c95-f685-46bc-b484-8a4e1ce41eab None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:48.599900 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de53c95-f685-46bc-b484-8a4e1ce41eab None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:48.620927 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 509/1010] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 5 12:04:48 2022] POST /identity/v3/endpoints => generated 325 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:04:49.046770 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc69e27d-9785-490f-8d99-fd56d5a089e4 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:49.047267 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc69e27d-9785-490f-8d99-fd56d5a089e4 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:49.047267 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc69e27d-9785-490f-8d99-fd56d5a089e4 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:49.048719 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 502/1011] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:04:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:04:49.053891 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319fd332-13ec-43cd-aecd-abd8edc4cac1 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:49.054241 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319fd332-13ec-43cd-aecd-abd8edc4cac1 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:49.054580 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319fd332-13ec-43cd-aecd-abd8edc4cac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:49.074398 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-319fd332-13ec-43cd-aecd-abd8edc4cac1 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:04:49.075608 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-319fd332-13ec-43cd-aecd-abd8edc4cac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:04:49.156925 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 510/1012] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:04:49 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 12:04:49.418365 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc69e27d-9785-490f-8d99-fd56d5a089e4 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:49.496378 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:49.524426 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc69e27d-9785-490f-8d99-fd56d5a089e4 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:49.557812 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a99ae9-45cf-4782-a4f3-8ad1aa219b86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:49.558518 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a99ae9-45cf-4782-a4f3-8ad1aa219b86 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:49.558795 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a99ae9-45cf-4782-a4f3-8ad1aa219b86 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:49.559065 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a99ae9-45cf-4782-a4f3-8ad1aa219b86 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:49.559643 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a99ae9-45cf-4782-a4f3-8ad1aa219b86 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:49.561049 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a99ae9-45cf-4782-a4f3-8ad1aa219b86 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:49.569769 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-58a99ae9-45cf-4782-a4f3-8ad1aa219b86 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 05 12:04:49.569769 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:49.569769 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 05 12:04:49.569769 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 05 12:04:49.569769 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 05 12:04:49.569769 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 05 12:04:49.569769 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 05 12:04:49.569769 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 12:04:49.569769 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 05 12:04:49.569769 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:04:49.569769 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 12:04:49.569769 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:04:49.569769 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:49.569769 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:04:49.569769 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:04:49.569769 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:04:49.569769 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:04:49.570787 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:04:49.570787 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:04:49.570787 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:04:49.570787 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:04:49.570787 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:04:49.570787 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:04:49.570787 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 05 12:04:49.570787 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 05 12:04:49.570787 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 05 12:04:49.570787 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 05 12:04:49.570787 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:04:49.570787 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:04:49.570787 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:04:49.570787 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:04:49.570787 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:04:49.570787 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:04:49.571664 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:04:49.571664 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:04:49.571664 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:04:49.571664 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:04:49.571664 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:04:49.571664 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:04:49.571664 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:04:49.571664 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:04:49.571664 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:04:49.571664 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:04:49.571664 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 05 12:04:49.571664 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 12:04:49.571664 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 05 12:04:49.571664 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:04:49.576319 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 503/1013] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Sep 5 12:04:49 2022] GET /identity/v3/services/compute => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:04:49.577641 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319fd332-13ec-43cd-aecd-abd8edc4cac1 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:49.634267 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:49.693623 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319fd332-13ec-43cd-aecd-abd8edc4cac1 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:49.733357 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbb7c07-43f3-4994-ba4c-492bfe31fa3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:49.733966 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb7c07-43f3-4994-ba4c-492bfe31fa3d None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:49.734241 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb7c07-43f3-4994-ba4c-492bfe31fa3d None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:49.734509 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb7c07-43f3-4994-ba4c-492bfe31fa3d None admin] PATH_INFO: `/v3/services` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:49.735145 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbb7c07-43f3-4994-ba4c-492bfe31fa3d None admin] RBAC: Adding query filter params (name=compute) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:49.735441 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbb7c07-43f3-4994-ba4c-492bfe31fa3d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:49.736790 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbb7c07-43f3-4994-ba4c-492bfe31fa3d None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:49.742305 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 511/1014] 10.222.0.50 () {56 vars in 1112 bytes} [Mon Sep 5 12:04:49 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:04:49.748426 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a99ae9-45cf-4782-a4f3-8ad1aa219b86 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:49.822398 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27d9287-67ff-4162-8e48-3578c7e3f500 None None] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:49.822684 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27d9287-67ff-4162-8e48-3578c7e3f500 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:49.822963 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27d9287-67ff-4162-8e48-3578c7e3f500 None None] PATH_INFO: `/` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:49.824486 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 512/1015] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:04:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:04:49.829533 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde12194-ab8b-4156-bbfc-15c707b7ddd9 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:49.829824 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde12194-ab8b-4156-bbfc-15c707b7ddd9 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:49.830095 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde12194-ab8b-4156-bbfc-15c707b7ddd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:49.851510 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-cde12194-ab8b-4156-bbfc-15c707b7ddd9 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:04:49.853942 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-cde12194-ab8b-4156-bbfc-15c707b7ddd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:04:49.871812 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a99ae9-45cf-4782-a4f3-8ad1aa219b86 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:49.910307 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32567485-e166-4196-830c-bf17515ec18e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:49.910931 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32567485-e166-4196-830c-bf17515ec18e None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:49.911211 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32567485-e166-4196-830c-bf17515ec18e None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:49.911488 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32567485-e166-4196-830c-bf17515ec18e None admin] PATH_INFO: `/v3/services` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:49.912135 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32567485-e166-4196-830c-bf17515ec18e None admin] RBAC: Adding query filter params (type=compute) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:49.912445 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32567485-e166-4196-830c-bf17515ec18e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:49.914216 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32567485-e166-4196-830c-bf17515ec18e None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:49.923472 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 504/1016] 10.222.0.50 () {56 vars in 1112 bytes} [Mon Sep 5 12:04:49 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:04:49.930068 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32567485-e166-4196-830c-bf17515ec18e None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:49.933720 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:49.938704 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 513/1017] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:04:49 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 05 12:04:50.049843 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32567485-e166-4196-830c-bf17515ec18e None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:50.095417 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efa5f4d-7665-4bf3-a982-07db6b5a8263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:50.096369 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efa5f4d-7665-4bf3-a982-07db6b5a8263 None admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:50.096849 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efa5f4d-7665-4bf3-a982-07db6b5a8263 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:50.097350 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efa5f4d-7665-4bf3-a982-07db6b5a8263 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:50.098204 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efa5f4d-7665-4bf3-a982-07db6b5a8263 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:50.099772 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efa5f4d-7665-4bf3-a982-07db6b5a8263 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:50.124590 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 505/1018] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 5 12:04:49 2022] POST /identity/v3/endpoints => generated 334 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:04:50.218908 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde12194-ab8b-4156-bbfc-15c707b7ddd9 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:50.281154 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:50.350551 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde12194-ab8b-4156-bbfc-15c707b7ddd9 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:50.397739 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c56e293-3a1e-4c14-9055-f9bbbbfb9d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:50.398638 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c56e293-3a1e-4c14-9055-f9bbbbfb9d6d None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:50.398918 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c56e293-3a1e-4c14-9055-f9bbbbfb9d6d None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:50.399191 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c56e293-3a1e-4c14-9055-f9bbbbfb9d6d None admin] PATH_INFO: `/v3/services/image` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:50.399781 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c56e293-3a1e-4c14-9055-f9bbbbfb9d6d None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:50.401769 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c56e293-3a1e-4c14-9055-f9bbbbfb9d6d None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:50.411247 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application [None req-7c56e293-3a1e-4c14-9055-f9bbbbfb9d6d None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 05 12:04:50.411247 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:50.411247 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 05 12:04:50.411247 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 05 12:04:50.411247 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 05 12:04:50.411247 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 05 12:04:50.411247 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 05 12:04:50.411247 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 12:04:50.411247 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 05 12:04:50.411247 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:04:50.411247 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 12:04:50.411247 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:04:50.411247 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:50.411247 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:04:50.411247 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:04:50.411247 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:04:50.411247 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:04:50.412337 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:04:50.412337 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:04:50.412337 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:04:50.412337 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:04:50.412337 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:04:50.412337 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:04:50.412337 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 05 12:04:50.412337 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 05 12:04:50.412337 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 05 12:04:50.412337 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 05 12:04:50.412337 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:04:50.412337 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:04:50.412337 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:04:50.412337 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:04:50.412337 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:04:50.412337 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:04:50.413270 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:04:50.413270 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application with Lock( Sep 05 12:04:50.413270 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:04:50.413270 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:04:50.413270 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:04:50.413270 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:04:50.413270 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:04:50.413270 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:04:50.413270 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:04:50.413270 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:04:50.413270 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 05 12:04:50.413270 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 12:04:50.413270 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 05 12:04:50.413270 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:04:50.413270 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 514/1019] 10.222.0.50 () {56 vars in 1105 bytes} [Mon Sep 5 12:04:50 2022] GET /identity/v3/services/image => generated 86 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:04:50.420525 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efa5f4d-7665-4bf3-a982-07db6b5a8263 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:50.492586 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:50.552602 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efa5f4d-7665-4bf3-a982-07db6b5a8263 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:50.579215 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c26095c-e55a-48bb-9e29-6a0b4a16fe4a None None] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:50.579505 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c26095c-e55a-48bb-9e29-6a0b4a16fe4a None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:50.579774 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c26095c-e55a-48bb-9e29-6a0b4a16fe4a None None] PATH_INFO: `/` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:50.581156 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 515/1020] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:04:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 12:04:50.586895 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c033175-d15d-4c05-ad81-b7fd36b77baf None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:50.587178 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c033175-d15d-4c05-ad81-b7fd36b77baf None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:50.587444 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c033175-d15d-4c05-ad81-b7fd36b77baf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:50.594214 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9d6e12-f818-414e-bde8-da78ddb67c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:50.595056 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9d6e12-f818-414e-bde8-da78ddb67c9b None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:50.595334 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9d6e12-f818-414e-bde8-da78ddb67c9b None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:50.596510 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9d6e12-f818-414e-bde8-da78ddb67c9b None admin] PATH_INFO: `/v3/services` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:50.597198 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9d6e12-f818-414e-bde8-da78ddb67c9b None admin] RBAC: Adding query filter params (name=image) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:50.597502 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9d6e12-f818-414e-bde8-da78ddb67c9b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:50.598904 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9d6e12-f818-414e-bde8-da78ddb67c9b None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:50.605385 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 506/1021] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 5 12:04:50 2022] GET /identity/v3/services?name=image => generated 122 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:04:50.606768 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-5c033175-d15d-4c05-ad81-b7fd36b77baf None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:04:50.608039 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-5c033175-d15d-4c05-ad81-b7fd36b77baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:04:50.611626 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9d6e12-f818-414e-bde8-da78ddb67c9b None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:50.682363 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 516/1022] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:04:50 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 05 12:04:50.727403 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9d6e12-f818-414e-bde8-da78ddb67c9b None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:50.750983 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:50.770549 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99528365-d9ea-452a-aeb6-1ab2049dca09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:50.771158 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99528365-d9ea-452a-aeb6-1ab2049dca09 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:50.771434 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99528365-d9ea-452a-aeb6-1ab2049dca09 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:50.771702 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99528365-d9ea-452a-aeb6-1ab2049dca09 None admin] PATH_INFO: `/v3/services` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:50.772331 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99528365-d9ea-452a-aeb6-1ab2049dca09 None admin] RBAC: Adding query filter params (type=image) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:50.772627 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99528365-d9ea-452a-aeb6-1ab2049dca09 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:50.774302 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99528365-d9ea-452a-aeb6-1ab2049dca09 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:50.785059 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 507/1023] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 5 12:04:50 2022] GET /identity/v3/services?type=image => generated 350 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:04:50.787630 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c033175-d15d-4c05-ad81-b7fd36b77baf None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:50.829547 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:50.910463 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c033175-d15d-4c05-ad81-b7fd36b77baf None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:50.955693 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99528365-d9ea-452a-aeb6-1ab2049dca09 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:50.965423 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42264603-31e1-4cf0-90b8-756af4641b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:50.966431 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42264603-31e1-4cf0-90b8-756af4641b0b None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:50.966796 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42264603-31e1-4cf0-90b8-756af4641b0b None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:50.967167 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42264603-31e1-4cf0-90b8-756af4641b0b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:50.967964 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42264603-31e1-4cf0-90b8-756af4641b0b None admin] RBAC: Adding query filter params (interface=public, service_id=d530538e289144b0a909b61d20e5fcd7, region_id=RegionOne) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:50.968438 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42264603-31e1-4cf0-90b8-756af4641b0b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:50.971289 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42264603-31e1-4cf0-90b8-756af4641b0b None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:50.977656 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 517/1024] 10.222.0.50 () {56 vars in 1251 bytes} [Mon Sep 5 12:04:50 2022] GET /identity/v3/endpoints?service_id=d530538e289144b0a909b61d20e5fcd7&interface=public®ion_id=RegionOne => generated 194 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:04:50.983493 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42264603-31e1-4cf0-90b8-756af4641b0b None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:51.107258 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:51.111622 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42264603-31e1-4cf0-90b8-756af4641b0b None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:51.119747 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99528365-d9ea-452a-aeb6-1ab2049dca09 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:51.160084 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500f3a5b-ddf4-4e8f-b4e5-515d350de698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:51.161114 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500f3a5b-ddf4-4e8f-b4e5-515d350de698 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:51.161244 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33d08c7-8538-48d3-9c30-950254a1bb4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:51.161674 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500f3a5b-ddf4-4e8f-b4e5-515d350de698 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:51.161792 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33d08c7-8538-48d3-9c30-950254a1bb4e None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:51.162185 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500f3a5b-ddf4-4e8f-b4e5-515d350de698 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:51.162309 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33d08c7-8538-48d3-9c30-950254a1bb4e None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:51.162628 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33d08c7-8538-48d3-9c30-950254a1bb4e None admin] PATH_INFO: `/v3/services` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:51.163420 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33d08c7-8538-48d3-9c30-950254a1bb4e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:51.164033 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500f3a5b-ddf4-4e8f-b4e5-515d350de698 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:51.165650 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500f3a5b-ddf4-4e8f-b4e5-515d350de698 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:51.166307 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33d08c7-8538-48d3-9c30-950254a1bb4e None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:51.168525 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 508/1025] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 5 12:04:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:04:51.175685 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 518/1026] 10.222.0.50 () {56 vars in 1087 bytes} [Mon Sep 5 12:04:50 2022] GET /identity/v3/services => generated 1957 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:04:51.176391 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500f3a5b-ddf4-4e8f-b4e5-515d350de698 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:51.290375 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:51.370520 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500f3a5b-ddf4-4e8f-b4e5-515d350de698 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:51.412933 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70362535-0340-4c58-9c6b-bb383f475cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:51.413641 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70362535-0340-4c58-9c6b-bb383f475cbe None admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:51.414046 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70362535-0340-4c58-9c6b-bb383f475cbe None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:51.414452 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70362535-0340-4c58-9c6b-bb383f475cbe None admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:51.415243 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70362535-0340-4c58-9c6b-bb383f475cbe None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:51.416952 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70362535-0340-4c58-9c6b-bb383f475cbe None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:51.451030 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 509/1027] 10.222.0.50 () {60 vars in 1141 bytes} [Mon Sep 5 12:04:51 2022] POST /identity/v3/projects => generated 311 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:04:52.310685 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35756a75-9200-4049-9287-41d1deda27c2 None None] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:52.311429 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35756a75-9200-4049-9287-41d1deda27c2 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:52.311722 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35756a75-9200-4049-9287-41d1deda27c2 None None] PATH_INFO: `/` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:52.314371 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 519/1028] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:04:52 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:04:52.322821 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96ac270-2db3-4145-b08d-df88337697d1 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:52.323519 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96ac270-2db3-4145-b08d-df88337697d1 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:52.323810 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96ac270-2db3-4145-b08d-df88337697d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:52.354031 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-a96ac270-2db3-4145-b08d-df88337697d1 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:04:52.356012 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-a96ac270-2db3-4145-b08d-df88337697d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:04:52.480849 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 510/1029] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:04:52 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 05 12:04:52.961573 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35756a75-9200-4049-9287-41d1deda27c2 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:53.157849 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35756a75-9200-4049-9287-41d1deda27c2 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:53.221998 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58007f8a-8ef7-46eb-a7e6-46df01bfb0e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:53.223062 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58007f8a-8ef7-46eb-a7e6-46df01bfb0e2 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:53.223535 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58007f8a-8ef7-46eb-a7e6-46df01bfb0e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:53.223976 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58007f8a-8ef7-46eb-a7e6-46df01bfb0e2 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:53.243917 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58007f8a-8ef7-46eb-a7e6-46df01bfb0e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:04:53.253772 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application [None req-58007f8a-8ef7-46eb-a7e6-46df01bfb0e2 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 05 12:04:53.253772 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:53.253772 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:04:53.253772 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:04:53.253772 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:04:53.253772 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:04:53.253772 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:04:53.253772 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:04:53.253772 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:04:53.253772 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:04:53.253772 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:04:53.253772 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:04:53.253772 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:04:53.253772 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:04:53.253772 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:04:53.253772 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:04:53.255720 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:04:53.255720 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:04:53.255720 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:04:53.255720 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:04:53.255720 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:04:53.255720 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:04:53.255720 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:04:53.255720 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:04:53.255720 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:04:53.255720 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:04:53.255720 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:04:53.255720 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application with Lock( Sep 05 12:04:53.255720 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:04:53.255720 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:04:53.255720 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:04:53.255720 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:04:53.258172 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:04:53.258172 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:04:53.258172 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:04:53.258172 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:04:53.258172 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:04:53.258172 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:04:53.258172 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:04:53.258172 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:04:53.258172 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:04:53.258172 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:04:53.258172 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 05 12:04:53.258172 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:04:53.261343 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 520/1030] 10.222.0.50 () {56 vars in 1120 bytes} [Mon Sep 5 12:04:52 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:04:53.265293 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96ac270-2db3-4145-b08d-df88337697d1 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:53.330070 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:53.450409 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab670634-6fb6-4630-9ffb-a976b8f0baf4 None None] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:53.451211 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab670634-6fb6-4630-9ffb-a976b8f0baf4 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:53.451398 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab670634-6fb6-4630-9ffb-a976b8f0baf4 None None] PATH_INFO: `/` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:53.455006 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 521/1031] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:04:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 12:04:53.458660 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96ac270-2db3-4145-b08d-df88337697d1 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:53.464284 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efab6da4-42dd-49b9-adca-57771a37af81 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:53.464787 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efab6da4-42dd-49b9-adca-57771a37af81 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:53.465334 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efab6da4-42dd-49b9-adca-57771a37af81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:53.498403 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-efab6da4-42dd-49b9-adca-57771a37af81 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:04:53.499534 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd096391-60fb-45e2-a39c-27efeef25222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:53.500155 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd096391-60fb-45e2-a39c-27efeef25222 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:53.500433 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd096391-60fb-45e2-a39c-27efeef25222 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:53.500594 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-efab6da4-42dd-49b9-adca-57771a37af81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:04:53.500746 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd096391-60fb-45e2-a39c-27efeef25222 None admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:53.501391 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd096391-60fb-45e2-a39c-27efeef25222 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:53.501683 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd096391-60fb-45e2-a39c-27efeef25222 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:53.503082 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd096391-60fb-45e2-a39c-27efeef25222 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:53.513409 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 511/1032] 10.222.0.50 () {56 vars in 1115 bytes} [Mon Sep 5 12:04:53 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:04:53.522209 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd096391-60fb-45e2-a39c-27efeef25222 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:53.536202 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:53.610358 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 522/1033] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:04:53 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 12:04:53.697610 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:53.704088 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd096391-60fb-45e2-a39c-27efeef25222 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:53.769260 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f128441a-a5be-4886-84c2-3c26c48d236b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:53.770361 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f128441a-a5be-4886-84c2-3c26c48d236b None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:53.770853 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f128441a-a5be-4886-84c2-3c26c48d236b None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:53.771341 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f128441a-a5be-4886-84c2-3c26c48d236b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:53.792000 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f128441a-a5be-4886-84c2-3c26c48d236b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:53.794721 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f128441a-a5be-4886-84c2-3c26c48d236b None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:53.823404 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-f128441a-a5be-4886-84c2-3c26c48d236b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:04:53.823404 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:53.823404 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:04:53.823404 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:04:53.823404 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:04:53.823404 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:04:53.823404 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:04:53.823404 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:04:53.823404 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:04:53.823404 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:04:53.823404 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:04:53.823404 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:04:53.823404 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:04:53.823404 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:04:53.823404 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:04:53.823404 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:04:53.824434 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:04:53.824434 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:04:53.824434 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:04:53.824434 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:04:53.824434 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:04:53.824434 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:04:53.824434 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:04:53.824434 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:04:53.824434 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:04:53.824434 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:04:53.824434 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:04:53.824434 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:04:53.824434 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:04:53.824434 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:04:53.824434 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:04:53.824434 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:04:53.824434 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:04:53.825388 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:04:53.825388 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:04:53.825388 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:04:53.829294 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 512/1034] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 5 12:04:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:04:53.834106 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efab6da4-42dd-49b9-adca-57771a37af81 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:53.953755 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efab6da4-42dd-49b9-adca-57771a37af81 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:53.993456 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c044472-54ed-482a-bb42-5486317f938f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:53.994810 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c044472-54ed-482a-bb42-5486317f938f None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:53.995289 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c044472-54ed-482a-bb42-5486317f938f None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:53.995696 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c044472-54ed-482a-bb42-5486317f938f None admin] PATH_INFO: `/v3/domains` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:53.996531 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c044472-54ed-482a-bb42-5486317f938f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:53.997014 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c044472-54ed-482a-bb42-5486317f938f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:53.998582 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c044472-54ed-482a-bb42-5486317f938f None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:54.012371 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 523/1035] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 5 12:04:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:04:54.018028 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f128441a-a5be-4886-84c2-3c26c48d236b None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:54.064655 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c044472-54ed-482a-bb42-5486317f938f None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:54.082889 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:54.150741 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f128441a-a5be-4886-84c2-3c26c48d236b None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:54.203078 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c044472-54ed-482a-bb42-5486317f938f None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:54.209347 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ba319f-0386-4934-9c98-d997d97c862a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:54.209811 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ba319f-0386-4934-9c98-d997d97c862a None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:54.210095 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ba319f-0386-4934-9c98-d997d97c862a None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:54.210456 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ba319f-0386-4934-9c98-d997d97c862a None admin] PATH_INFO: `/v3/users/nova` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:54.219270 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ba319f-0386-4934-9c98-d997d97c862a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:54.220770 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ba319f-0386-4934-9c98-d997d97c862a None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:54.232497 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-f4ba319f-0386-4934-9c98-d997d97c862a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 05 12:04:54.232497 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:54.232497 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:04:54.232497 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:04:54.232497 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:04:54.232497 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:04:54.232497 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:04:54.232497 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:04:54.232497 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:04:54.232497 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:04:54.232497 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:04:54.232497 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:04:54.232497 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 12:04:54.232497 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 12:04:54.232497 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 12:04:54.232497 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 12:04:54.233732 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:04:54.233732 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:04:54.233732 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 12:04:54.233732 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:04:54.233732 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 12:04:54.233732 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:04:54.233732 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:04:54.233732 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:04:54.233732 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:04:54.233732 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:04:54.233732 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:04:54.233732 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:04:54.233732 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:04:54.233732 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:04:54.233732 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:04:54.233732 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:04:54.233732 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:04:54.233732 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:04:54.235102 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:04:54.235102 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:04:54.235102 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 12:04:54.235102 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 12:04:54.235102 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 12:04:54.235102 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 12:04:54.235102 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 12:04:54.235102 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 12:04:54.235102 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 05 12:04:54.235102 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:04:54.235102 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 513/1036] 10.222.0.50 () {56 vars in 1093 bytes} [Mon Sep 5 12:04:54 2022] GET /identity/v3/users/nova => generated 82 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 12:04:54.235102 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1925cd48-4ad4-49ec-9047-044c81d55321 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:54.236371 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1925cd48-4ad4-49ec-9047-044c81d55321 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:54.236371 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1925cd48-4ad4-49ec-9047-044c81d55321 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:54.237131 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 514/1037] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:04:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:04:54.243951 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1925cd48-4ad4-49ec-9047-044c81d55321 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:54.250002 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eab15a-0aec-4747-9df0-a163ab76a964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:54.250649 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eab15a-0aec-4747-9df0-a163ab76a964 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:54.250934 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eab15a-0aec-4747-9df0-a163ab76a964 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:54.251204 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eab15a-0aec-4747-9df0-a163ab76a964 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:54.252417 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00eab15a-0aec-4747-9df0-a163ab76a964 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:54.253918 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00eab15a-0aec-4747-9df0-a163ab76a964 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:54.255567 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 524/1038] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 5 12:04:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:04:54.255567 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb532c18-5274-4e14-b651-187aa1bea2ef None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:54.255567 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb532c18-5274-4e14-b651-187aa1bea2ef None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:54.255567 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb532c18-5274-4e14-b651-187aa1bea2ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:54.262274 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:54.277485 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-cb532c18-5274-4e14-b651-187aa1bea2ef None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:04:54.278705 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-cb532c18-5274-4e14-b651-187aa1bea2ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:04:54.352755 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 525/1039] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:04:54 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 12:04:54.354279 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb532c18-5274-4e14-b651-187aa1bea2ef None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:54.367422 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1925cd48-4ad4-49ec-9047-044c81d55321 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:54.371492 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:54.430276 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9677f42-85a0-4ec5-bf61-9e212fa02ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:54.430904 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9677f42-85a0-4ec5-bf61-9e212fa02ed4 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:54.431218 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9677f42-85a0-4ec5-bf61-9e212fa02ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:54.431508 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9677f42-85a0-4ec5-bf61-9e212fa02ed4 None admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:54.432185 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9677f42-85a0-4ec5-bf61-9e212fa02ed4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:54.432562 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9677f42-85a0-4ec5-bf61-9e212fa02ed4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:54.434008 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9677f42-85a0-4ec5-bf61-9e212fa02ed4 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:54.455045 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 515/1040] 10.222.0.50 () {56 vars in 1133 bytes} [Mon Sep 5 12:04:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:04:54.464671 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9677f42-85a0-4ec5-bf61-9e212fa02ed4 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:54.495126 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb532c18-5274-4e14-b651-187aa1bea2ef None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:54.553312 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7a745f-cd91-46e2-8629-327c0856f75a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:54.554353 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7a745f-cd91-46e2-8629-327c0856f75a None admin] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:54.554872 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7a745f-cd91-46e2-8629-327c0856f75a None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:54.555311 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7a745f-cd91-46e2-8629-327c0856f75a None admin] PATH_INFO: `/v3/users` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:54.557104 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7a745f-cd91-46e2-8629-327c0856f75a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:54.560120 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7a745f-cd91-46e2-8629-327c0856f75a None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:54.570878 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:54.597266 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 526/1041] 10.222.0.50 () {60 vars in 1132 bytes} [Mon Sep 5 12:04:54 2022] POST /identity/v3/users => generated 285 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:04:54.621429 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7a745f-cd91-46e2-8629-327c0856f75a None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:54.635611 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9677f42-85a0-4ec5-bf61-9e212fa02ed4 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:54.685133 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f12524-73c7-48d3-8dec-1c78a00c23ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:54.686393 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f12524-73c7-48d3-8dec-1c78a00c23ce None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:54.686795 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f12524-73c7-48d3-8dec-1c78a00c23ce None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:54.687104 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f12524-73c7-48d3-8dec-1c78a00c23ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:54.704365 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:54.750806 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7a745f-cd91-46e2-8629-327c0856f75a None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:54.795153 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f12524-73c7-48d3-8dec-1c78a00c23ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:54.796212 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f12524-73c7-48d3-8dec-1c78a00c23ce None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:54.810101 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cad2643-2a9b-4cb1-83b4-2852809ee5e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:54.811269 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cad2643-2a9b-4cb1-83b4-2852809ee5e0 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:54.811924 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cad2643-2a9b-4cb1-83b4-2852809ee5e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:54.812206 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cad2643-2a9b-4cb1-83b4-2852809ee5e0 None admin] PATH_INFO: `/v3/services/image` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:54.812823 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cad2643-2a9b-4cb1-83b4-2852809ee5e0 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:54.814253 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cad2643-2a9b-4cb1-83b4-2852809ee5e0 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:54.825779 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application [None req-0cad2643-2a9b-4cb1-83b4-2852809ee5e0 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 05 12:04:54.825779 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:54.825779 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 05 12:04:54.825779 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 05 12:04:54.825779 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 05 12:04:54.825779 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 05 12:04:54.825779 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 05 12:04:54.825779 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 12:04:54.825779 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 05 12:04:54.825779 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:04:54.825779 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 12:04:54.825779 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:04:54.825779 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:54.825779 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:04:54.825779 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:04:54.825779 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:04:54.825779 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:04:54.828126 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:04:54.828126 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:04:54.828126 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:04:54.828126 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:04:54.828126 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:04:54.828126 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:04:54.828126 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 05 12:04:54.828126 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 05 12:04:54.828126 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 05 12:04:54.828126 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 05 12:04:54.828126 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:04:54.828126 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:04:54.828126 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:04:54.828126 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:04:54.828126 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:04:54.828126 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:04:54.830052 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:04:54.830052 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application with Lock( Sep 05 12:04:54.830052 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:04:54.830052 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:04:54.830052 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:04:54.830052 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:04:54.830052 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:04:54.830052 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:04:54.830052 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:04:54.830052 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:04:54.830052 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 05 12:04:54.830052 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 12:04:54.830052 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 05 12:04:54.830052 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:04:54.830052 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 527/1042] 10.222.0.50 () {56 vars in 1105 bytes} [Mon Sep 5 12:04:54 2022] GET /identity/v3/services/image => generated 86 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 12:04:54.834001 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cad2643-2a9b-4cb1-83b4-2852809ee5e0 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:54.892849 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:54.934223 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 516/1043] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Sep 5 12:04:54 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 05 12:04:54.939947 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f12524-73c7-48d3-8dec-1c78a00c23ce None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:54.979147 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cad2643-2a9b-4cb1-83b4-2852809ee5e0 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:55.013782 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:55.021377 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc7176e-ae93-4af4-bd5e-ed6e3d9db653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:55.021994 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc7176e-ae93-4af4-bd5e-ed6e3d9db653 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:55.022292 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc7176e-ae93-4af4-bd5e-ed6e3d9db653 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:55.022556 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc7176e-ae93-4af4-bd5e-ed6e3d9db653 None admin] PATH_INFO: `/v3/services` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:55.023466 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc7176e-ae93-4af4-bd5e-ed6e3d9db653 None admin] RBAC: Adding query filter params (name=image) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:55.023785 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc7176e-ae93-4af4-bd5e-ed6e3d9db653 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:55.025226 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc7176e-ae93-4af4-bd5e-ed6e3d9db653 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:55.030516 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 528/1044] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 5 12:04:54 2022] GET /identity/v3/services?name=image => generated 122 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:04:55.036754 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc7176e-ae93-4af4-bd5e-ed6e3d9db653 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:55.108413 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f12524-73c7-48d3-8dec-1c78a00c23ce None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:55.158513 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc7176e-ae93-4af4-bd5e-ed6e3d9db653 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:55.177560 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847a63d5-0f74-4074-b402-f5d265d5b0f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:55.178619 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847a63d5-0f74-4074-b402-f5d265d5b0f9 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:55.179121 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847a63d5-0f74-4074-b402-f5d265d5b0f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:55.179610 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847a63d5-0f74-4074-b402-f5d265d5b0f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:55.199707 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbfd772-49a5-447d-9850-b92da83a3a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:55.199948 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847a63d5-0f74-4074-b402-f5d265d5b0f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:55.200323 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbfd772-49a5-447d-9850-b92da83a3a96 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:55.200608 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbfd772-49a5-447d-9850-b92da83a3a96 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:55.200879 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbfd772-49a5-447d-9850-b92da83a3a96 None admin] PATH_INFO: `/v3/services` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:55.201544 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbfd772-49a5-447d-9850-b92da83a3a96 None admin] RBAC: Adding query filter params (type=image) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:55.201849 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbfd772-49a5-447d-9850-b92da83a3a96 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:55.202540 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847a63d5-0f74-4074-b402-f5d265d5b0f9 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:55.203210 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbfd772-49a5-447d-9850-b92da83a3a96 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:55.209165 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 529/1045] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 5 12:04:55 2022] GET /identity/v3/services?type=image => generated 350 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:04:55.214667 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbfd772-49a5-447d-9850-b92da83a3a96 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:55.229546 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-847a63d5-0f74-4074-b402-f5d265d5b0f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:04:55.229546 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:55.229546 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:04:55.229546 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:04:55.229546 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:04:55.229546 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:04:55.229546 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:04:55.229546 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:04:55.229546 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:04:55.229546 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:04:55.229546 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:04:55.229546 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:04:55.229546 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:04:55.229546 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:04:55.229546 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:04:55.229546 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:04:55.230751 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:04:55.230751 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:04:55.230751 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:04:55.230751 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:04:55.230751 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:04:55.230751 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:04:55.230751 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:04:55.230751 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:04:55.230751 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:04:55.230751 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:04:55.230751 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:04:55.230751 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:04:55.230751 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:04:55.230751 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:04:55.230751 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:04:55.230751 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:04:55.230751 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:04:55.231741 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:04:55.231741 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:04:55.231741 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:04:55.231741 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 517/1046] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 5 12:04:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 12:04:55.236863 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847a63d5-0f74-4074-b402-f5d265d5b0f9 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:55.265383 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:55.294907 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:55.344077 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbfd772-49a5-447d-9850-b92da83a3a96 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:55.378960 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847a63d5-0f74-4074-b402-f5d265d5b0f9 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:55.387688 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00195d6-43ff-412f-a84a-eb67a11cd997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:55.388478 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00195d6-43ff-412f-a84a-eb67a11cd997 None admin] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:55.389087 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00195d6-43ff-412f-a84a-eb67a11cd997 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:55.389478 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00195d6-43ff-412f-a84a-eb67a11cd997 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:55.390300 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00195d6-43ff-412f-a84a-eb67a11cd997 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:55.392272 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00195d6-43ff-412f-a84a-eb67a11cd997 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:55.427258 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af11fd12-0eee-4810-8f99-1a5823d80df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:55.427889 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af11fd12-0eee-4810-8f99-1a5823d80df8 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:55.428168 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af11fd12-0eee-4810-8f99-1a5823d80df8 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:55.428476 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af11fd12-0eee-4810-8f99-1a5823d80df8 None admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:55.429173 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 530/1047] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 5 12:04:55 2022] POST /identity/v3/endpoints => generated 327 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 12:04:55.429343 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af11fd12-0eee-4810-8f99-1a5823d80df8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:55.429506 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af11fd12-0eee-4810-8f99-1a5823d80df8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:55.430936 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af11fd12-0eee-4810-8f99-1a5823d80df8 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:55.449118 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 518/1048] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 5 12:04:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:04:55.457582 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00195d6-43ff-412f-a84a-eb67a11cd997 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:55.621077 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00195d6-43ff-412f-a84a-eb67a11cd997 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:55.638716 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:55.665892 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94737c8c-502b-4eb7-9635-1b74c126ad6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:55.666548 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94737c8c-502b-4eb7-9635-1b74c126ad6d None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:55.666995 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94737c8c-502b-4eb7-9635-1b74c126ad6d None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:55.667105 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94737c8c-502b-4eb7-9635-1b74c126ad6d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:55.675020 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94737c8c-502b-4eb7-9635-1b74c126ad6d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:55.676491 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94737c8c-502b-4eb7-9635-1b74c126ad6d None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:55.691790 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application [None req-94737c8c-502b-4eb7-9635-1b74c126ad6d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:04:55.691790 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:55.691790 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:04:55.691790 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:04:55.691790 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:04:55.691790 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:04:55.691790 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:04:55.691790 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:04:55.691790 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:04:55.691790 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:04:55.691790 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:04:55.691790 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:04:55.691790 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 12:04:55.691790 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 12:04:55.691790 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 12:04:55.692993 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 12:04:55.692993 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:04:55.692993 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:04:55.692993 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:04:55.692993 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:04:55.692993 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:04:55.692993 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:04:55.692993 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:04:55.692993 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application with Lock( Sep 05 12:04:55.692993 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:04:55.692993 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:04:55.692993 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:04:55.692993 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:04:55.692993 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:04:55.692993 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:04:55.692993 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:04:55.692993 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:04:55.694259 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 12:04:55.694259 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 12:04:55.694259 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 12:04:55.694259 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 12:04:55.694259 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 12:04:55.694259 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 12:04:55.694259 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:04:55.694259 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:04:55.694259 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 531/1049] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Sep 5 12:04:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:04:55.701654 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af11fd12-0eee-4810-8f99-1a5823d80df8 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:55.811601 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:55.851038 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af11fd12-0eee-4810-8f99-1a5823d80df8 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:55.905493 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1f64ad-ca71-4407-add8-f8f9d2bfd94a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:55.906315 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1f64ad-ca71-4407-add8-f8f9d2bfd94a None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:55.906731 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1f64ad-ca71-4407-add8-f8f9d2bfd94a None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:55.907138 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1f64ad-ca71-4407-add8-f8f9d2bfd94a None admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:55.908300 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1f64ad-ca71-4407-add8-f8f9d2bfd94a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:55.908816 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1f64ad-ca71-4407-add8-f8f9d2bfd94a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:55.911014 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1f64ad-ca71-4407-add8-f8f9d2bfd94a None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:55.932045 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 519/1050] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Sep 5 12:04:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:04:55.938203 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94737c8c-502b-4eb7-9635-1b74c126ad6d None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:56.127005 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94737c8c-502b-4eb7-9635-1b74c126ad6d None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:56.192634 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04922c85-d654-4c85-8152-ce3e5a49c28f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:56.194121 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04922c85-d654-4c85-8152-ce3e5a49c28f None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:56.194868 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04922c85-d654-4c85-8152-ce3e5a49c28f None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:56.195634 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04922c85-d654-4c85-8152-ce3e5a49c28f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:56.197737 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04922c85-d654-4c85-8152-ce3e5a49c28f None admin] RBAC: Adding query filter params (role.id=2ca407f96a3e417eac20298c6e80384e, scope.project.id=ae4f8939fcc040bca99783a77e6ede4d, user.id=cb060ff495bc4abb83ff88992fb7be09) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:56.198488 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04922c85-d654-4c85-8152-ce3e5a49c28f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:56.201716 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04922c85-d654-4c85-8152-ce3e5a49c28f None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:56.213085 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 532/1051] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Sep 5 12:04:55 2022] GET /identity/v3/role_assignments?user.id=cb060ff495bc4abb83ff88992fb7be09&scope.project.id=ae4f8939fcc040bca99783a77e6ede4d&role.id=2ca407f96a3e417eac20298c6e80384e => generated 259 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:04:56.701826 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df31e5d-205c-4ba7-8e78-362b11ae71f6 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:56.702651 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df31e5d-205c-4ba7-8e78-362b11ae71f6 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:56.702651 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df31e5d-205c-4ba7-8e78-362b11ae71f6 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:56.703981 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 520/1052] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:04:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 12:04:56.709776 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66d3fc3-7ad8-41e2-a22a-21c0a9774a3a None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:56.710523 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66d3fc3-7ad8-41e2-a22a-21c0a9774a3a None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:56.710523 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66d3fc3-7ad8-41e2-a22a-21c0a9774a3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:56.731054 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-e66d3fc3-7ad8-41e2-a22a-21c0a9774a3a None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:04:56.732278 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-e66d3fc3-7ad8-41e2-a22a-21c0a9774a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:04:56.773714 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:56.826339 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 533/1053] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:04:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 12:04:57.102123 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df31e5d-205c-4ba7-8e78-362b11ae71f6 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:57.224305 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df31e5d-205c-4ba7-8e78-362b11ae71f6 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:57.271439 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8b5b61-d8d9-496a-bf16-364ad67f0107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:57.272096 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8b5b61-d8d9-496a-bf16-364ad67f0107 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:57.272380 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8b5b61-d8d9-496a-bf16-364ad67f0107 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:57.272657 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8b5b61-d8d9-496a-bf16-364ad67f0107 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:57.277687 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:57.289513 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8b5b61-d8d9-496a-bf16-364ad67f0107 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:04:57.294588 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-3a8b5b61-d8d9-496a-bf16-364ad67f0107 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 12:04:57.294588 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:57.294588 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:04:57.294588 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:04:57.294588 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:04:57.294588 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:04:57.294588 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:04:57.294588 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:04:57.294588 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:04:57.294588 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:04:57.294588 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:04:57.294588 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:04:57.294588 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:04:57.294588 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:04:57.294588 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:04:57.294588 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:04:57.296367 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:04:57.296367 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:04:57.296367 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:04:57.296367 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:04:57.296367 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:04:57.296367 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:04:57.296367 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:04:57.296367 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:04:57.296367 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:04:57.296367 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:04:57.296367 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:04:57.296367 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:04:57.296367 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:04:57.296367 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:04:57.296367 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:04:57.296367 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:04:57.298094 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:04:57.298094 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:04:57.298094 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:04:57.298094 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:04:57.298094 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:04:57.298094 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:04:57.298094 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:04:57.298094 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:04:57.298094 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:04:57.298094 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:04:57.298094 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 12:04:57.298094 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:04:57.301139 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 521/1054] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Sep 5 12:04:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 12:04:57.302487 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66d3fc3-7ad8-41e2-a22a-21c0a9774a3a None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:57.426359 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66d3fc3-7ad8-41e2-a22a-21c0a9774a3a None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:57.466932 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5aff6f-e062-43b4-a94c-d9a61bec29aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:57.467559 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5aff6f-e062-43b4-a94c-d9a61bec29aa None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:57.467834 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5aff6f-e062-43b4-a94c-d9a61bec29aa None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:57.468105 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5aff6f-e062-43b4-a94c-d9a61bec29aa None admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:57.468807 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5aff6f-e062-43b4-a94c-d9a61bec29aa None admin] RBAC: Adding query filter params (name=admin) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:57.469226 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5aff6f-e062-43b4-a94c-d9a61bec29aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:57.470706 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5aff6f-e062-43b4-a94c-d9a61bec29aa None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:57.478078 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f051cd12-6204-4abc-9314-1aedab2d24cd None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:57.478741 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f051cd12-6204-4abc-9314-1aedab2d24cd None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:57.479219 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f051cd12-6204-4abc-9314-1aedab2d24cd None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:57.480944 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 534/1055] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Sep 5 12:04:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:04:57.481923 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 522/1056] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:04:57 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:04:57.487712 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd467b7-4e2e-4404-af2b-02184b96bbfc None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:57.488019 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd467b7-4e2e-4404-af2b-02184b96bbfc None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:57.488266 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd467b7-4e2e-4404-af2b-02184b96bbfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:57.492424 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f051cd12-6204-4abc-9314-1aedab2d24cd None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:57.507551 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-bcd467b7-4e2e-4404-af2b-02184b96bbfc None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:04:57.508753 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-bcd467b7-4e2e-4404-af2b-02184b96bbfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:04:57.548174 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:57.618730 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 535/1057] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:04:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 05 12:04:57.643367 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f051cd12-6204-4abc-9314-1aedab2d24cd None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:57.704502 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2cd9f4-837c-41b6-bb0c-7115f6c8425d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:57.705519 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2cd9f4-837c-41b6-bb0c-7115f6c8425d None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:57.705965 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2cd9f4-837c-41b6-bb0c-7115f6c8425d None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:57.706438 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2cd9f4-837c-41b6-bb0c-7115f6c8425d None admin] PATH_INFO: `/v3/users/36fc0625e9014df282053e2cc88f2f4b` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:57.730801 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2cd9f4-837c-41b6-bb0c-7115f6c8425d None admin] RBAC: Authorizing `identity:get_user(user_id=36fc0625e9014df282053e2cc88f2f4b)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:57.733404 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2cd9f4-837c-41b6-bb0c-7115f6c8425d None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:57.736531 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 523/1058] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Sep 5 12:04:57 2022] GET /identity/v3/users/36fc0625e9014df282053e2cc88f2f4b => generated 285 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:04:57.745254 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd467b7-4e2e-4404-af2b-02184b96bbfc None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:57.891551 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd467b7-4e2e-4404-af2b-02184b96bbfc None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:57.905741 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2cd9f4-837c-41b6-bb0c-7115f6c8425d None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:57.953157 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47e6793-1ef8-4638-9787-72ba9508f965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:57.954196 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e6793-1ef8-4638-9787-72ba9508f965 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:57.954738 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e6793-1ef8-4638-9787-72ba9508f965 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:57.955168 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e6793-1ef8-4638-9787-72ba9508f965 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:57.964538 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:58.002207 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:58.016311 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2cd9f4-837c-41b6-bb0c-7115f6c8425d None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:58.057622 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61f16fc-f4df-42f6-9a8b-3ee6317527ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:58.059199 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61f16fc-f4df-42f6-9a8b-3ee6317527ac None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:58.059679 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61f16fc-f4df-42f6-9a8b-3ee6317527ac None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:58.060146 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61f16fc-f4df-42f6-9a8b-3ee6317527ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:58.063356 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47e6793-1ef8-4638-9787-72ba9508f965 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:58.066090 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47e6793-1ef8-4638-9787-72ba9508f965 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:58.154702 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61f16fc-f4df-42f6-9a8b-3ee6317527ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:58.157098 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61f16fc-f4df-42f6-9a8b-3ee6317527ac None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:58.205059 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 536/1059] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Sep 5 12:04:57 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 05 12:04:58.211423 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47e6793-1ef8-4638-9787-72ba9508f965 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:58.242117 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:58.305527 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:58.310953 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 524/1060] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Sep 5 12:04:57 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 05 12:04:58.311797 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61f16fc-f4df-42f6-9a8b-3ee6317527ac None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:58.352525 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47e6793-1ef8-4638-9787-72ba9508f965 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:58.398974 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7badcd-13df-4d04-994c-8b5179a21ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:58.399309 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7badcd-13df-4d04-994c-8b5179a21ede None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:58.399594 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7badcd-13df-4d04-994c-8b5179a21ede None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:58.399866 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7badcd-13df-4d04-994c-8b5179a21ede None admin] PATH_INFO: `/v3/projects/b81d447cd35f410fb625816a1b953eaf` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:58.401589 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7badcd-13df-4d04-994c-8b5179a21ede None admin] RBAC: Authorizing `identity:get_project(project_id=b81d447cd35f410fb625816a1b953eaf)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:58.403064 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7badcd-13df-4d04-994c-8b5179a21ede None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:58.404925 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 537/1061] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Sep 5 12:04:58 2022] GET /identity/v3/projects/b81d447cd35f410fb625816a1b953eaf => generated 311 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:04:58.415017 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7badcd-13df-4d04-994c-8b5179a21ede None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:58.454475 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61f16fc-f4df-42f6-9a8b-3ee6317527ac None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:58.492654 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33992662-4cf0-47a9-9703-cb29753273b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:58.493346 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33992662-4cf0-47a9-9703-cb29753273b5 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:58.493627 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33992662-4cf0-47a9-9703-cb29753273b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:58.493943 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33992662-4cf0-47a9-9703-cb29753273b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:58.505035 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33992662-4cf0-47a9-9703-cb29753273b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:58.506535 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33992662-4cf0-47a9-9703-cb29753273b5 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:58.524361 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-33992662-4cf0-47a9-9703-cb29753273b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:04:58.524361 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:58.524361 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:04:58.524361 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:04:58.524361 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:04:58.524361 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:04:58.524361 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:04:58.524361 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:04:58.524361 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:04:58.524361 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:04:58.524361 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:04:58.524361 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:04:58.524361 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:04:58.524361 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:04:58.524361 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:04:58.524361 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:04:58.526109 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:04:58.526109 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:04:58.526109 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:04:58.526109 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:04:58.526109 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:04:58.526109 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:04:58.526109 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:04:58.526109 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:04:58.526109 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:04:58.526109 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:04:58.526109 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:04:58.526109 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:04:58.526109 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:04:58.526109 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:04:58.526109 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:04:58.526109 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:04:58.526109 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:04:58.527018 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:04:58.527018 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:04:58.527018 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:04:58.527018 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 525/1062] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 5 12:04:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:04:58.536112 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33992662-4cf0-47a9-9703-cb29753273b5 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:58.552444 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:58.579877 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7badcd-13df-4d04-994c-8b5179a21ede None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:58.612087 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:58.626032 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45414d75-4b3b-4b03-a29d-dafc427d3fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:58.627071 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45414d75-4b3b-4b03-a29d-dafc427d3fcf None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:58.627566 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45414d75-4b3b-4b03-a29d-dafc427d3fcf None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:58.628106 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45414d75-4b3b-4b03-a29d-dafc427d3fcf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:58.629471 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45414d75-4b3b-4b03-a29d-dafc427d3fcf None admin] RBAC: Adding query filter params (role.id=16e2ccc8bd1b497d8cee780c1c7df0d2, scope.project.id=b81d447cd35f410fb625816a1b953eaf, user.id=36fc0625e9014df282053e2cc88f2f4b) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:58.630019 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45414d75-4b3b-4b03-a29d-dafc427d3fcf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:58.632681 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45414d75-4b3b-4b03-a29d-dafc427d3fcf None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:58.644185 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 538/1063] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Sep 5 12:04:58 2022] GET /identity/v3/role_assignments?user.id=36fc0625e9014df282053e2cc88f2f4b&scope.project.id=b81d447cd35f410fb625816a1b953eaf&role.id=16e2ccc8bd1b497d8cee780c1c7df0d2 => generated 259 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:04:58.672996 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33992662-4cf0-47a9-9703-cb29753273b5 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:58.696098 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eccb38e-bf41-427d-9101-5b20e401e9b4 None None] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:58.696378 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eccb38e-bf41-427d-9101-5b20e401e9b4 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:58.696645 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eccb38e-bf41-427d-9101-5b20e401e9b4 None None] PATH_INFO: `/` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:58.698121 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 539/1064] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:04:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 12:04:58.703627 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d57b1ed-ff9d-4737-90e0-d87a8825ba80 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:58.703920 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d57b1ed-ff9d-4737-90e0-d87a8825ba80 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:58.704189 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d57b1ed-ff9d-4737-90e0-d87a8825ba80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:58.714034 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3833b952-4d9d-4cc0-9b84-26678aa9f530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:58.715343 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3833b952-4d9d-4cc0-9b84-26678aa9f530 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:58.715813 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3833b952-4d9d-4cc0-9b84-26678aa9f530 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:58.716274 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3833b952-4d9d-4cc0-9b84-26678aa9f530 None admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:58.717199 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3833b952-4d9d-4cc0-9b84-26678aa9f530 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:58.717857 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3833b952-4d9d-4cc0-9b84-26678aa9f530 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:58.719316 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3833b952-4d9d-4cc0-9b84-26678aa9f530 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:58.723750 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-1d57b1ed-ff9d-4737-90e0-d87a8825ba80 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:04:58.725012 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-1d57b1ed-ff9d-4737-90e0-d87a8825ba80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:04:58.734367 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 526/1065] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 5 12:04:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:04:58.820010 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 540/1066] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:04:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 05 12:04:59.097583 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3833b952-4d9d-4cc0-9b84-26678aa9f530 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:59.168077 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:59.205101 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3833b952-4d9d-4cc0-9b84-26678aa9f530 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:59.241737 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0098935-8883-45db-b548-3bf088027b7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:59.242384 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0098935-8883-45db-b548-3bf088027b7b None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:59.242667 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0098935-8883-45db-b548-3bf088027b7b None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:59.242943 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0098935-8883-45db-b548-3bf088027b7b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:59.253671 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0098935-8883-45db-b548-3bf088027b7b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:04:59.258537 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-d0098935-8883-45db-b548-3bf088027b7b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 05 12:04:59.258537 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:59.258537 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:04:59.258537 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:04:59.258537 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:04:59.258537 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:04:59.258537 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:04:59.258537 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:04:59.258537 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:04:59.258537 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:04:59.258537 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:04:59.258537 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:04:59.258537 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:04:59.258537 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:04:59.258537 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:04:59.258537 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:04:59.260517 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:04:59.260517 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:04:59.260517 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:04:59.260517 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:04:59.260517 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:04:59.260517 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:04:59.260517 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:04:59.260517 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:04:59.260517 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:04:59.260517 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:04:59.260517 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:04:59.260517 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:04:59.260517 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:04:59.260517 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:04:59.260517 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:04:59.260517 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:04:59.262447 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:04:59.262447 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:04:59.262447 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:04:59.262447 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:04:59.262447 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:04:59.262447 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:04:59.262447 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:04:59.262447 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:04:59.262447 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:04:59.262447 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:04:59.262447 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 05 12:04:59.262447 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:04:59.262447 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 527/1067] 10.222.0.50 () {56 vars in 1120 bytes} [Mon Sep 5 12:04:59 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:04:59.265862 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d57b1ed-ff9d-4737-90e0-d87a8825ba80 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:59.372986 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d57b1ed-ff9d-4737-90e0-d87a8825ba80 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:59.397099 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:59.411326 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80166d37-2c55-4343-af35-cd089083572a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:59.411951 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80166d37-2c55-4343-af35-cd089083572a None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:59.412233 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80166d37-2c55-4343-af35-cd089083572a None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:59.412506 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80166d37-2c55-4343-af35-cd089083572a None admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:59.413224 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80166d37-2c55-4343-af35-cd089083572a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:59.413532 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80166d37-2c55-4343-af35-cd089083572a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:59.414907 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80166d37-2c55-4343-af35-cd089083572a None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:59.423521 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 541/1068] 10.222.0.50 () {56 vars in 1115 bytes} [Mon Sep 5 12:04:59 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:04:59.429533 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0098935-8883-45db-b548-3bf088027b7b None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:59.533892 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0098935-8883-45db-b548-3bf088027b7b None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:59.561061 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:04:59.571087 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915f3db5-4785-4dff-a824-9dd84137dd6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:59.571734 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915f3db5-4785-4dff-a824-9dd84137dd6b None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:59.572547 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915f3db5-4785-4dff-a824-9dd84137dd6b None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:59.572819 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915f3db5-4785-4dff-a824-9dd84137dd6b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:59.583845 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915f3db5-4785-4dff-a824-9dd84137dd6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:59.585358 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915f3db5-4785-4dff-a824-9dd84137dd6b None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:59.601904 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-915f3db5-4785-4dff-a824-9dd84137dd6b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:04:59.601904 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:59.601904 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:04:59.601904 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:04:59.601904 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:04:59.601904 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:04:59.601904 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:04:59.601904 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:04:59.601904 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:04:59.601904 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:04:59.601904 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:04:59.601904 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:04:59.601904 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:04:59.601904 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:04:59.601904 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:04:59.601904 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:04:59.603061 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:04:59.603061 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:04:59.603061 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:04:59.603061 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:04:59.603061 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:04:59.603061 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:04:59.603061 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:04:59.603061 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:04:59.603061 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:04:59.603061 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:04:59.603061 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:04:59.603061 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:04:59.603061 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:04:59.603061 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:04:59.603061 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:04:59.603061 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:04:59.603061 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:04:59.605638 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:04:59.605638 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:04:59.605638 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:04:59.605638 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 528/1069] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 5 12:04:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 12:04:59.609617 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80166d37-2c55-4343-af35-cd089083572a None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:59.718616 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80166d37-2c55-4343-af35-cd089083572a None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:59.753778 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413ed594-baeb-490a-870a-771839f14f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:59.754393 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413ed594-baeb-490a-870a-771839f14f04 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:59.754671 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413ed594-baeb-490a-870a-771839f14f04 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:59.754942 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413ed594-baeb-490a-870a-771839f14f04 None admin] PATH_INFO: `/v3/domains` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:59.755589 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413ed594-baeb-490a-870a-771839f14f04 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:04:59.755931 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413ed594-baeb-490a-870a-771839f14f04 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:59.757347 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413ed594-baeb-490a-870a-771839f14f04 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:59.776337 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 542/1070] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 5 12:04:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:04:59.777684 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915f3db5-4785-4dff-a824-9dd84137dd6b None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:04:59.888119 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915f3db5-4785-4dff-a824-9dd84137dd6b None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:04:59.924041 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268003f5-78d6-4ed9-b49b-36f86117995e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:04:59.924678 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268003f5-78d6-4ed9-b49b-36f86117995e None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:04:59.925026 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268003f5-78d6-4ed9-b49b-36f86117995e None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:04:59.925286 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268003f5-78d6-4ed9-b49b-36f86117995e None admin] PATH_INFO: `/v3/users/nova` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:04:59.933628 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268003f5-78d6-4ed9-b49b-36f86117995e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:04:59.935088 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268003f5-78d6-4ed9-b49b-36f86117995e None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:04:59.947848 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-268003f5-78d6-4ed9-b49b-36f86117995e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 05 12:04:59.947848 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:04:59.947848 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:04:59.947848 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:04:59.947848 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:04:59.947848 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:04:59.947848 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:04:59.947848 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:04:59.947848 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:04:59.947848 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:04:59.947848 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:04:59.947848 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:04:59.947848 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 12:04:59.947848 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 12:04:59.947848 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 12:04:59.947848 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 12:04:59.949962 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:04:59.949962 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:04:59.949962 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 12:04:59.949962 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:04:59.949962 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 12:04:59.949962 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:04:59.949962 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:04:59.949962 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:04:59.949962 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:04:59.949962 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:04:59.949962 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:04:59.949962 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:04:59.949962 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:04:59.949962 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:04:59.949962 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:04:59.949962 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:04:59.949962 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:04:59.949962 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:04:59.951951 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:04:59.951951 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:04:59.951951 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 12:04:59.951951 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 12:04:59.951951 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 12:04:59.951951 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 12:04:59.951951 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 12:04:59.951951 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 12:04:59.951951 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 05 12:04:59.951951 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:04:59.951951 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 529/1071] 10.222.0.50 () {56 vars in 1093 bytes} [Mon Sep 5 12:04:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:04:59.954970 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413ed594-baeb-490a-870a-771839f14f04 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:05:00.002489 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:05:00.061718 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413ed594-baeb-490a-870a-771839f14f04 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:05:00.102919 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e829bfc-7473-4dae-981f-16e1d2d58bde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:05:00.104584 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e829bfc-7473-4dae-981f-16e1d2d58bde None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:05:00.104870 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e829bfc-7473-4dae-981f-16e1d2d58bde None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:05:00.105245 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e829bfc-7473-4dae-981f-16e1d2d58bde None admin] PATH_INFO: `/v3/users` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:05:00.106134 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e829bfc-7473-4dae-981f-16e1d2d58bde None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:05:00.106509 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e829bfc-7473-4dae-981f-16e1d2d58bde None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:05:00.108012 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e829bfc-7473-4dae-981f-16e1d2d58bde None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:05:00.128182 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 543/1072] 10.222.0.50 () {56 vars in 1133 bytes} [Mon Sep 5 12:04:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:05:00.134113 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268003f5-78d6-4ed9-b49b-36f86117995e None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:05:00.177449 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:05:00.245204 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268003f5-78d6-4ed9-b49b-36f86117995e None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:05:00.282857 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e972a4d-d862-406b-a36e-614e7ffa9d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:05:00.283445 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e972a4d-d862-406b-a36e-614e7ffa9d84 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:05:00.283729 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e972a4d-d862-406b-a36e-614e7ffa9d84 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:05:00.284002 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e972a4d-d862-406b-a36e-614e7ffa9d84 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:05:00.296017 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e972a4d-d862-406b-a36e-614e7ffa9d84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:05:00.297553 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e972a4d-d862-406b-a36e-614e7ffa9d84 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:05:00.313731 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-8e972a4d-d862-406b-a36e-614e7ffa9d84 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:05:00.313731 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:05:00.313731 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:05:00.313731 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:05:00.313731 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:05:00.313731 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:05:00.313731 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:05:00.313731 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:05:00.313731 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:05:00.313731 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:05:00.313731 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:05:00.313731 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:05:00.313731 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:05:00.313731 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:05:00.313731 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:05:00.313731 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:05:00.314945 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:05:00.314945 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:05:00.314945 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:05:00.314945 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:05:00.314945 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:05:00.314945 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:05:00.314945 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:05:00.314945 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:05:00.314945 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:05:00.314945 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:05:00.314945 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:05:00.314945 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:05:00.314945 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:05:00.314945 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:05:00.314945 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:05:00.314945 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:05:00.314945 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:05:00.315984 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:05:00.315984 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:05:00.315984 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:05:00.315984 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 530/1073] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 5 12:05:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:05:00.321167 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e829bfc-7473-4dae-981f-16e1d2d58bde None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:05:00.426297 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e829bfc-7473-4dae-981f-16e1d2d58bde None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:05:00.428094 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:05:00.464375 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233b5383-b8e8-417e-a5d6-9876e8d31444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:05:00.465029 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233b5383-b8e8-417e-a5d6-9876e8d31444 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:05:00.465312 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233b5383-b8e8-417e-a5d6-9876e8d31444 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:05:00.465586 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233b5383-b8e8-417e-a5d6-9876e8d31444 None admin] PATH_INFO: `/v3/domains` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:05:00.466243 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233b5383-b8e8-417e-a5d6-9876e8d31444 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:05:00.466546 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233b5383-b8e8-417e-a5d6-9876e8d31444 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:05:00.467933 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233b5383-b8e8-417e-a5d6-9876e8d31444 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:05:00.480761 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 544/1074] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 5 12:05:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:05:00.486763 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e972a4d-d862-406b-a36e-614e7ffa9d84 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:05:00.583808 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:05:00.594784 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e972a4d-d862-406b-a36e-614e7ffa9d84 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:05:00.631136 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a667c02f-67ea-46c8-9200-3d9fee125a20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:05:00.631786 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a667c02f-67ea-46c8-9200-3d9fee125a20 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:05:00.632069 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a667c02f-67ea-46c8-9200-3d9fee125a20 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:05:00.632343 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a667c02f-67ea-46c8-9200-3d9fee125a20 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:05:00.639732 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a667c02f-67ea-46c8-9200-3d9fee125a20 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:05:00.641245 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a667c02f-67ea-46c8-9200-3d9fee125a20 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:05:00.654504 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-a667c02f-67ea-46c8-9200-3d9fee125a20 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:05:00.654504 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:05:00.654504 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:05:00.654504 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:05:00.654504 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:05:00.654504 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:05:00.654504 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:05:00.654504 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:05:00.654504 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:05:00.654504 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:05:00.654504 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:05:00.654504 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:05:00.654504 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 12:05:00.654504 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 12:05:00.654504 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 12:05:00.656109 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 12:05:00.656109 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:05:00.656109 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:05:00.656109 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:05:00.656109 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:05:00.656109 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:05:00.656109 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:05:00.656109 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:05:00.656109 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:05:00.656109 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:05:00.656109 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:05:00.656109 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:05:00.656109 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:05:00.656109 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:05:00.656109 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:05:00.656109 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:05:00.656109 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:05:00.657176 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 12:05:00.657176 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 12:05:00.657176 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 12:05:00.657176 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 12:05:00.657176 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 12:05:00.657176 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 12:05:00.657176 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:05:00.657176 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:05:00.657176 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 531/1075] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Sep 5 12:05:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:05:00.658637 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f8f8fe-7ef5-4b66-883b-687c7c73adfd None None] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:05:00.658927 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f8f8fe-7ef5-4b66-883b-687c7c73adfd None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:05:00.659206 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f8f8fe-7ef5-4b66-883b-687c7c73adfd None None] PATH_INFO: `/` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:05:00.660940 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 545/1076] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:05:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:05:00.662227 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a667c02f-67ea-46c8-9200-3d9fee125a20 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:05:00.669123 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842bfe8f-8fc3-44d4-a510-50b548da9c38 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:05:00.669528 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842bfe8f-8fc3-44d4-a510-50b548da9c38 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:05:00.669872 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842bfe8f-8fc3-44d4-a510-50b548da9c38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:05:00.688677 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-842bfe8f-8fc3-44d4-a510-50b548da9c38 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:05:00.689944 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-842bfe8f-8fc3-44d4-a510-50b548da9c38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:05:00.761800 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 546/1077] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:05:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 05 12:05:00.779353 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a667c02f-67ea-46c8-9200-3d9fee125a20 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:05:00.819265 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eb7935-28bd-4508-ae67-8e4dc944546e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:05:00.819874 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eb7935-28bd-4508-ae67-8e4dc944546e None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:05:00.820155 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eb7935-28bd-4508-ae67-8e4dc944546e None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:05:00.820425 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eb7935-28bd-4508-ae67-8e4dc944546e None admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:05:00.821235 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eb7935-28bd-4508-ae67-8e4dc944546e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:05:00.821541 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eb7935-28bd-4508-ae67-8e4dc944546e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:05:00.823039 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eb7935-28bd-4508-ae67-8e4dc944546e None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:05:00.841944 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 532/1078] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Sep 5 12:05:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:05:00.843198 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842bfe8f-8fc3-44d4-a510-50b548da9c38 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:05:00.947576 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:05:00.957354 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842bfe8f-8fc3-44d4-a510-50b548da9c38 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:05:00.994994 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8893dd-ef77-4189-87bf-31c6d743b5b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:05:00.995673 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8893dd-ef77-4189-87bf-31c6d743b5b1 None admin] REQUEST_METHOD: `PUT` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:05:00.995952 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8893dd-ef77-4189-87bf-31c6d743b5b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:05:00.996222 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8893dd-ef77-4189-87bf-31c6d743b5b1 None admin] PATH_INFO: `/v3/projects/ae4f8939fcc040bca99783a77e6ede4d/users/cb060ff495bc4abb83ff88992fb7be09/roles/2ca407f96a3e417eac20298c6e80384e` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:05:00.998482 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8893dd-ef77-4189-87bf-31c6d743b5b1 None admin] RBAC: Authorizing `identity:create_grant(project_id=ae4f8939fcc040bca99783a77e6ede4d, user_id=cb060ff495bc4abb83ff88992fb7be09, role_id=2ca407f96a3e417eac20298c6e80384e)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:05:00.999935 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8893dd-ef77-4189-87bf-31c6d743b5b1 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:05:01.015963 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 547/1079] 10.222.0.50 () {58 vars in 1439 bytes} [Mon Sep 5 12:05:00 2022] PUT /identity/v3/projects/ae4f8939fcc040bca99783a77e6ede4d/users/cb060ff495bc4abb83ff88992fb7be09/roles/2ca407f96a3e417eac20298c6e80384e => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:05:01.032847 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eb7935-28bd-4508-ae67-8e4dc944546e None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:05:01.049947 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:05:01.182913 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eb7935-28bd-4508-ae67-8e4dc944546e None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:05:01.223128 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7fed22-7ba6-4325-95e2-d319356e06e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:05:01.223788 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7fed22-7ba6-4325-95e2-d319356e06e0 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:05:01.224069 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7fed22-7ba6-4325-95e2-d319356e06e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:05:01.224338 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7fed22-7ba6-4325-95e2-d319356e06e0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:05:01.237692 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7fed22-7ba6-4325-95e2-d319356e06e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:05:01.242676 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-8b7fed22-7ba6-4325-95e2-d319356e06e0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 12:05:01.242676 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:05:01.242676 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:05:01.242676 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:05:01.242676 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:05:01.242676 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:05:01.242676 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:05:01.242676 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:05:01.242676 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:05:01.242676 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:05:01.242676 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:05:01.242676 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:05:01.242676 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:05:01.242676 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:05:01.242676 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:05:01.242676 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:05:01.245441 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:05:01.245441 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:05:01.245441 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:05:01.245441 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:05:01.245441 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:05:01.245441 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:05:01.245441 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:05:01.245441 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:05:01.245441 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:05:01.245441 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:05:01.245441 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:05:01.245441 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:05:01.245441 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:05:01.245441 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:05:01.245441 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:05:01.245441 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:05:01.247575 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:05:01.247575 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:05:01.247575 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:05:01.247575 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:05:01.247575 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:05:01.247575 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:05:01.247575 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:05:01.247575 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:05:01.247575 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:05:01.247575 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:05:01.247575 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 12:05:01.247575 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:05:01.247575 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 533/1080] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Sep 5 12:05:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 12:05:01.253853 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8893dd-ef77-4189-87bf-31c6d743b5b1 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:05:01.422748 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8893dd-ef77-4189-87bf-31c6d743b5b1 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:05:01.483968 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c14d87c-8aa2-4c7a-9eed-8051ae7dd8ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:05:01.484915 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c14d87c-8aa2-4c7a-9eed-8051ae7dd8ff None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:05:01.485422 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c14d87c-8aa2-4c7a-9eed-8051ae7dd8ff None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:05:01.485857 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c14d87c-8aa2-4c7a-9eed-8051ae7dd8ff None admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:05:01.486932 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c14d87c-8aa2-4c7a-9eed-8051ae7dd8ff None admin] RBAC: Adding query filter params (name=admin) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:05:01.487487 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c14d87c-8aa2-4c7a-9eed-8051ae7dd8ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:05:01.490096 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c14d87c-8aa2-4c7a-9eed-8051ae7dd8ff None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:05:01.505605 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 548/1081] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Sep 5 12:05:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:05:01.511607 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7fed22-7ba6-4325-95e2-d319356e06e0 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:05:01.620057 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:05:01.656250 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7fed22-7ba6-4325-95e2-d319356e06e0 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:05:01.695590 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6a1dc3-bef0-4eb8-91e4-1423dfba52e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:05:01.696326 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6a1dc3-bef0-4eb8-91e4-1423dfba52e4 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:05:01.696663 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6a1dc3-bef0-4eb8-91e4-1423dfba52e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:05:01.697548 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6a1dc3-bef0-4eb8-91e4-1423dfba52e4 None admin] PATH_INFO: `/v3/users/36fc0625e9014df282053e2cc88f2f4b` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:05:01.698817 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6a1dc3-bef0-4eb8-91e4-1423dfba52e4 None admin] RBAC: Authorizing `identity:get_user(user_id=36fc0625e9014df282053e2cc88f2f4b)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:05:01.700387 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6a1dc3-bef0-4eb8-91e4-1423dfba52e4 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:05:01.702148 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 534/1082] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Sep 5 12:05:01 2022] GET /identity/v3/users/36fc0625e9014df282053e2cc88f2f4b => generated 285 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:05:01.708868 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c14d87c-8aa2-4c7a-9eed-8051ae7dd8ff None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:05:01.735763 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:05:01.843061 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c14d87c-8aa2-4c7a-9eed-8051ae7dd8ff None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:05:01.880924 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37418a8a-0d97-4541-a0a8-11dfe0ef48e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:05:01.881561 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37418a8a-0d97-4541-a0a8-11dfe0ef48e6 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:05:01.881828 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37418a8a-0d97-4541-a0a8-11dfe0ef48e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:05:01.882107 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37418a8a-0d97-4541-a0a8-11dfe0ef48e6 None admin] PATH_INFO: `/v3/projects/b81d447cd35f410fb625816a1b953eaf` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:05:01.883249 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37418a8a-0d97-4541-a0a8-11dfe0ef48e6 None admin] RBAC: Authorizing `identity:get_project(project_id=b81d447cd35f410fb625816a1b953eaf)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:05:01.885228 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37418a8a-0d97-4541-a0a8-11dfe0ef48e6 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:05:01.886933 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 549/1083] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Sep 5 12:05:01 2022] GET /identity/v3/projects/b81d447cd35f410fb625816a1b953eaf => generated 311 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:05:01.893092 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6a1dc3-bef0-4eb8-91e4-1423dfba52e4 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:05:02.005593 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6a1dc3-bef0-4eb8-91e4-1423dfba52e4 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:05:02.046229 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a97fbf-570c-46e0-8e33-b3ae8fcf9515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:05:02.046894 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a97fbf-570c-46e0-8e33-b3ae8fcf9515 None admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:05:02.047171 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a97fbf-570c-46e0-8e33-b3ae8fcf9515 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:05:02.047441 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a97fbf-570c-46e0-8e33-b3ae8fcf9515 None admin] PATH_INFO: `/v3/projects/b81d447cd35f410fb625816a1b953eaf/users/36fc0625e9014df282053e2cc88f2f4b/roles/16e2ccc8bd1b497d8cee780c1c7df0d2` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:05:02.049434 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a97fbf-570c-46e0-8e33-b3ae8fcf9515 None admin] RBAC: Authorizing `identity:create_grant(project_id=b81d447cd35f410fb625816a1b953eaf, user_id=36fc0625e9014df282053e2cc88f2f4b, role_id=16e2ccc8bd1b497d8cee780c1c7df0d2)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:05:02.050903 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a97fbf-570c-46e0-8e33-b3ae8fcf9515 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:05:02.061790 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:05:02.076586 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 535/1084] 10.222.0.50 () {58 vars in 1439 bytes} [Mon Sep 5 12:05:01 2022] PUT /identity/v3/projects/b81d447cd35f410fb625816a1b953eaf/users/36fc0625e9014df282053e2cc88f2f4b/roles/16e2ccc8bd1b497d8cee780c1c7df0d2 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 12:05:02.990178 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d2b742-8f82-4a94-aeed-660fcb03ab42 None None] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:05:02.990787 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d2b742-8f82-4a94-aeed-660fcb03ab42 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:05:02.991068 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d2b742-8f82-4a94-aeed-660fcb03ab42 None None] PATH_INFO: `/` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:05:02.993345 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 550/1085] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:05:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:05:03.001221 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306187a7-3e85-447c-90f5-1c7411037efc None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:05:03.002052 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306187a7-3e85-447c-90f5-1c7411037efc None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:05:03.002221 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306187a7-3e85-447c-90f5-1c7411037efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:05:03.023193 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-306187a7-3e85-447c-90f5-1c7411037efc None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:05:03.024725 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-306187a7-3e85-447c-90f5-1c7411037efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:05:03.106685 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 536/1086] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:05:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 12:05:03.390498 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d2b742-8f82-4a94-aeed-660fcb03ab42 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:05:03.479034 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:05:03.500822 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d2b742-8f82-4a94-aeed-660fcb03ab42 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:05:03.537769 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a9c5a2-2db1-482f-9c88-afac1fdd3271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:05:03.538410 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a9c5a2-2db1-482f-9c88-afac1fdd3271 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:05:03.538694 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a9c5a2-2db1-482f-9c88-afac1fdd3271 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:05:03.538970 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a9c5a2-2db1-482f-9c88-afac1fdd3271 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:05:03.550021 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a9c5a2-2db1-482f-9c88-afac1fdd3271 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:05:03.554906 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application [None req-40a9c5a2-2db1-482f-9c88-afac1fdd3271 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 05 12:05:03.554906 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:05:03.554906 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:05:03.554906 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:05:03.554906 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:05:03.554906 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:05:03.554906 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:05:03.554906 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:05:03.554906 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:05:03.554906 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:05:03.554906 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:05:03.554906 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:05:03.554906 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:05:03.554906 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:05:03.554906 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:05:03.554906 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:05:03.557431 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:05:03.557431 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:05:03.557431 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:05:03.557431 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:05:03.557431 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:05:03.557431 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:05:03.557431 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:05:03.557431 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:05:03.557431 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:05:03.557431 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:05:03.557431 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:05:03.557431 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application with Lock( Sep 05 12:05:03.557431 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:05:03.557431 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:05:03.557431 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:05:03.557431 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:05:03.559290 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:05:03.559290 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:05:03.559290 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:05:03.559290 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:05:03.559290 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:05:03.559290 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:05:03.559290 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:05:03.559290 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:05:03.559290 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:05:03.559290 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:05:03.559290 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 05 12:05:03.559290 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:05:03.561089 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 551/1087] 10.222.0.50 () {56 vars in 1120 bytes} [Mon Sep 5 12:05:03 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:05:03.562693 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306187a7-3e85-447c-90f5-1c7411037efc None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:05:03.671514 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306187a7-3e85-447c-90f5-1c7411037efc None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:05:03.702413 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:05:03.711457 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebbfba2-4244-4f2d-83aa-a0ce4d13c8a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:05:03.712077 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebbfba2-4244-4f2d-83aa-a0ce4d13c8a8 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:05:03.712354 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebbfba2-4244-4f2d-83aa-a0ce4d13c8a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:05:03.712663 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebbfba2-4244-4f2d-83aa-a0ce4d13c8a8 None admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:05:03.713374 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebbfba2-4244-4f2d-83aa-a0ce4d13c8a8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:05:03.713675 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebbfba2-4244-4f2d-83aa-a0ce4d13c8a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:05:03.715064 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebbfba2-4244-4f2d-83aa-a0ce4d13c8a8 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:05:03.731580 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 537/1088] 10.222.0.50 () {56 vars in 1115 bytes} [Mon Sep 5 12:05:03 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:05:03.732703 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a9c5a2-2db1-482f-9c88-afac1fdd3271 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:05:03.844540 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a9c5a2-2db1-482f-9c88-afac1fdd3271 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:05:03.883348 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fb6967-14b2-4ae4-b560-1a054fb3105b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:05:03.883996 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fb6967-14b2-4ae4-b560-1a054fb3105b None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:05:03.884279 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fb6967-14b2-4ae4-b560-1a054fb3105b None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:05:03.885135 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fb6967-14b2-4ae4-b560-1a054fb3105b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:05:03.896919 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fb6967-14b2-4ae4-b560-1a054fb3105b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:05:03.898655 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fb6967-14b2-4ae4-b560-1a054fb3105b None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:05:03.900887 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:05:03.917629 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application [None req-29fb6967-14b2-4ae4-b560-1a054fb3105b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:05:03.917629 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:05:03.917629 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:05:03.917629 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:05:03.917629 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:05:03.917629 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:05:03.917629 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:05:03.917629 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:05:03.917629 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:05:03.917629 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:05:03.917629 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:05:03.917629 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:05:03.917629 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:05:03.917629 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:05:03.917629 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:05:03.917629 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:05:03.918760 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:05:03.918760 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:05:03.918760 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:05:03.918760 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:05:03.918760 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:05:03.918760 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:05:03.918760 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:05:03.918760 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application with Lock( Sep 05 12:05:03.918760 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:05:03.918760 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:05:03.918760 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:05:03.918760 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:05:03.918760 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:05:03.918760 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:05:03.918760 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:05:03.918760 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:05:03.918760 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:05:03.920326 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:05:03.920326 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:05:03.920326 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:05:03.920326 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 552/1089] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 5 12:05:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 12:05:03.925362 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebbfba2-4244-4f2d-83aa-a0ce4d13c8a8 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:05:04.049547 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebbfba2-4244-4f2d-83aa-a0ce4d13c8a8 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:05:04.089069 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fee39a1-c585-4706-9be4-6051e5bd3ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:05:04.089744 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fee39a1-c585-4706-9be4-6051e5bd3ee7 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:05:04.090042 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fee39a1-c585-4706-9be4-6051e5bd3ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:05:04.090314 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fee39a1-c585-4706-9be4-6051e5bd3ee7 None admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:05:04.091016 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fee39a1-c585-4706-9be4-6051e5bd3ee7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:05:04.091323 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fee39a1-c585-4706-9be4-6051e5bd3ee7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:05:04.092826 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fee39a1-c585-4706-9be4-6051e5bd3ee7 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:05:04.107793 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 538/1090] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 5 12:05:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:05:04.114092 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fb6967-14b2-4ae4-b560-1a054fb3105b None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:05:04.269392 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fb6967-14b2-4ae4-b560-1a054fb3105b None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:05:04.328087 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cda739-e2e9-4015-acee-2c84e0ba81cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:05:04.328758 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cda739-e2e9-4015-acee-2c84e0ba81cf None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:05:04.329072 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cda739-e2e9-4015-acee-2c84e0ba81cf None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:05:04.329349 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cda739-e2e9-4015-acee-2c84e0ba81cf None admin] PATH_INFO: `/v3/users/nova` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:05:04.339418 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cda739-e2e9-4015-acee-2c84e0ba81cf None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:05:04.340921 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cda739-e2e9-4015-acee-2c84e0ba81cf None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:05:04.354106 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application [None req-e5cda739-e2e9-4015-acee-2c84e0ba81cf None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 05 12:05:04.354106 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:05:04.354106 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:05:04.354106 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:05:04.354106 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:05:04.354106 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:05:04.354106 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:05:04.354106 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:05:04.354106 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:05:04.354106 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:05:04.354106 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:05:04.354106 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:05:04.354106 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 12:05:04.354106 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 12:05:04.354106 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 12:05:04.354106 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 12:05:04.356028 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:05:04.356028 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:05:04.356028 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 12:05:04.356028 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:05:04.356028 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 12:05:04.356028 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:05:04.356028 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:05:04.356028 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:05:04.356028 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:05:04.356028 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:05:04.356028 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:05:04.356028 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application with Lock( Sep 05 12:05:04.356028 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:05:04.356028 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:05:04.356028 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:05:04.356028 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:05:04.356028 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:05:04.356028 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:05:04.358023 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:05:04.358023 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:05:04.358023 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 12:05:04.358023 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 12:05:04.358023 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 12:05:04.358023 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 12:05:04.358023 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 12:05:04.358023 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 12:05:04.358023 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 05 12:05:04.358023 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:05:04.358023 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 553/1091] 10.222.0.50 () {56 vars in 1093 bytes} [Mon Sep 5 12:05:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:05:04.363223 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fee39a1-c585-4706-9be4-6051e5bd3ee7 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:05:04.418085 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:05:04.473700 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fee39a1-c585-4706-9be4-6051e5bd3ee7 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:05:04.509842 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830ef38a-be6e-4555-9a87-6b75a6e98a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:05:04.510459 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830ef38a-be6e-4555-9a87-6b75a6e98a5f None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:05:04.510742 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830ef38a-be6e-4555-9a87-6b75a6e98a5f None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:05:04.511015 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830ef38a-be6e-4555-9a87-6b75a6e98a5f None admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:05:04.511758 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830ef38a-be6e-4555-9a87-6b75a6e98a5f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:05:04.512072 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830ef38a-be6e-4555-9a87-6b75a6e98a5f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:05:04.513580 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830ef38a-be6e-4555-9a87-6b75a6e98a5f None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:05:04.533101 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 539/1092] 10.222.0.50 () {56 vars in 1133 bytes} [Mon Sep 5 12:05:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:05:04.539275 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cda739-e2e9-4015-acee-2c84e0ba81cf None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:05:04.602243 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:05:04.652329 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cda739-e2e9-4015-acee-2c84e0ba81cf None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:05:04.689777 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18145b80-f666-4be9-ac5c-73edd8051444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:05:04.690514 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18145b80-f666-4be9-ac5c-73edd8051444 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:05:04.690854 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18145b80-f666-4be9-ac5c-73edd8051444 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:05:04.691206 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18145b80-f666-4be9-ac5c-73edd8051444 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:05:04.724413 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a54fe34-2be3-4345-89ab-0afaeb85e508 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:05:04.724921 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a54fe34-2be3-4345-89ab-0afaeb85e508 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:05:04.725310 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a54fe34-2be3-4345-89ab-0afaeb85e508 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:05:04.726996 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 540/1093] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:05:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 12:05:04.735833 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3061e88-0280-45df-ad7f-253800cb6a7a None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:05:04.736333 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3061e88-0280-45df-ad7f-253800cb6a7a None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:05:04.736817 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3061e88-0280-45df-ad7f-253800cb6a7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:05:04.766425 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-e3061e88-0280-45df-ad7f-253800cb6a7a None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:05:04.768430 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-e3061e88-0280-45df-ad7f-253800cb6a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:05:04.770399 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18145b80-f666-4be9-ac5c-73edd8051444 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:05:04.771912 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18145b80-f666-4be9-ac5c-73edd8051444 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:05:04.840746 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:05:04.863827 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 541/1094] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:05:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 12:05:04.895558 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 554/1095] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Sep 5 12:05:04 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 05 12:05:04.903180 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3061e88-0280-45df-ad7f-253800cb6a7a None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:05:04.950501 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:05:05.052474 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3061e88-0280-45df-ad7f-253800cb6a7a None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:05:05.111053 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c540c4f-a852-4ba7-9ec1-28682e4ab4cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:05:05.112052 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c540c4f-a852-4ba7-9ec1-28682e4ab4cf None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:05:05.112539 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c540c4f-a852-4ba7-9ec1-28682e4ab4cf None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:05:05.113043 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c540c4f-a852-4ba7-9ec1-28682e4ab4cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:05:05.131179 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c540c4f-a852-4ba7-9ec1-28682e4ab4cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:05:05.133807 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c540c4f-a852-4ba7-9ec1-28682e4ab4cf None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:05:05.153177 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-7c540c4f-a852-4ba7-9ec1-28682e4ab4cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:05:05.153177 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:05:05.153177 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:05:05.153177 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:05:05.153177 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:05:05.153177 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:05:05.153177 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:05:05.153177 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:05:05.153177 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:05:05.153177 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:05:05.153177 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:05:05.153177 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:05:05.153177 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:05:05.153177 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:05:05.153177 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:05:05.153177 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:05:05.154913 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:05:05.154913 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:05:05.154913 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:05:05.154913 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:05:05.154913 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:05:05.154913 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:05:05.154913 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:05:05.154913 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:05:05.154913 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:05:05.154913 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:05:05.154913 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:05:05.154913 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:05:05.154913 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:05:05.154913 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:05:05.154913 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:05:05.154913 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:05:05.154913 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:05:05.156469 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:05:05.156469 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:05:05.156469 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:05:05.156469 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 542/1096] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 5 12:05:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:05:05.163629 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18145b80-f666-4be9-ac5c-73edd8051444 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:05:05.231778 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c540c4f-a852-4ba7-9ec1-28682e4ab4cf None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:05:05.307747 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18145b80-f666-4be9-ac5c-73edd8051444 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:05:05.345766 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:05:05.355896 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f84b9f-3ea6-44cc-bb8d-e4f78656b2a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:05:05.356630 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f84b9f-3ea6-44cc-bb8d-e4f78656b2a0 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:05:05.357050 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f84b9f-3ea6-44cc-bb8d-e4f78656b2a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:05:05.357435 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f84b9f-3ea6-44cc-bb8d-e4f78656b2a0 None admin] PATH_INFO: `/v3/domains` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:05:05.358194 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f84b9f-3ea6-44cc-bb8d-e4f78656b2a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:05:05.358389 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c540c4f-a852-4ba7-9ec1-28682e4ab4cf None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:05:05.358678 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f84b9f-3ea6-44cc-bb8d-e4f78656b2a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:05:05.360163 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f84b9f-3ea6-44cc-bb8d-e4f78656b2a0 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:05:05.381560 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 555/1097] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 5 12:05:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:05:05.382856 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f84b9f-3ea6-44cc-bb8d-e4f78656b2a0 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:05:05.401611 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:05:05.404597 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a01978a-ba17-411f-91a0-7458b100b683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:05:05.405367 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a01978a-ba17-411f-91a0-7458b100b683 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:05:05.405845 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a01978a-ba17-411f-91a0-7458b100b683 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:05:05.406270 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a01978a-ba17-411f-91a0-7458b100b683 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:05:05.423368 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a01978a-ba17-411f-91a0-7458b100b683 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:05:05.429644 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-1a01978a-ba17-411f-91a0-7458b100b683 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 12:05:05.429644 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:05:05.429644 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:05:05.429644 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:05:05.429644 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:05:05.429644 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:05:05.429644 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:05:05.429644 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:05:05.429644 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:05:05.429644 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:05:05.429644 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:05:05.429644 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:05:05.429644 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:05:05.429644 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:05:05.429644 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:05:05.429644 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:05:05.432231 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:05:05.432231 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:05:05.432231 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:05:05.432231 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:05:05.432231 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:05:05.432231 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:05:05.432231 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:05:05.432231 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:05:05.432231 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:05:05.432231 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:05:05.432231 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:05:05.432231 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:05:05.432231 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:05:05.432231 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:05:05.432231 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:05:05.432231 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:05:05.434049 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:05:05.434049 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:05:05.434049 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:05:05.434049 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:05:05.434049 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:05:05.434049 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:05:05.434049 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:05:05.434049 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:05:05.434049 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:05:05.434049 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:05:05.434049 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 12:05:05.434049 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:05:05.434049 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 543/1098] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Sep 5 12:05:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 12:05:05.441541 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a01978a-ba17-411f-91a0-7458b100b683 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:05:05.516521 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f84b9f-3ea6-44cc-bb8d-e4f78656b2a0 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:05:05.557071 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a01978a-ba17-411f-91a0-7458b100b683 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:05:05.573641 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96be4e6f-20ee-4e37-8dbc-8736d03a06b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:05:05.574568 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96be4e6f-20ee-4e37-8dbc-8736d03a06b9 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:05:05.575009 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96be4e6f-20ee-4e37-8dbc-8736d03a06b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:05:05.575429 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96be4e6f-20ee-4e37-8dbc-8736d03a06b9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:05:05.587228 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96be4e6f-20ee-4e37-8dbc-8736d03a06b9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:05:05.589922 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96be4e6f-20ee-4e37-8dbc-8736d03a06b9 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:05:05.591598 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396b7df5-1fd7-451a-835b-dd133549ecab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:05:05.592210 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396b7df5-1fd7-451a-835b-dd133549ecab None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:05:05.592485 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396b7df5-1fd7-451a-835b-dd133549ecab None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:05:05.592760 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396b7df5-1fd7-451a-835b-dd133549ecab None admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:05:05.593454 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396b7df5-1fd7-451a-835b-dd133549ecab None admin] RBAC: Adding query filter params (name=admin) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:05:05.594165 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396b7df5-1fd7-451a-835b-dd133549ecab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:05:05.595131 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396b7df5-1fd7-451a-835b-dd133549ecab None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:05:05.604477 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application [None req-96be4e6f-20ee-4e37-8dbc-8736d03a06b9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:05:05.604477 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:05:05.604477 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:05:05.604477 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:05:05.604477 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:05:05.604477 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:05:05.604477 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:05:05.604477 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:05:05.604477 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:05:05.604477 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:05:05.604477 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:05:05.604477 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:05:05.604477 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 12:05:05.604477 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 12:05:05.604477 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 12:05:05.606203 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 12:05:05.606203 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:05:05.606203 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:05:05.606203 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:05:05.606203 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:05:05.606203 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:05:05.606203 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:05:05.606203 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:05:05.606203 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application with Lock( Sep 05 12:05:05.606203 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:05:05.606203 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:05:05.606203 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:05:05.606203 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:05:05.606203 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:05:05.606203 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:05:05.606203 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:05:05.606203 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:05:05.607971 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 12:05:05.607971 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 12:05:05.607971 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 12:05:05.607971 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 12:05:05.607971 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 12:05:05.607971 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 12:05:05.607971 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:05:05.607971 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:05:05.608787 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 544/1099] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Sep 5 12:05:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:05:05.608955 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 556/1100] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Sep 5 12:05:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 12:05:05.611813 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96be4e6f-20ee-4e37-8dbc-8736d03a06b9 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:05:05.612458 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396b7df5-1fd7-451a-835b-dd133549ecab None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:05:05.632971 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:05:05.719984 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:05:05.753479 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96be4e6f-20ee-4e37-8dbc-8736d03a06b9 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:05:05.756528 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396b7df5-1fd7-451a-835b-dd133549ecab None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:05:05.801645 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c718b6d-fa55-40bd-8884-d30d3d3a45a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:05:05.802458 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c718b6d-fa55-40bd-8884-d30d3d3a45a8 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:05:05.802837 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c718b6d-fa55-40bd-8884-d30d3d3a45a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:05:05.803207 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c718b6d-fa55-40bd-8884-d30d3d3a45a8 None admin] PATH_INFO: `/v3/users/36fc0625e9014df282053e2cc88f2f4b` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:05:05.804497 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c718b6d-fa55-40bd-8884-d30d3d3a45a8 None admin] RBAC: Authorizing `identity:get_user(user_id=36fc0625e9014df282053e2cc88f2f4b)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:05:05.806068 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7714480-b7b7-410b-8f50-c81a5861e4c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:05:05.806280 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c718b6d-fa55-40bd-8884-d30d3d3a45a8 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:05:05.806836 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7714480-b7b7-410b-8f50-c81a5861e4c5 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:05:05.807169 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7714480-b7b7-410b-8f50-c81a5861e4c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:05:05.807508 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7714480-b7b7-410b-8f50-c81a5861e4c5 None admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:05:05.808333 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7714480-b7b7-410b-8f50-c81a5861e4c5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:05:05.808484 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 557/1101] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Sep 5 12:05:05 2022] GET /identity/v3/users/36fc0625e9014df282053e2cc88f2f4b => generated 285 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:05:05.808828 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7714480-b7b7-410b-8f50-c81a5861e4c5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:05:05.811529 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7714480-b7b7-410b-8f50-c81a5861e4c5 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:05:05.817576 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c718b6d-fa55-40bd-8884-d30d3d3a45a8 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:05:05.827148 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 545/1102] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Sep 5 12:05:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:05:05.833420 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7714480-b7b7-410b-8f50-c81a5861e4c5 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:05:05.919093 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:05:05.947837 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c718b6d-fa55-40bd-8884-d30d3d3a45a8 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:05:05.961896 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7714480-b7b7-410b-8f50-c81a5861e4c5 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:05:05.984678 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e546a00-bbcb-4e55-a48f-e3c8ba6a50e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:05:05.985342 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e546a00-bbcb-4e55-a48f-e3c8ba6a50e5 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:05:05.985619 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e546a00-bbcb-4e55-a48f-e3c8ba6a50e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:05:05.985890 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e546a00-bbcb-4e55-a48f-e3c8ba6a50e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:05:06.001153 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:05:06.010556 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52a86e3-1d35-451f-b0c3-9af23c752a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:05:06.011332 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52a86e3-1d35-451f-b0c3-9af23c752a74 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:05:06.011755 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52a86e3-1d35-451f-b0c3-9af23c752a74 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:05:06.012152 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52a86e3-1d35-451f-b0c3-9af23c752a74 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:05:06.013108 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52a86e3-1d35-451f-b0c3-9af23c752a74 None admin] RBAC: Adding query filter params (role.id=2ca407f96a3e417eac20298c6e80384e, scope.project.id=ae4f8939fcc040bca99783a77e6ede4d, user.id=cb060ff495bc4abb83ff88992fb7be09) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:05:06.013517 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52a86e3-1d35-451f-b0c3-9af23c752a74 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:05:06.015160 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52a86e3-1d35-451f-b0c3-9af23c752a74 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:05:06.022616 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 546/1103] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Sep 5 12:05:05 2022] GET /identity/v3/role_assignments?user.id=cb060ff495bc4abb83ff88992fb7be09&scope.project.id=ae4f8939fcc040bca99783a77e6ede4d&role.id=2ca407f96a3e417eac20298c6e80384e => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:05:06.070906 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e546a00-bbcb-4e55-a48f-e3c8ba6a50e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:05:06.073068 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e546a00-bbcb-4e55-a48f-e3c8ba6a50e5 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:05:06.195209 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 558/1104] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Sep 5 12:05:05 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 05 12:05:06.204051 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52a86e3-1d35-451f-b0c3-9af23c752a74 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:05:06.342717 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52a86e3-1d35-451f-b0c3-9af23c752a74 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:05:06.405548 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b1ede3-6f5f-48a1-83ba-20b2bd994a36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:05:06.406627 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b1ede3-6f5f-48a1-83ba-20b2bd994a36 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:05:06.407118 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b1ede3-6f5f-48a1-83ba-20b2bd994a36 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:05:06.407621 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b1ede3-6f5f-48a1-83ba-20b2bd994a36 None admin] PATH_INFO: `/v3/projects/b81d447cd35f410fb625816a1b953eaf` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:05:06.409711 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b1ede3-6f5f-48a1-83ba-20b2bd994a36 None admin] RBAC: Authorizing `identity:get_project(project_id=b81d447cd35f410fb625816a1b953eaf)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:05:06.412497 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b1ede3-6f5f-48a1-83ba-20b2bd994a36 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:05:06.416379 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 547/1105] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Sep 5 12:05:06 2022] GET /identity/v3/projects/b81d447cd35f410fb625816a1b953eaf => generated 311 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:05:06.425285 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e546a00-bbcb-4e55-a48f-e3c8ba6a50e5 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:05:06.493069 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:05:06.572477 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e546a00-bbcb-4e55-a48f-e3c8ba6a50e5 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:05:06.614854 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaf67a8-3d88-4d04-9035-c2753664d6a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:05:06.615476 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaf67a8-3d88-4d04-9035-c2753664d6a0 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:05:06.615749 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaf67a8-3d88-4d04-9035-c2753664d6a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:05:06.616020 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaf67a8-3d88-4d04-9035-c2753664d6a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:05:06.616763 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaf67a8-3d88-4d04-9035-c2753664d6a0 None admin] RBAC: Adding query filter params (role.id=16e2ccc8bd1b497d8cee780c1c7df0d2, scope.project.id=b81d447cd35f410fb625816a1b953eaf, user.id=36fc0625e9014df282053e2cc88f2f4b) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:05:06.617103 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaf67a8-3d88-4d04-9035-c2753664d6a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:05:06.618551 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaf67a8-3d88-4d04-9035-c2753664d6a0 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:05:06.625311 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 559/1106] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Sep 5 12:05:06 2022] GET /identity/v3/role_assignments?user.id=36fc0625e9014df282053e2cc88f2f4b&scope.project.id=b81d447cd35f410fb625816a1b953eaf&role.id=16e2ccc8bd1b497d8cee780c1c7df0d2 => generated 608 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:05:08.675834 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eb2d3f-48a0-41a7-bda2-bb57e7b0b205 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:05:08.676639 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eb2d3f-48a0-41a7-bda2-bb57e7b0b205 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:05:08.676639 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eb2d3f-48a0-41a7-bda2-bb57e7b0b205 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:05:08.677775 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 548/1107] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:05:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 12:05:08.684406 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0445cb-85ca-4816-9596-ee31408decfe None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:05:08.685024 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0445cb-85ca-4816-9596-ee31408decfe None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:05:08.685024 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0445cb-85ca-4816-9596-ee31408decfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:05:08.704786 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-5d0445cb-85ca-4816-9596-ee31408decfe None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:05:08.706034 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-5d0445cb-85ca-4816-9596-ee31408decfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:05:08.782107 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 560/1108] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:05:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 12:05:09.054293 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eb2d3f-48a0-41a7-bda2-bb57e7b0b205 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:05:09.060613 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:05:09.237670 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eb2d3f-48a0-41a7-bda2-bb57e7b0b205 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:05:09.298971 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62c24e7-20cc-4304-9a8e-0bce845ae1c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:05:09.300064 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62c24e7-20cc-4304-9a8e-0bce845ae1c9 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:05:09.300563 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62c24e7-20cc-4304-9a8e-0bce845ae1c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:05:09.301097 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62c24e7-20cc-4304-9a8e-0bce845ae1c9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:05:09.303078 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62c24e7-20cc-4304-9a8e-0bce845ae1c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:05:09.305889 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62c24e7-20cc-4304-9a8e-0bce845ae1c9 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:05:09.308867 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 549/1109] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 5 12:05:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:05:09.314922 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0445cb-85ca-4816-9596-ee31408decfe None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:05:09.351993 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:05:09.423034 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0445cb-85ca-4816-9596-ee31408decfe None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:05:09.458559 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d9cf0c-a864-42a5-a423-443a83144ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:05:09.459176 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d9cf0c-a864-42a5-a423-443a83144ae7 None admin] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:05:09.459453 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d9cf0c-a864-42a5-a423-443a83144ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:05:09.459725 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d9cf0c-a864-42a5-a423-443a83144ae7 None admin] PATH_INFO: `/v3/users` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:05:09.460384 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d9cf0c-a864-42a5-a423-443a83144ae7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:05:09.461852 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d9cf0c-a864-42a5-a423-443a83144ae7 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:05:09.486244 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 561/1110] 10.222.0.50 () {60 vars in 1132 bytes} [Mon Sep 5 12:05:09 2022] POST /identity/v3/users => generated 286 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:05:11.507207 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882d75f5-86e6-40f3-815f-13074384b81b None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:05:11.507819 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882d75f5-86e6-40f3-815f-13074384b81b None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:05:11.507819 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882d75f5-86e6-40f3-815f-13074384b81b None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:05:11.509211 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 550/1111] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:05:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:05:11.515658 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffbcf0f-0cd7-4721-8cc9-627b8906bc86 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:05:11.516206 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffbcf0f-0cd7-4721-8cc9-627b8906bc86 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:05:11.516206 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffbcf0f-0cd7-4721-8cc9-627b8906bc86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:05:11.536807 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-cffbcf0f-0cd7-4721-8cc9-627b8906bc86 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:05:11.538129 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-cffbcf0f-0cd7-4721-8cc9-627b8906bc86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:05:11.618523 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 562/1112] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:05:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 12:05:11.894567 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882d75f5-86e6-40f3-815f-13074384b81b None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:05:11.970935 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:05:12.004565 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882d75f5-86e6-40f3-815f-13074384b81b None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:05:12.042654 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0963fbc-0665-435f-90fc-75980fab47ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:05:12.043268 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0963fbc-0665-435f-90fc-75980fab47ed None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:05:12.043579 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0963fbc-0665-435f-90fc-75980fab47ed None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:05:12.043887 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0963fbc-0665-435f-90fc-75980fab47ed None admin] PATH_INFO: `/v3/roles/bf853a508574493f9bc7d85f3c3b36fd` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:05:12.045393 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0963fbc-0665-435f-90fc-75980fab47ed None admin] RBAC: Authorizing `identity:get_role(role_id=bf853a508574493f9bc7d85f3c3b36fd)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:05:12.046835 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0963fbc-0665-435f-90fc-75980fab47ed None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:05:12.048333 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 551/1113] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Sep 5 12:05:11 2022] GET /identity/v3/roles/bf853a508574493f9bc7d85f3c3b36fd => generated 223 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:05:12.054480 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffbcf0f-0cd7-4721-8cc9-627b8906bc86 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:05:12.080200 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:05:12.176289 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffbcf0f-0cd7-4721-8cc9-627b8906bc86 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:05:12.214158 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45725b2-5719-4608-af1e-2c44e7032f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:05:12.214815 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45725b2-5719-4608-af1e-2c44e7032f19 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:05:12.215100 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45725b2-5719-4608-af1e-2c44e7032f19 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:05:12.215379 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45725b2-5719-4608-af1e-2c44e7032f19 None admin] PATH_INFO: `/v3/users/e6a7b75fa5ad4b96b50c7c9e662b1e3b` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:05:12.230154 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45725b2-5719-4608-af1e-2c44e7032f19 None admin] RBAC: Authorizing `identity:get_user(user_id=e6a7b75fa5ad4b96b50c7c9e662b1e3b)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:05:12.231618 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45725b2-5719-4608-af1e-2c44e7032f19 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:05:12.233393 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 563/1114] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Sep 5 12:05:12 2022] GET /identity/v3/users/e6a7b75fa5ad4b96b50c7c9e662b1e3b => generated 286 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:05:12.239625 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0963fbc-0665-435f-90fc-75980fab47ed None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:05:12.348194 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0963fbc-0665-435f-90fc-75980fab47ed None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:05:12.386083 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa5d195-8b09-4358-98ee-9b0910841aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:05:12.386694 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa5d195-8b09-4358-98ee-9b0910841aab None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:05:12.386978 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa5d195-8b09-4358-98ee-9b0910841aab None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:05:12.387254 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa5d195-8b09-4358-98ee-9b0910841aab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:05:12.398850 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:05:12.466605 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa5d195-8b09-4358-98ee-9b0910841aab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:05:12.468047 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa5d195-8b09-4358-98ee-9b0910841aab None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:05:12.575148 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 552/1115] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Sep 5 12:05:12 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 05 12:05:12.584597 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45725b2-5719-4608-af1e-2c44e7032f19 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:05:12.672694 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:05:12.703020 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45725b2-5719-4608-af1e-2c44e7032f19 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:05:12.741907 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9250cf4e-eaee-45b0-83f2-bdcb1a965410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:05:12.742549 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9250cf4e-eaee-45b0-83f2-bdcb1a965410 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:05:12.742835 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9250cf4e-eaee-45b0-83f2-bdcb1a965410 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:05:12.743111 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9250cf4e-eaee-45b0-83f2-bdcb1a965410 None admin] PATH_INFO: `/v3/projects/b81d447cd35f410fb625816a1b953eaf` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:05:12.744838 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9250cf4e-eaee-45b0-83f2-bdcb1a965410 None admin] RBAC: Authorizing `identity:get_project(project_id=b81d447cd35f410fb625816a1b953eaf)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:05:12.746305 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9250cf4e-eaee-45b0-83f2-bdcb1a965410 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:05:12.747988 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 564/1116] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Sep 5 12:05:12 2022] GET /identity/v3/projects/b81d447cd35f410fb625816a1b953eaf => generated 311 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:05:12.759057 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa5d195-8b09-4358-98ee-9b0910841aab None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:05:12.814370 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:05:12.878863 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa5d195-8b09-4358-98ee-9b0910841aab None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:05:12.918482 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76710e06-da7b-4019-9386-c2074cc90323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:05:12.919097 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76710e06-da7b-4019-9386-c2074cc90323 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:05:12.919383 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76710e06-da7b-4019-9386-c2074cc90323 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:05:12.919659 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76710e06-da7b-4019-9386-c2074cc90323 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:05:12.920424 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76710e06-da7b-4019-9386-c2074cc90323 None admin] RBAC: Adding query filter params (role.id=bf853a508574493f9bc7d85f3c3b36fd, scope.project.id=b81d447cd35f410fb625816a1b953eaf, user.id=e6a7b75fa5ad4b96b50c7c9e662b1e3b) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:05:12.920707 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76710e06-da7b-4019-9386-c2074cc90323 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:05:12.922192 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76710e06-da7b-4019-9386-c2074cc90323 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:05:12.928976 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 553/1117] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Sep 5 12:05:12 2022] GET /identity/v3/role_assignments?user.id=e6a7b75fa5ad4b96b50c7c9e662b1e3b&scope.project.id=b81d447cd35f410fb625816a1b953eaf&role.id=bf853a508574493f9bc7d85f3c3b36fd => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:05:14.929276 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6788e0e-4215-4f62-b585-468c59f6fe45 None None] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:05:14.930083 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6788e0e-4215-4f62-b585-468c59f6fe45 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:05:14.930276 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6788e0e-4215-4f62-b585-468c59f6fe45 None None] PATH_INFO: `/` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:05:14.932146 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 565/1118] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:05:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:05:14.938204 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3025c4fb-252e-482d-88a7-592b67411e7f None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:05:14.938769 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3025c4fb-252e-482d-88a7-592b67411e7f None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:05:14.938769 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3025c4fb-252e-482d-88a7-592b67411e7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:05:14.958337 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-3025c4fb-252e-482d-88a7-592b67411e7f None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:05:14.959626 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-3025c4fb-252e-482d-88a7-592b67411e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:05:15.032310 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 554/1119] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:05:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 12:05:15.546121 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6788e0e-4215-4f62-b585-468c59f6fe45 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:05:15.718137 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6788e0e-4215-4f62-b585-468c59f6fe45 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:05:15.776078 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4f5665-82bc-4df5-8ed3-6fad77afd43c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:05:15.777191 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4f5665-82bc-4df5-8ed3-6fad77afd43c None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:05:15.777679 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4f5665-82bc-4df5-8ed3-6fad77afd43c None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:05:15.778164 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4f5665-82bc-4df5-8ed3-6fad77afd43c None admin] PATH_INFO: `/v3/roles/bf853a508574493f9bc7d85f3c3b36fd` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:05:15.780666 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4f5665-82bc-4df5-8ed3-6fad77afd43c None admin] RBAC: Authorizing `identity:get_role(role_id=bf853a508574493f9bc7d85f3c3b36fd)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:05:15.783229 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4f5665-82bc-4df5-8ed3-6fad77afd43c None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:05:15.785771 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 566/1120] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Sep 5 12:05:15 2022] GET /identity/v3/roles/bf853a508574493f9bc7d85f3c3b36fd => generated 223 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:05:15.792151 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3025c4fb-252e-482d-88a7-592b67411e7f None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:05:15.825997 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:05:15.895957 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3025c4fb-252e-482d-88a7-592b67411e7f None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:05:15.932137 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5e9109-c8b5-42f4-8fca-002f83f9cff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:05:15.932852 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5e9109-c8b5-42f4-8fca-002f83f9cff4 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:05:15.933206 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5e9109-c8b5-42f4-8fca-002f83f9cff4 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:05:15.933517 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5e9109-c8b5-42f4-8fca-002f83f9cff4 None admin] PATH_INFO: `/v3/users/e6a7b75fa5ad4b96b50c7c9e662b1e3b` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:05:15.934710 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5e9109-c8b5-42f4-8fca-002f83f9cff4 None admin] RBAC: Authorizing `identity:get_user(user_id=e6a7b75fa5ad4b96b50c7c9e662b1e3b)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:05:15.936192 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5e9109-c8b5-42f4-8fca-002f83f9cff4 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:05:15.937895 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 555/1121] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Sep 5 12:05:15 2022] GET /identity/v3/users/e6a7b75fa5ad4b96b50c7c9e662b1e3b => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:05:15.943860 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4f5665-82bc-4df5-8ed3-6fad77afd43c None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:05:15.962865 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:05:16.055598 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4f5665-82bc-4df5-8ed3-6fad77afd43c None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:05:16.094058 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672a43c7-ecd7-4bd8-98fe-8f4c30f69a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:05:16.094616 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672a43c7-ecd7-4bd8-98fe-8f4c30f69a4e None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:05:16.094895 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672a43c7-ecd7-4bd8-98fe-8f4c30f69a4e None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:05:16.095166 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672a43c7-ecd7-4bd8-98fe-8f4c30f69a4e None admin] PATH_INFO: `/v3/projects/b81d447cd35f410fb625816a1b953eaf` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:05:16.096372 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672a43c7-ecd7-4bd8-98fe-8f4c30f69a4e None admin] RBAC: Authorizing `identity:get_project(project_id=b81d447cd35f410fb625816a1b953eaf)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:05:16.097829 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672a43c7-ecd7-4bd8-98fe-8f4c30f69a4e None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:05:16.099535 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 567/1122] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Sep 5 12:05:15 2022] GET /identity/v3/projects/b81d447cd35f410fb625816a1b953eaf => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:05:16.106245 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5e9109-c8b5-42f4-8fca-002f83f9cff4 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:05:16.214687 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5e9109-c8b5-42f4-8fca-002f83f9cff4 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:05:16.216320 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:05:16.254564 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b2aec4-d53b-47b2-b7d0-b67a28702bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:05:16.255340 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b2aec4-d53b-47b2-b7d0-b67a28702bc2 None admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:05:16.255624 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b2aec4-d53b-47b2-b7d0-b67a28702bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:05:16.255896 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b2aec4-d53b-47b2-b7d0-b67a28702bc2 None admin] PATH_INFO: `/v3/projects/b81d447cd35f410fb625816a1b953eaf/users/e6a7b75fa5ad4b96b50c7c9e662b1e3b/roles/bf853a508574493f9bc7d85f3c3b36fd` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:05:16.258197 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b2aec4-d53b-47b2-b7d0-b67a28702bc2 None admin] RBAC: Authorizing `identity:create_grant(project_id=b81d447cd35f410fb625816a1b953eaf, user_id=e6a7b75fa5ad4b96b50c7c9e662b1e3b, role_id=bf853a508574493f9bc7d85f3c3b36fd)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:05:16.259695 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b2aec4-d53b-47b2-b7d0-b67a28702bc2 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:05:16.273955 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 556/1123] 10.222.0.50 () {58 vars in 1439 bytes} [Mon Sep 5 12:05:16 2022] PUT /identity/v3/projects/b81d447cd35f410fb625816a1b953eaf/users/e6a7b75fa5ad4b96b50c7c9e662b1e3b/roles/bf853a508574493f9bc7d85f3c3b36fd => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:05:18.219141 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebdd8c5-17fe-4207-9bd7-2fcfbb5803a4 None None] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:05:18.219734 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebdd8c5-17fe-4207-9bd7-2fcfbb5803a4 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:05:18.219734 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebdd8c5-17fe-4207-9bd7-2fcfbb5803a4 None None] PATH_INFO: `/` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:05:18.221056 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 568/1124] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:05:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:05:18.226476 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4a3909-4bb0-4d98-9525-8b893ef6b542 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:05:18.226992 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4a3909-4bb0-4d98-9525-8b893ef6b542 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:05:18.227126 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4a3909-4bb0-4d98-9525-8b893ef6b542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:05:18.245937 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-5c4a3909-4bb0-4d98-9525-8b893ef6b542 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:05:18.247170 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-5c4a3909-4bb0-4d98-9525-8b893ef6b542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:05:18.349907 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 557/1125] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:05:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 12:05:18.625838 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebdd8c5-17fe-4207-9bd7-2fcfbb5803a4 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:05:18.721612 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:05:18.739829 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebdd8c5-17fe-4207-9bd7-2fcfbb5803a4 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:05:18.779828 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af90c5b9-0baa-4a6b-8262-460e08e0490e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:05:18.780472 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af90c5b9-0baa-4a6b-8262-460e08e0490e None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:05:18.780760 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af90c5b9-0baa-4a6b-8262-460e08e0490e None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:05:18.781059 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af90c5b9-0baa-4a6b-8262-460e08e0490e None admin] PATH_INFO: `/v3/roles/bf853a508574493f9bc7d85f3c3b36fd` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:05:18.782517 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af90c5b9-0baa-4a6b-8262-460e08e0490e None admin] RBAC: Authorizing `identity:get_role(role_id=bf853a508574493f9bc7d85f3c3b36fd)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:05:18.783945 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af90c5b9-0baa-4a6b-8262-460e08e0490e None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:05:18.785389 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 569/1126] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Sep 5 12:05:18 2022] GET /identity/v3/roles/bf853a508574493f9bc7d85f3c3b36fd => generated 223 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:05:18.791416 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4a3909-4bb0-4d98-9525-8b893ef6b542 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:05:18.891641 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:05:18.901815 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4a3909-4bb0-4d98-9525-8b893ef6b542 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:05:18.938923 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e482d90-f77d-4dea-a08c-5f5091265439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:05:18.939558 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e482d90-f77d-4dea-a08c-5f5091265439 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:05:18.939836 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e482d90-f77d-4dea-a08c-5f5091265439 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:05:18.940111 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e482d90-f77d-4dea-a08c-5f5091265439 None admin] PATH_INFO: `/v3/users/e6a7b75fa5ad4b96b50c7c9e662b1e3b` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:05:18.941281 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e482d90-f77d-4dea-a08c-5f5091265439 None admin] RBAC: Authorizing `identity:get_user(user_id=e6a7b75fa5ad4b96b50c7c9e662b1e3b)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:05:18.942722 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e482d90-f77d-4dea-a08c-5f5091265439 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:05:18.944347 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 558/1127] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Sep 5 12:05:18 2022] GET /identity/v3/users/e6a7b75fa5ad4b96b50c7c9e662b1e3b => generated 286 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:05:18.952997 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af90c5b9-0baa-4a6b-8262-460e08e0490e None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:05:19.064822 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af90c5b9-0baa-4a6b-8262-460e08e0490e None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:05:19.109844 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80321b6-5042-400b-8942-74066f358df3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:05:19.110815 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80321b6-5042-400b-8942-74066f358df3 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:05:19.111286 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80321b6-5042-400b-8942-74066f358df3 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:05:19.111751 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80321b6-5042-400b-8942-74066f358df3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:05:19.138403 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:05:19.189070 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80321b6-5042-400b-8942-74066f358df3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:05:19.190460 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80321b6-5042-400b-8942-74066f358df3 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:05:19.307304 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 570/1128] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Sep 5 12:05:18 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 05 12:05:19.313780 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e482d90-f77d-4dea-a08c-5f5091265439 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:05:19.485591 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e482d90-f77d-4dea-a08c-5f5091265439 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:05:19.545589 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dce4a2e-8638-44bb-ba3b-a77212d360c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:05:19.546628 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dce4a2e-8638-44bb-ba3b-a77212d360c0 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:05:19.547079 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dce4a2e-8638-44bb-ba3b-a77212d360c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:05:19.547559 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dce4a2e-8638-44bb-ba3b-a77212d360c0 None admin] PATH_INFO: `/v3/projects/b81d447cd35f410fb625816a1b953eaf` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:05:19.549557 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dce4a2e-8638-44bb-ba3b-a77212d360c0 None admin] RBAC: Authorizing `identity:get_project(project_id=b81d447cd35f410fb625816a1b953eaf)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:05:19.552196 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dce4a2e-8638-44bb-ba3b-a77212d360c0 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:05:19.555263 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 559/1129] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Sep 5 12:05:19 2022] GET /identity/v3/projects/b81d447cd35f410fb625816a1b953eaf => generated 311 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:05:19.562110 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80321b6-5042-400b-8942-74066f358df3 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:05:19.623221 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:05:19.675751 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80321b6-5042-400b-8942-74066f358df3 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:05:19.714414 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9340ec5-996c-4dad-9625-671648bb0313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:05:19.715039 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9340ec5-996c-4dad-9625-671648bb0313 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:05:19.715322 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9340ec5-996c-4dad-9625-671648bb0313 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:05:19.715600 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9340ec5-996c-4dad-9625-671648bb0313 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:05:19.716373 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9340ec5-996c-4dad-9625-671648bb0313 None admin] RBAC: Adding query filter params (role.id=bf853a508574493f9bc7d85f3c3b36fd, scope.project.id=b81d447cd35f410fb625816a1b953eaf, user.id=e6a7b75fa5ad4b96b50c7c9e662b1e3b) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:05:19.716689 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9340ec5-996c-4dad-9625-671648bb0313 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:05:19.718217 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9340ec5-996c-4dad-9625-671648bb0313 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:05:19.725151 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 571/1130] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Sep 5 12:05:19 2022] GET /identity/v3/role_assignments?user.id=e6a7b75fa5ad4b96b50c7c9e662b1e3b&scope.project.id=b81d447cd35f410fb625816a1b953eaf&role.id=bf853a508574493f9bc7d85f3c3b36fd => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:05:21.754742 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d992cb39-a9b4-4dd4-918a-7f2a31727899 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:05:21.755378 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d992cb39-a9b4-4dd4-918a-7f2a31727899 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:05:21.755378 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d992cb39-a9b4-4dd4-918a-7f2a31727899 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:05:21.756659 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 560/1131] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:05:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 12:05:21.763638 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2890cee0-91c2-4df6-b51e-befe4235df18 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:05:21.764210 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2890cee0-91c2-4df6-b51e-befe4235df18 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:05:21.764210 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2890cee0-91c2-4df6-b51e-befe4235df18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:05:21.783310 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-2890cee0-91c2-4df6-b51e-befe4235df18 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:05:21.784685 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-2890cee0-91c2-4df6-b51e-befe4235df18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:05:21.855965 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 572/1132] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:05:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 12:05:22.130736 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d992cb39-a9b4-4dd4-918a-7f2a31727899 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:05:22.162635 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:05:22.256853 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d992cb39-a9b4-4dd4-918a-7f2a31727899 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:05:22.298191 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea55177-22bd-4ebe-963b-dd89e4efb0e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:05:22.298909 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea55177-22bd-4ebe-963b-dd89e4efb0e0 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:05:22.299237 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea55177-22bd-4ebe-963b-dd89e4efb0e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:05:22.299571 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea55177-22bd-4ebe-963b-dd89e4efb0e0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:05:22.300928 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea55177-22bd-4ebe-963b-dd89e4efb0e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:05:22.302477 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea55177-22bd-4ebe-963b-dd89e4efb0e0 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:05:22.304371 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 561/1133] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 5 12:05:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:05:22.310677 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2890cee0-91c2-4df6-b51e-befe4235df18 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:05:22.359905 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:05:22.418797 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2890cee0-91c2-4df6-b51e-befe4235df18 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:05:22.456042 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a28da2-40d6-4ad0-9406-07f81d80e7ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:05:22.456660 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a28da2-40d6-4ad0-9406-07f81d80e7ce None admin] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:05:22.456960 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a28da2-40d6-4ad0-9406-07f81d80e7ce None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:05:22.457234 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a28da2-40d6-4ad0-9406-07f81d80e7ce None admin] PATH_INFO: `/v3/projects` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:05:22.457911 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a28da2-40d6-4ad0-9406-07f81d80e7ce None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:05:22.459359 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a28da2-40d6-4ad0-9406-07f81d80e7ce None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:05:22.489410 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 573/1134] 10.222.0.50 () {60 vars in 1141 bytes} [Mon Sep 5 12:05:22 2022] POST /identity/v3/projects => generated 311 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:05:24.495069 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd99f815-b892-4733-8ba6-a6c07b309d06 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:05:24.495642 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd99f815-b892-4733-8ba6-a6c07b309d06 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:05:24.495642 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd99f815-b892-4733-8ba6-a6c07b309d06 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:05:24.496999 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 562/1135] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:05:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:05:24.502782 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa1c9ea-ab4f-483c-a54b-8cac5668e842 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:05:24.503328 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa1c9ea-ab4f-483c-a54b-8cac5668e842 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:05:24.503470 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa1c9ea-ab4f-483c-a54b-8cac5668e842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:05:24.523184 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-7aa1c9ea-ab4f-483c-a54b-8cac5668e842 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:05:24.524438 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-7aa1c9ea-ab4f-483c-a54b-8cac5668e842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:05:24.597676 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 574/1136] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:05:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 12:05:24.869500 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd99f815-b892-4733-8ba6-a6c07b309d06 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:05:25.013499 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:05:25.021373 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd99f815-b892-4733-8ba6-a6c07b309d06 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:05:25.058281 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d14cd47-e7d9-49a7-8a7c-4d63a3f35160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:05:25.058838 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d14cd47-e7d9-49a7-8a7c-4d63a3f35160 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:05:25.059115 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d14cd47-e7d9-49a7-8a7c-4d63a3f35160 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:05:25.059385 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d14cd47-e7d9-49a7-8a7c-4d63a3f35160 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:05:25.060603 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d14cd47-e7d9-49a7-8a7c-4d63a3f35160 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:05:25.062149 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d14cd47-e7d9-49a7-8a7c-4d63a3f35160 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:05:25.063867 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 563/1137] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 5 12:05:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:05:25.069957 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa1c9ea-ab4f-483c-a54b-8cac5668e842 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:05:25.101356 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:05:25.183146 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa1c9ea-ab4f-483c-a54b-8cac5668e842 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:05:25.219155 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b8c9e5-df12-4fb8-81e4-101862d0136f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:05:25.219768 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b8c9e5-df12-4fb8-81e4-101862d0136f None admin] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:05:25.220050 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b8c9e5-df12-4fb8-81e4-101862d0136f None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:05:25.220323 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b8c9e5-df12-4fb8-81e4-101862d0136f None admin] PATH_INFO: `/v3/users` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:05:25.221009 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b8c9e5-df12-4fb8-81e4-101862d0136f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:05:25.222447 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b8c9e5-df12-4fb8-81e4-101862d0136f None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:05:25.245069 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 575/1138] 10.222.0.50 () {60 vars in 1132 bytes} [Mon Sep 5 12:05:25 2022] POST /identity/v3/users => generated 286 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:05:27.239424 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bddf534-5c1a-41ac-b84c-e869edd09076 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:05:27.240003 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bddf534-5c1a-41ac-b84c-e869edd09076 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:05:27.240003 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bddf534-5c1a-41ac-b84c-e869edd09076 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:05:27.241950 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 564/1139] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:05:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:05:27.251144 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fec951-9f64-4245-9228-abd2c0d8439d None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:05:27.251669 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fec951-9f64-4245-9228-abd2c0d8439d None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:05:27.251669 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fec951-9f64-4245-9228-abd2c0d8439d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:05:27.272453 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-58fec951-9f64-4245-9228-abd2c0d8439d None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:05:27.273997 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-58fec951-9f64-4245-9228-abd2c0d8439d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:05:27.355830 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 576/1140] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:05:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 12:05:27.648113 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bddf534-5c1a-41ac-b84c-e869edd09076 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:05:27.767698 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bddf534-5c1a-41ac-b84c-e869edd09076 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:05:27.807084 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa753618-550c-4eb1-b0ba-066186abe612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:05:27.807727 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa753618-550c-4eb1-b0ba-066186abe612 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:05:27.808010 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa753618-550c-4eb1-b0ba-066186abe612 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:05:27.808286 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa753618-550c-4eb1-b0ba-066186abe612 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:05:27.819595 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa753618-550c-4eb1-b0ba-066186abe612 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:05:27.825157 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-aa753618-550c-4eb1-b0ba-066186abe612 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 12:05:27.825157 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:05:27.825157 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:05:27.825157 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:05:27.825157 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:05:27.825157 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:05:27.825157 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:05:27.825157 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:05:27.825157 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:05:27.825157 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:05:27.825157 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:05:27.825157 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:05:27.825157 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:05:27.825157 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:05:27.825157 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:05:27.825157 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:05:27.827032 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:05:27.827032 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:05:27.827032 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:05:27.827032 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:05:27.827032 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:05:27.827032 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:05:27.827032 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:05:27.827032 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:05:27.827032 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:05:27.827032 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:05:27.827032 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:05:27.827032 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:05:27.827032 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:05:27.827032 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:05:27.827032 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:05:27.827032 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:05:27.829082 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:05:27.829082 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:05:27.829082 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:05:27.829082 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:05:27.829082 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:05:27.829082 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:05:27.829082 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:05:27.829082 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:05:27.829082 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:05:27.829082 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:05:27.829082 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 12:05:27.829082 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:05:27.829082 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 565/1141] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Sep 5 12:05:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 12:05:27.834241 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fec951-9f64-4245-9228-abd2c0d8439d None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:05:27.850128 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:05:27.941514 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fec951-9f64-4245-9228-abd2c0d8439d None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:05:27.976368 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bf620a-931d-4ad3-a6f1-8c364e5c1b3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:05:27.977003 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bf620a-931d-4ad3-a6f1-8c364e5c1b3f None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:05:27.977286 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bf620a-931d-4ad3-a6f1-8c364e5c1b3f None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:05:27.977559 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bf620a-931d-4ad3-a6f1-8c364e5c1b3f None admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:05:27.978741 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bf620a-931d-4ad3-a6f1-8c364e5c1b3f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:05:27.979045 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bf620a-931d-4ad3-a6f1-8c364e5c1b3f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:05:27.980421 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bf620a-931d-4ad3-a6f1-8c364e5c1b3f None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:05:27.989447 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 577/1142] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Sep 5 12:05:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:05:27.997846 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa753618-550c-4eb1-b0ba-066186abe612 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:05:28.042725 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:05:28.147115 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa753618-550c-4eb1-b0ba-066186abe612 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:05:28.182964 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1606d4f-4ffa-4abd-a7f3-432f33ec92ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:05:28.183601 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1606d4f-4ffa-4abd-a7f3-432f33ec92ec None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:05:28.183886 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1606d4f-4ffa-4abd-a7f3-432f33ec92ec None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:05:28.184160 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1606d4f-4ffa-4abd-a7f3-432f33ec92ec None admin] PATH_INFO: `/v3/users/6778cdc9c9b14512a72bf1a519937ce0` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:05:28.199212 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1606d4f-4ffa-4abd-a7f3-432f33ec92ec None admin] RBAC: Authorizing `identity:get_user(user_id=6778cdc9c9b14512a72bf1a519937ce0)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:05:28.200614 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1606d4f-4ffa-4abd-a7f3-432f33ec92ec None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:05:28.202398 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 566/1143] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Sep 5 12:05:27 2022] GET /identity/v3/users/6778cdc9c9b14512a72bf1a519937ce0 => generated 286 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:05:28.212972 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bf620a-931d-4ad3-a6f1-8c364e5c1b3f None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:05:28.348400 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:05:28.392261 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bf620a-931d-4ad3-a6f1-8c364e5c1b3f None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:05:28.455900 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3171c8c-1a7b-4234-ad4e-4a9f898ca236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:05:28.456856 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3171c8c-1a7b-4234-ad4e-4a9f898ca236 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:05:28.457384 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3171c8c-1a7b-4234-ad4e-4a9f898ca236 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:05:28.457871 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3171c8c-1a7b-4234-ad4e-4a9f898ca236 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:05:28.576148 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3171c8c-1a7b-4234-ad4e-4a9f898ca236 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:05:28.578901 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3171c8c-1a7b-4234-ad4e-4a9f898ca236 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:05:28.705705 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:05:28.745005 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 578/1144] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Sep 5 12:05:28 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 534 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 05 12:05:28.751172 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1606d4f-4ffa-4abd-a7f3-432f33ec92ec None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:05:28.852671 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:05:28.872611 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1606d4f-4ffa-4abd-a7f3-432f33ec92ec None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:05:28.910091 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0022cda3-ed87-45d1-947f-0ccc7c8c1763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:05:28.910727 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0022cda3-ed87-45d1-947f-0ccc7c8c1763 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:05:28.911007 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0022cda3-ed87-45d1-947f-0ccc7c8c1763 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:05:28.911279 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0022cda3-ed87-45d1-947f-0ccc7c8c1763 None admin] PATH_INFO: `/v3/projects/defa868b254248c8b60e9fe7a813a3f0` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:05:28.912415 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0022cda3-ed87-45d1-947f-0ccc7c8c1763 None admin] RBAC: Authorizing `identity:get_project(project_id=defa868b254248c8b60e9fe7a813a3f0)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:05:28.913893 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0022cda3-ed87-45d1-947f-0ccc7c8c1763 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:05:28.915591 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 567/1145] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Sep 5 12:05:28 2022] GET /identity/v3/projects/defa868b254248c8b60e9fe7a813a3f0 => generated 311 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:05:28.921911 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3171c8c-1a7b-4234-ad4e-4a9f898ca236 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:05:29.020649 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3171c8c-1a7b-4234-ad4e-4a9f898ca236 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:05:29.054801 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8118a7-5edd-4f68-85b2-41adf0569a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:05:29.055397 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8118a7-5edd-4f68-85b2-41adf0569a1d None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:05:29.056185 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8118a7-5edd-4f68-85b2-41adf0569a1d None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:05:29.056456 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8118a7-5edd-4f68-85b2-41adf0569a1d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:05:29.057203 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8118a7-5edd-4f68-85b2-41adf0569a1d None admin] RBAC: Adding query filter params (role.id=16e2ccc8bd1b497d8cee780c1c7df0d2, scope.project.id=defa868b254248c8b60e9fe7a813a3f0, user.id=6778cdc9c9b14512a72bf1a519937ce0) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:05:29.057512 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8118a7-5edd-4f68-85b2-41adf0569a1d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:05:29.058935 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8118a7-5edd-4f68-85b2-41adf0569a1d None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:05:29.064259 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 579/1146] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Sep 5 12:05:28 2022] GET /identity/v3/role_assignments?user.id=6778cdc9c9b14512a72bf1a519937ce0&scope.project.id=defa868b254248c8b60e9fe7a813a3f0&role.id=16e2ccc8bd1b497d8cee780c1c7df0d2 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:05:30.982722 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d3a26c-ff42-4901-b3e7-f89f8de0e1dc None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:05:30.983273 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d3a26c-ff42-4901-b3e7-f89f8de0e1dc None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:05:30.983273 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d3a26c-ff42-4901-b3e7-f89f8de0e1dc None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:05:30.984740 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 568/1147] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:05:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:05:30.990248 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f737b735-d835-472f-a0f4-9ab5905a8f52 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:05:30.990733 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f737b735-d835-472f-a0f4-9ab5905a8f52 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:05:30.990855 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f737b735-d835-472f-a0f4-9ab5905a8f52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:05:31.009910 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-f737b735-d835-472f-a0f4-9ab5905a8f52 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:05:31.011165 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-f737b735-d835-472f-a0f4-9ab5905a8f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:05:31.049295 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:05:31.084323 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 580/1148] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:05:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 12:05:31.352213 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d3a26c-ff42-4901-b3e7-f89f8de0e1dc None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:05:31.463041 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d3a26c-ff42-4901-b3e7-f89f8de0e1dc None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:05:31.500637 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182aa77f-ab10-4e15-8b3c-d43de2d004f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:05:31.501302 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182aa77f-ab10-4e15-8b3c-d43de2d004f6 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:05:31.501577 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182aa77f-ab10-4e15-8b3c-d43de2d004f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:05:31.501845 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182aa77f-ab10-4e15-8b3c-d43de2d004f6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:05:31.513122 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182aa77f-ab10-4e15-8b3c-d43de2d004f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:05:31.517941 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-182aa77f-ab10-4e15-8b3c-d43de2d004f6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 12:05:31.517941 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:05:31.517941 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:05:31.517941 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:05:31.517941 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:05:31.517941 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:05:31.517941 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:05:31.517941 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:05:31.517941 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:05:31.517941 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:05:31.517941 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:05:31.517941 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:05:31.517941 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:05:31.517941 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:05:31.517941 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:05:31.517941 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:05:31.519612 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:05:31.519612 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:05:31.519612 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:05:31.519612 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:05:31.519612 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:05:31.519612 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:05:31.519612 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:05:31.519612 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:05:31.519612 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:05:31.519612 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:05:31.519612 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:05:31.519612 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:05:31.519612 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:05:31.519612 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:05:31.519612 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:05:31.519612 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:05:31.520611 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:05:31.520611 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:05:31.520611 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:05:31.520611 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:05:31.520611 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:05:31.520611 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:05:31.520611 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:05:31.520611 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:05:31.520611 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:05:31.520611 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:05:31.520611 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 12:05:31.520611 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:05:31.520611 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 569/1149] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Sep 5 12:05:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:05:31.526383 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f737b735-d835-472f-a0f4-9ab5905a8f52 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:05:31.636430 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f737b735-d835-472f-a0f4-9ab5905a8f52 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:05:31.694784 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6f5519-3d8b-48f3-a6b4-1bfa36c90cac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:05:31.695815 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6f5519-3d8b-48f3-a6b4-1bfa36c90cac None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:05:31.696319 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6f5519-3d8b-48f3-a6b4-1bfa36c90cac None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:05:31.696810 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6f5519-3d8b-48f3-a6b4-1bfa36c90cac None admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:05:31.698053 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6f5519-3d8b-48f3-a6b4-1bfa36c90cac None admin] RBAC: Adding query filter params (name=admin) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:05:31.698600 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6f5519-3d8b-48f3-a6b4-1bfa36c90cac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:05:31.701285 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6f5519-3d8b-48f3-a6b4-1bfa36c90cac None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:05:31.717968 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 581/1150] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Sep 5 12:05:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:05:31.724010 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182aa77f-ab10-4e15-8b3c-d43de2d004f6 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:05:31.738825 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:05:31.833202 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182aa77f-ab10-4e15-8b3c-d43de2d004f6 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:05:31.867802 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43623d7-b582-46d0-b990-1d2c1840fa3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:05:31.869037 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43623d7-b582-46d0-b990-1d2c1840fa3c None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:05:31.869309 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43623d7-b582-46d0-b990-1d2c1840fa3c None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:05:31.869578 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43623d7-b582-46d0-b990-1d2c1840fa3c None admin] PATH_INFO: `/v3/users/6778cdc9c9b14512a72bf1a519937ce0` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:05:31.870750 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43623d7-b582-46d0-b990-1d2c1840fa3c None admin] RBAC: Authorizing `identity:get_user(user_id=6778cdc9c9b14512a72bf1a519937ce0)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:05:31.872206 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43623d7-b582-46d0-b990-1d2c1840fa3c None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:05:31.873834 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 570/1151] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Sep 5 12:05:31 2022] GET /identity/v3/users/6778cdc9c9b14512a72bf1a519937ce0 => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:05:31.880087 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6f5519-3d8b-48f3-a6b4-1bfa36c90cac None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:05:31.913946 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:05:31.987465 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6f5519-3d8b-48f3-a6b4-1bfa36c90cac None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:05:32.024142 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a347ec-b9b9-4f15-92d7-1dfc995c3dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:05:32.025446 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a347ec-b9b9-4f15-92d7-1dfc995c3dca None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:05:32.025653 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a347ec-b9b9-4f15-92d7-1dfc995c3dca None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:05:32.025964 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a347ec-b9b9-4f15-92d7-1dfc995c3dca None admin] PATH_INFO: `/v3/projects/defa868b254248c8b60e9fe7a813a3f0` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:05:32.027166 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a347ec-b9b9-4f15-92d7-1dfc995c3dca None admin] RBAC: Authorizing `identity:get_project(project_id=defa868b254248c8b60e9fe7a813a3f0)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:05:32.028708 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a347ec-b9b9-4f15-92d7-1dfc995c3dca None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:05:32.030456 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 582/1152] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Sep 5 12:05:31 2022] GET /identity/v3/projects/defa868b254248c8b60e9fe7a813a3f0 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:05:32.036655 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43623d7-b582-46d0-b990-1d2c1840fa3c None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:05:32.117731 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:05:32.140540 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43623d7-b582-46d0-b990-1d2c1840fa3c None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:05:32.177546 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e88265c-f4b0-432b-94cc-9cfc7e30ad6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:05:32.178182 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e88265c-f4b0-432b-94cc-9cfc7e30ad6b None admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:05:32.178515 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e88265c-f4b0-432b-94cc-9cfc7e30ad6b None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:05:32.178833 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e88265c-f4b0-432b-94cc-9cfc7e30ad6b None admin] PATH_INFO: `/v3/projects/defa868b254248c8b60e9fe7a813a3f0/users/6778cdc9c9b14512a72bf1a519937ce0/roles/16e2ccc8bd1b497d8cee780c1c7df0d2` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:05:32.180951 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e88265c-f4b0-432b-94cc-9cfc7e30ad6b None admin] RBAC: Authorizing `identity:create_grant(project_id=defa868b254248c8b60e9fe7a813a3f0, user_id=6778cdc9c9b14512a72bf1a519937ce0, role_id=16e2ccc8bd1b497d8cee780c1c7df0d2)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:05:32.182460 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e88265c-f4b0-432b-94cc-9cfc7e30ad6b None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:05:32.197576 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 571/1153] 10.222.0.50 () {58 vars in 1439 bytes} [Mon Sep 5 12:05:32 2022] PUT /identity/v3/projects/defa868b254248c8b60e9fe7a813a3f0/users/6778cdc9c9b14512a72bf1a519937ce0/roles/16e2ccc8bd1b497d8cee780c1c7df0d2 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:05:34.153382 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dab7e3-0eb6-40bc-9e1c-e2c1614246ef None None] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:05:34.154196 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dab7e3-0eb6-40bc-9e1c-e2c1614246ef None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:05:34.154396 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dab7e3-0eb6-40bc-9e1c-e2c1614246ef None None] PATH_INFO: `/` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:05:34.155784 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 583/1154] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:05:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:05:34.161902 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313abfa4-7242-4c62-91bd-5817f929e89e None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:05:34.162695 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313abfa4-7242-4c62-91bd-5817f929e89e None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:05:34.162847 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313abfa4-7242-4c62-91bd-5817f929e89e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:05:34.182415 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-313abfa4-7242-4c62-91bd-5817f929e89e None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:05:34.183721 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-313abfa4-7242-4c62-91bd-5817f929e89e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:05:34.257714 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 572/1155] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:05:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 12:05:34.527203 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dab7e3-0eb6-40bc-9e1c-e2c1614246ef None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:05:34.635069 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:05:34.639847 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dab7e3-0eb6-40bc-9e1c-e2c1614246ef None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:05:34.677216 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f74bea-6f63-47f2-9ab9-cd87d78c37e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:05:34.677873 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f74bea-6f63-47f2-9ab9-cd87d78c37e2 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:05:34.678156 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f74bea-6f63-47f2-9ab9-cd87d78c37e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:05:34.678433 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f74bea-6f63-47f2-9ab9-cd87d78c37e2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:05:34.690347 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f74bea-6f63-47f2-9ab9-cd87d78c37e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:05:34.695773 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application [None req-47f74bea-6f63-47f2-9ab9-cd87d78c37e2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 12:05:34.695773 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:05:34.695773 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:05:34.695773 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:05:34.695773 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:05:34.695773 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:05:34.695773 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:05:34.695773 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:05:34.695773 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:05:34.695773 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:05:34.695773 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:05:34.695773 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:05:34.695773 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:05:34.695773 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:05:34.695773 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:05:34.695773 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:05:34.697021 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:05:34.697021 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:05:34.697021 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:05:34.697021 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:05:34.697021 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:05:34.697021 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:05:34.697021 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:05:34.697021 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:05:34.697021 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:05:34.697021 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:05:34.697021 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:05:34.697021 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application with Lock( Sep 05 12:05:34.697021 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:05:34.697021 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:05:34.697021 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:05:34.697021 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:05:34.702096 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:05:34.702096 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:05:34.702096 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:05:34.702096 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:05:34.702096 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:05:34.702096 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:05:34.702096 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:05:34.702096 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:05:34.702096 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:05:34.702096 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:05:34.702096 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 12:05:34.702096 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:05:34.702096 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 584/1156] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Sep 5 12:05:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:05:34.703783 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313abfa4-7242-4c62-91bd-5817f929e89e None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:05:34.776634 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:05:34.830872 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313abfa4-7242-4c62-91bd-5817f929e89e None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:05:34.875451 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5b8e1e-af8d-47e7-b303-15fb5acd2b16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:05:34.876079 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5b8e1e-af8d-47e7-b303-15fb5acd2b16 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:05:34.876363 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5b8e1e-af8d-47e7-b303-15fb5acd2b16 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:05:34.876640 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5b8e1e-af8d-47e7-b303-15fb5acd2b16 None admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:05:34.877353 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5b8e1e-af8d-47e7-b303-15fb5acd2b16 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:05:34.877660 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5b8e1e-af8d-47e7-b303-15fb5acd2b16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:05:34.879082 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5b8e1e-af8d-47e7-b303-15fb5acd2b16 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:05:34.888579 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 573/1157] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Sep 5 12:05:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:05:34.894570 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f74bea-6f63-47f2-9ab9-cd87d78c37e2 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:05:35.004319 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f74bea-6f63-47f2-9ab9-cd87d78c37e2 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:05:35.042437 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f686dbfc-186f-401f-a648-7de912d44571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:05:35.042970 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f686dbfc-186f-401f-a648-7de912d44571 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:05:35.043250 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f686dbfc-186f-401f-a648-7de912d44571 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:05:35.043524 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f686dbfc-186f-401f-a648-7de912d44571 None admin] PATH_INFO: `/v3/users/6778cdc9c9b14512a72bf1a519937ce0` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:05:35.044701 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f686dbfc-186f-401f-a648-7de912d44571 None admin] RBAC: Authorizing `identity:get_user(user_id=6778cdc9c9b14512a72bf1a519937ce0)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:05:35.046179 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f686dbfc-186f-401f-a648-7de912d44571 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:05:35.047794 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 585/1158] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Sep 5 12:05:34 2022] GET /identity/v3/users/6778cdc9c9b14512a72bf1a519937ce0 => generated 286 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:05:35.054135 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5b8e1e-af8d-47e7-b303-15fb5acd2b16 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:05:35.164878 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5b8e1e-af8d-47e7-b303-15fb5acd2b16 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:05:35.195582 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:05:35.201986 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5594d41-0598-459e-aff8-71aa96a6c229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:05:35.202607 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5594d41-0598-459e-aff8-71aa96a6c229 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:05:35.202888 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5594d41-0598-459e-aff8-71aa96a6c229 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:05:35.203163 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5594d41-0598-459e-aff8-71aa96a6c229 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:05:35.277315 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5594d41-0598-459e-aff8-71aa96a6c229 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:05:35.278801 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5594d41-0598-459e-aff8-71aa96a6c229 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:05:35.388460 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 574/1159] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Sep 5 12:05:35 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 05 12:05:35.395074 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f686dbfc-186f-401f-a648-7de912d44571 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:05:35.425632 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:05:35.505615 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f686dbfc-186f-401f-a648-7de912d44571 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:05:35.550854 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeaae95-bab8-4609-abce-df1f266dd951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:05:35.550854 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeaae95-bab8-4609-abce-df1f266dd951 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:05:35.551168 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeaae95-bab8-4609-abce-df1f266dd951 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:05:35.551501 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeaae95-bab8-4609-abce-df1f266dd951 None admin] PATH_INFO: `/v3/projects/defa868b254248c8b60e9fe7a813a3f0` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:05:35.552533 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aeaae95-bab8-4609-abce-df1f266dd951 None admin] RBAC: Authorizing `identity:get_project(project_id=defa868b254248c8b60e9fe7a813a3f0)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:05:35.554017 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aeaae95-bab8-4609-abce-df1f266dd951 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:05:35.556297 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 586/1160] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Sep 5 12:05:35 2022] GET /identity/v3/projects/defa868b254248c8b60e9fe7a813a3f0 => generated 311 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:05:35.562756 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5594d41-0598-459e-aff8-71aa96a6c229 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:05:35.593248 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:05:35.704351 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5594d41-0598-459e-aff8-71aa96a6c229 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:05:35.756220 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f820fb5-0f25-454a-87cd-dc850060e718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:05:35.756836 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f820fb5-0f25-454a-87cd-dc850060e718 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:05:35.757145 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f820fb5-0f25-454a-87cd-dc850060e718 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:05:35.757416 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f820fb5-0f25-454a-87cd-dc850060e718 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:05:35.758162 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f820fb5-0f25-454a-87cd-dc850060e718 None admin] RBAC: Adding query filter params (role.id=16e2ccc8bd1b497d8cee780c1c7df0d2, scope.project.id=defa868b254248c8b60e9fe7a813a3f0, user.id=6778cdc9c9b14512a72bf1a519937ce0) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:05:35.758468 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f820fb5-0f25-454a-87cd-dc850060e718 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:05:35.760008 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f820fb5-0f25-454a-87cd-dc850060e718 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:05:35.767014 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 575/1161] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Sep 5 12:05:35 2022] GET /identity/v3/role_assignments?user.id=6778cdc9c9b14512a72bf1a519937ce0&scope.project.id=defa868b254248c8b60e9fe7a813a3f0&role.id=16e2ccc8bd1b497d8cee780c1c7df0d2 => generated 608 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:05:37.747073 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897403d9-e355-4d3e-991e-f58670ce31e5 None None] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:05:37.747649 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897403d9-e355-4d3e-991e-f58670ce31e5 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:05:37.747649 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897403d9-e355-4d3e-991e-f58670ce31e5 None None] PATH_INFO: `/` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:05:37.748976 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 587/1162] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:05:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 12:05:37.754563 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ead5b61-acbc-4cef-9034-8a0b541b9e70 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:05:37.755121 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ead5b61-acbc-4cef-9034-8a0b541b9e70 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:05:37.755121 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ead5b61-acbc-4cef-9034-8a0b541b9e70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:05:37.775646 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-4ead5b61-acbc-4cef-9034-8a0b541b9e70 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:05:37.776854 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-4ead5b61-acbc-4cef-9034-8a0b541b9e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:05:37.856294 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 576/1163] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:05:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 12:05:38.123751 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897403d9-e355-4d3e-991e-f58670ce31e5 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:05:38.224020 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:05:38.231664 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897403d9-e355-4d3e-991e-f58670ce31e5 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:05:38.267926 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a25470-3782-42b0-a756-49000d616249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:05:38.268552 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a25470-3782-42b0-a756-49000d616249 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:05:38.268829 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a25470-3782-42b0-a756-49000d616249 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:05:38.269139 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a25470-3782-42b0-a756-49000d616249 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:05:38.347616 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a25470-3782-42b0-a756-49000d616249 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:05:38.349119 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a25470-3782-42b0-a756-49000d616249 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:05:38.450615 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:05:38.458218 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 588/1164] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Sep 5 12:05:38 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 05 12:05:38.464265 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ead5b61-acbc-4cef-9034-8a0b541b9e70 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:05:38.490496 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:05:38.571279 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ead5b61-acbc-4cef-9034-8a0b541b9e70 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:05:38.606354 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869fcc90-d065-4021-afa7-076d09fab298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:05:38.607001 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869fcc90-d065-4021-afa7-076d09fab298 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:05:38.607283 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869fcc90-d065-4021-afa7-076d09fab298 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:05:38.607554 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869fcc90-d065-4021-afa7-076d09fab298 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:05:38.614398 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869fcc90-d065-4021-afa7-076d09fab298 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:05:38.615868 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869fcc90-d065-4021-afa7-076d09fab298 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:05:38.628306 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-869fcc90-d065-4021-afa7-076d09fab298 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 05 12:05:38.628306 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:05:38.628306 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 05 12:05:38.628306 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 05 12:05:38.628306 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 12:05:38.628306 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 12:05:38.628306 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 12:05:38.628306 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 12:05:38.628306 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 05 12:05:38.628306 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:05:38.628306 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 12:05:38.628306 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:05:38.628306 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:05:38.628306 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:05:38.628306 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:05:38.628306 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:05:38.628306 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:05:38.630066 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:05:38.630066 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:05:38.630066 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:05:38.630066 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:05:38.630066 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:05:38.630066 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:05:38.630066 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:05:38.630066 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:05:38.630066 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:05:38.630066 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:05:38.630066 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:05:38.630066 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:05:38.630066 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:05:38.630066 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:05:38.630066 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:05:38.630066 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:05:38.631393 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:05:38.631393 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:05:38.631393 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:05:38.631393 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:05:38.631393 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:05:38.631393 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:05:38.631393 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:05:38.631393 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:05:38.631393 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:05:38.631393 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:05:38.631393 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 05 12:05:38.631393 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:05:38.631393 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 05 12:05:38.631393 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:05:38.631393 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 577/1165] 10.222.0.50 () {56 vars in 1117 bytes} [Mon Sep 5 12:05:38 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:05:38.636074 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a25470-3782-42b0-a756-49000d616249 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:05:38.739185 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a25470-3782-42b0-a756-49000d616249 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:05:38.776379 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657eded4-63d6-42d2-9428-471d3894f40c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:05:38.777075 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657eded4-63d6-42d2-9428-471d3894f40c None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:05:38.777297 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657eded4-63d6-42d2-9428-471d3894f40c None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:05:38.777573 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657eded4-63d6-42d2-9428-471d3894f40c None admin] PATH_INFO: `/v3/domains` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:05:38.778230 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657eded4-63d6-42d2-9428-471d3894f40c None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:05:38.778537 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657eded4-63d6-42d2-9428-471d3894f40c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:05:38.779913 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657eded4-63d6-42d2-9428-471d3894f40c None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:05:38.787822 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 589/1166] 10.222.0.50 () {56 vars in 1115 bytes} [Mon Sep 5 12:05:38 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:05:40.734445 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7805a4b4-125f-4cc0-8a62-bb298c34d3af None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:05:40.735068 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7805a4b4-125f-4cc0-8a62-bb298c34d3af None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:05:40.735068 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7805a4b4-125f-4cc0-8a62-bb298c34d3af None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:05:40.736614 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 578/1167] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:05:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:05:40.742917 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6333e08-fbff-4508-8fe5-2aa6f0644443 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:05:40.744066 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6333e08-fbff-4508-8fe5-2aa6f0644443 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:05:40.744181 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6333e08-fbff-4508-8fe5-2aa6f0644443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:05:40.765302 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-b6333e08-fbff-4508-8fe5-2aa6f0644443 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:05:40.766569 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-b6333e08-fbff-4508-8fe5-2aa6f0644443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:05:40.834296 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:05:40.846856 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 590/1168] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:05:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 12:05:41.122824 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7805a4b4-125f-4cc0-8a62-bb298c34d3af None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:05:41.221402 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:05:41.252351 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7805a4b4-125f-4cc0-8a62-bb298c34d3af None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:05:41.312604 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91261a67-c76c-4da1-8552-aa3de1d63035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:05:41.313659 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91261a67-c76c-4da1-8552-aa3de1d63035 None admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:05:41.314150 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91261a67-c76c-4da1-8552-aa3de1d63035 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:05:41.314629 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91261a67-c76c-4da1-8552-aa3de1d63035 None admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:05:41.315839 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91261a67-c76c-4da1-8552-aa3de1d63035 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:05:41.318415 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91261a67-c76c-4da1-8552-aa3de1d63035 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:05:41.340345 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 579/1169] 10.222.0.50 () {60 vars in 1138 bytes} [Mon Sep 5 12:05:41 2022] POST /identity/v3/domains => generated 267 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:05:43.323454 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c74d4b-6e65-4dde-aa80-a40641e8044e None None] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:05:43.324092 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c74d4b-6e65-4dde-aa80-a40641e8044e None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:05:43.324092 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c74d4b-6e65-4dde-aa80-a40641e8044e None None] PATH_INFO: `/` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:05:43.325586 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 591/1170] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:05:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:05:43.331279 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bbfd3b-a3a9-49c1-a0cf-cdcb4f691e0f None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:05:43.331791 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bbfd3b-a3a9-49c1-a0cf-cdcb4f691e0f None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:05:43.331930 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bbfd3b-a3a9-49c1-a0cf-cdcb4f691e0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:05:43.351460 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-76bbfd3b-a3a9-49c1-a0cf-cdcb4f691e0f None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:05:43.352679 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-76bbfd3b-a3a9-49c1-a0cf-cdcb4f691e0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:05:43.425917 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 580/1171] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:05:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 05 12:05:43.707293 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c74d4b-6e65-4dde-aa80-a40641e8044e None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:05:43.818195 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c74d4b-6e65-4dde-aa80-a40641e8044e None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:05:43.856097 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c38739f-ab9b-41eb-8dd0-6d6d469f50cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:05:43.856757 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c38739f-ab9b-41eb-8dd0-6d6d469f50cd None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:05:43.857069 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c38739f-ab9b-41eb-8dd0-6d6d469f50cd None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:05:43.857341 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c38739f-ab9b-41eb-8dd0-6d6d469f50cd None admin] PATH_INFO: `/v3/domains/ed52942859b5487e8cba1f7c97b6c9b4` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:05:43.870374 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c38739f-ab9b-41eb-8dd0-6d6d469f50cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=ed52942859b5487e8cba1f7c97b6c9b4)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:05:43.872011 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c38739f-ab9b-41eb-8dd0-6d6d469f50cd None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:05:43.873756 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 592/1172] 10.222.0.50 () {56 vars in 1183 bytes} [Mon Sep 5 12:05:43 2022] GET /identity/v3/domains/ed52942859b5487e8cba1f7c97b6c9b4 => generated 267 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:05:43.879891 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bbfd3b-a3a9-49c1-a0cf-cdcb4f691e0f None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:05:43.959158 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:05:43.986088 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bbfd3b-a3a9-49c1-a0cf-cdcb4f691e0f None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:05:44.021359 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd1737b-0d60-462e-b436-bfb5916c21d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:05:44.021966 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd1737b-0d60-462e-b436-bfb5916c21d3 None admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:05:44.022244 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd1737b-0d60-462e-b436-bfb5916c21d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:05:44.022524 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd1737b-0d60-462e-b436-bfb5916c21d3 None admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:05:44.023445 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd1737b-0d60-462e-b436-bfb5916c21d3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:05:44.025444 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd1737b-0d60-462e-b436-bfb5916c21d3 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:05:44.054266 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 581/1173] 10.222.0.50 () {60 vars in 1141 bytes} [Mon Sep 5 12:05:43 2022] POST /identity/v3/projects => generated 361 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 12:05:46.067003 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a3bb4e-375d-4ca0-bab1-e2014efce068 None None] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:05:46.067533 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a3bb4e-375d-4ca0-bab1-e2014efce068 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:05:46.067533 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a3bb4e-375d-4ca0-bab1-e2014efce068 None None] PATH_INFO: `/` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:05:46.068823 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 593/1174] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:05:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:05:46.074444 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaf8b4e-9011-400c-af7c-aea6f270909d None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:05:46.074950 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaf8b4e-9011-400c-af7c-aea6f270909d None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:05:46.075064 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaf8b4e-9011-400c-af7c-aea6f270909d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:05:46.098140 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-beaf8b4e-9011-400c-af7c-aea6f270909d None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:05:46.099354 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-beaf8b4e-9011-400c-af7c-aea6f270909d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:05:46.170142 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 582/1175] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:05:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 12:05:46.440803 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a3bb4e-375d-4ca0-bab1-e2014efce068 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:05:46.499160 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:05:46.556950 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a3bb4e-375d-4ca0-bab1-e2014efce068 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:05:46.594338 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3e37cc-500f-4f5b-bbf7-2d830fed9e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:05:46.594884 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3e37cc-500f-4f5b-bbf7-2d830fed9e2b None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:05:46.595165 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3e37cc-500f-4f5b-bbf7-2d830fed9e2b None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:05:46.595440 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3e37cc-500f-4f5b-bbf7-2d830fed9e2b None admin] PATH_INFO: `/v3/domains/ed52942859b5487e8cba1f7c97b6c9b4` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:05:46.596597 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3e37cc-500f-4f5b-bbf7-2d830fed9e2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=ed52942859b5487e8cba1f7c97b6c9b4)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:05:46.598067 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3e37cc-500f-4f5b-bbf7-2d830fed9e2b None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:05:46.599850 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 594/1176] 10.222.0.50 () {56 vars in 1183 bytes} [Mon Sep 5 12:05:46 2022] GET /identity/v3/domains/ed52942859b5487e8cba1f7c97b6c9b4 => generated 267 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:05:46.606201 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaf8b4e-9011-400c-af7c-aea6f270909d None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:05:46.671781 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:05:46.719154 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaf8b4e-9011-400c-af7c-aea6f270909d None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:05:46.752504 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b580280b-3313-4825-aa5e-a7656f89dc55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:05:46.753139 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b580280b-3313-4825-aa5e-a7656f89dc55 None admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:05:46.753419 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b580280b-3313-4825-aa5e-a7656f89dc55 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:05:46.753691 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b580280b-3313-4825-aa5e-a7656f89dc55 None admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:05:46.754347 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b580280b-3313-4825-aa5e-a7656f89dc55 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:05:46.755779 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b580280b-3313-4825-aa5e-a7656f89dc55 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:05:46.780203 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 583/1177] 10.222.0.50 () {60 vars in 1132 bytes} [Mon Sep 5 12:05:46 2022] POST /identity/v3/users => generated 311 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 12:05:48.748205 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ec61b9-1a22-4798-bd50-bd4fef5617ba None None] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:05:48.748785 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ec61b9-1a22-4798-bd50-bd4fef5617ba None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:05:48.748785 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ec61b9-1a22-4798-bd50-bd4fef5617ba None None] PATH_INFO: `/` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:05:48.750130 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 595/1178] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:05:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 12:05:48.755832 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc02a9df-b1dd-49cb-802d-9f6a781fe002 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:05:48.756572 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc02a9df-b1dd-49cb-802d-9f6a781fe002 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:05:48.756804 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc02a9df-b1dd-49cb-802d-9f6a781fe002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:05:48.776548 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-bc02a9df-b1dd-49cb-802d-9f6a781fe002 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:05:48.777980 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-bc02a9df-b1dd-49cb-802d-9f6a781fe002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:05:48.850186 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 584/1179] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:05:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 05 12:05:49.363600 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ec61b9-1a22-4798-bd50-bd4fef5617ba None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:05:49.538500 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ec61b9-1a22-4798-bd50-bd4fef5617ba None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:05:49.575356 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:05:49.605312 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839acceb-d429-49c5-b806-a164c552b177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:05:49.606354 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839acceb-d429-49c5-b806-a164c552b177 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:05:49.606856 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839acceb-d429-49c5-b806-a164c552b177 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:05:49.607349 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839acceb-d429-49c5-b806-a164c552b177 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:05:49.625611 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839acceb-d429-49c5-b806-a164c552b177 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:05:49.635730 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application [None req-839acceb-d429-49c5-b806-a164c552b177 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 12:05:49.635730 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:05:49.635730 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:05:49.635730 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:05:49.635730 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:05:49.635730 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:05:49.635730 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:05:49.635730 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:05:49.635730 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:05:49.635730 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:05:49.635730 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:05:49.635730 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:05:49.635730 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:05:49.635730 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:05:49.635730 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:05:49.635730 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:05:49.636969 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:05:49.636969 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:05:49.636969 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:05:49.636969 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:05:49.636969 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:05:49.636969 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:05:49.636969 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:05:49.636969 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:05:49.636969 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:05:49.636969 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:05:49.636969 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:05:49.636969 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application with Lock( Sep 05 12:05:49.636969 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:05:49.636969 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:05:49.636969 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:05:49.636969 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:05:49.638057 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:05:49.638057 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:05:49.638057 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:05:49.638057 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:05:49.638057 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:05:49.638057 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:05:49.638057 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:05:49.638057 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:05:49.638057 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:05:49.638057 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:05:49.638057 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 12:05:49.638057 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:05:49.638057 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 596/1180] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Sep 5 12:05:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:05:49.647157 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc02a9df-b1dd-49cb-802d-9f6a781fe002 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:05:49.692336 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:05:49.756352 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc02a9df-b1dd-49cb-802d-9f6a781fe002 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:05:49.794953 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f336971a-4966-43ce-98a9-7f49fe6944e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:05:49.795684 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f336971a-4966-43ce-98a9-7f49fe6944e3 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:05:49.796050 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f336971a-4966-43ce-98a9-7f49fe6944e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:05:49.796417 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f336971a-4966-43ce-98a9-7f49fe6944e3 None admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:05:49.797235 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f336971a-4966-43ce-98a9-7f49fe6944e3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:05:49.797643 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f336971a-4966-43ce-98a9-7f49fe6944e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:05:49.799125 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f336971a-4966-43ce-98a9-7f49fe6944e3 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:05:49.808408 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 585/1181] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Sep 5 12:05:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:05:49.814731 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839acceb-d429-49c5-b806-a164c552b177 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:05:49.921685 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839acceb-d429-49c5-b806-a164c552b177 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:05:49.958644 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94faaecf-faf2-493e-910a-b6cac9976780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:05:49.959294 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94faaecf-faf2-493e-910a-b6cac9976780 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:05:49.959573 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94faaecf-faf2-493e-910a-b6cac9976780 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:05:49.959847 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94faaecf-faf2-493e-910a-b6cac9976780 None admin] PATH_INFO: `/v3/users/10c2c3e2b5274d7f822c3ccf9ae40686` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:05:49.976340 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94faaecf-faf2-493e-910a-b6cac9976780 None admin] RBAC: Authorizing `identity:get_user(user_id=10c2c3e2b5274d7f822c3ccf9ae40686)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:05:49.977887 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94faaecf-faf2-493e-910a-b6cac9976780 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:05:49.979610 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 597/1182] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Sep 5 12:05:49 2022] GET /identity/v3/users/10c2c3e2b5274d7f822c3ccf9ae40686 => generated 311 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:05:49.985890 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f336971a-4966-43ce-98a9-7f49fe6944e3 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:05:50.116077 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f336971a-4966-43ce-98a9-7f49fe6944e3 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:05:50.120734 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:05:50.156337 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7636a902-c7e5-4f77-88b7-736e4e0ffd95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:05:50.156995 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7636a902-c7e5-4f77-88b7-736e4e0ffd95 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:05:50.157281 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7636a902-c7e5-4f77-88b7-736e4e0ffd95 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:05:50.157557 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7636a902-c7e5-4f77-88b7-736e4e0ffd95 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:05:50.230210 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7636a902-c7e5-4f77-88b7-736e4e0ffd95 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:05:50.231609 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7636a902-c7e5-4f77-88b7-736e4e0ffd95 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:05:50.342671 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 586/1183] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Sep 5 12:05:49 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 05 12:05:50.349748 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94faaecf-faf2-493e-910a-b6cac9976780 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:05:50.396816 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:05:50.475868 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94faaecf-faf2-493e-910a-b6cac9976780 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:05:50.542065 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51cc570-b685-41fe-a787-c1b09e2dcf37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:05:50.543011 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51cc570-b685-41fe-a787-c1b09e2dcf37 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:05:50.543460 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51cc570-b685-41fe-a787-c1b09e2dcf37 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:05:50.543916 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51cc570-b685-41fe-a787-c1b09e2dcf37 None admin] PATH_INFO: `/v3/projects/1cd9a855928d4f619728564adc6fe419` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:05:50.545895 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51cc570-b685-41fe-a787-c1b09e2dcf37 None admin] RBAC: Authorizing `identity:get_project(project_id=1cd9a855928d4f619728564adc6fe419)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:05:50.548445 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51cc570-b685-41fe-a787-c1b09e2dcf37 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:05:50.550546 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 598/1184] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Sep 5 12:05:50 2022] GET /identity/v3/projects/1cd9a855928d4f619728564adc6fe419 => generated 361 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:05:50.557894 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7636a902-c7e5-4f77-88b7-736e4e0ffd95 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:05:50.561318 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:05:50.706708 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7636a902-c7e5-4f77-88b7-736e4e0ffd95 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:05:50.741761 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc15464e-b536-4329-9d0e-a57ea26b01ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:05:50.742375 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc15464e-b536-4329-9d0e-a57ea26b01ae None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:05:50.742653 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc15464e-b536-4329-9d0e-a57ea26b01ae None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:05:50.743501 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc15464e-b536-4329-9d0e-a57ea26b01ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:05:50.744228 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc15464e-b536-4329-9d0e-a57ea26b01ae None admin] RBAC: Adding query filter params (role.id=16e2ccc8bd1b497d8cee780c1c7df0d2, scope.project.id=1cd9a855928d4f619728564adc6fe419, user.id=10c2c3e2b5274d7f822c3ccf9ae40686) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:05:50.744532 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc15464e-b536-4329-9d0e-a57ea26b01ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:05:50.746011 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc15464e-b536-4329-9d0e-a57ea26b01ae None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:05:50.751896 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 587/1185] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Sep 5 12:05:50 2022] GET /identity/v3/role_assignments?user.id=10c2c3e2b5274d7f822c3ccf9ae40686&scope.project.id=1cd9a855928d4f619728564adc6fe419&role.id=16e2ccc8bd1b497d8cee780c1c7df0d2 => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:05:52.684550 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f3317a-c4c5-4a0b-a618-8618fb7bb0c8 None None] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:05:52.685264 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f3317a-c4c5-4a0b-a618-8618fb7bb0c8 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:05:52.685264 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f3317a-c4c5-4a0b-a618-8618fb7bb0c8 None None] PATH_INFO: `/` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:05:52.686456 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 599/1186] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:05:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:05:52.691896 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317bd20f-90d2-49ca-a0d6-6f86d37503a0 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:05:52.692406 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317bd20f-90d2-49ca-a0d6-6f86d37503a0 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:05:52.692543 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317bd20f-90d2-49ca-a0d6-6f86d37503a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:05:52.710906 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-317bd20f-90d2-49ca-a0d6-6f86d37503a0 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:05:52.712198 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-317bd20f-90d2-49ca-a0d6-6f86d37503a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:05:52.777032 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:05:52.784016 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 588/1187] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:05:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 12:05:53.053209 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f3317a-c4c5-4a0b-a618-8618fb7bb0c8 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:05:53.161185 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f3317a-c4c5-4a0b-a618-8618fb7bb0c8 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:05:53.163965 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:05:53.198458 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92e58e9-1959-4739-ad04-d0349f4563cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:05:53.199096 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92e58e9-1959-4739-ad04-d0349f4563cf None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:05:53.199380 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92e58e9-1959-4739-ad04-d0349f4563cf None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:05:53.199655 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92e58e9-1959-4739-ad04-d0349f4563cf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:05:53.210370 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92e58e9-1959-4739-ad04-d0349f4563cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:05:53.215847 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application [None req-c92e58e9-1959-4739-ad04-d0349f4563cf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 12:05:53.215847 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:05:53.215847 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:05:53.215847 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:05:53.215847 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:05:53.215847 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:05:53.215847 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:05:53.215847 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:05:53.215847 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:05:53.215847 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:05:53.215847 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:05:53.215847 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:05:53.215847 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:05:53.215847 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:05:53.215847 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:05:53.215847 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:05:53.217583 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:05:53.217583 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:05:53.217583 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:05:53.217583 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:05:53.217583 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:05:53.217583 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:05:53.217583 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:05:53.217583 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:05:53.217583 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:05:53.217583 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:05:53.217583 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:05:53.217583 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application with Lock( Sep 05 12:05:53.217583 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:05:53.217583 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:05:53.217583 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:05:53.217583 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:05:53.219135 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:05:53.219135 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:05:53.219135 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:05:53.219135 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:05:53.219135 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:05:53.219135 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:05:53.219135 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:05:53.219135 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:05:53.219135 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:05:53.219135 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:05:53.219135 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 12:05:53.219135 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:05:53.219135 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 600/1188] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Sep 5 12:05:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 12:05:53.227039 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317bd20f-90d2-49ca-a0d6-6f86d37503a0 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:05:53.392418 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317bd20f-90d2-49ca-a0d6-6f86d37503a0 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:05:53.452458 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ead8a38-c66a-4863-824b-7edb7c8e5a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:05:53.453529 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ead8a38-c66a-4863-824b-7edb7c8e5a7c None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:05:53.454013 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ead8a38-c66a-4863-824b-7edb7c8e5a7c None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:05:53.454508 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ead8a38-c66a-4863-824b-7edb7c8e5a7c None admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:05:53.455690 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ead8a38-c66a-4863-824b-7edb7c8e5a7c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:05:53.456228 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ead8a38-c66a-4863-824b-7edb7c8e5a7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:05:53.458851 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ead8a38-c66a-4863-824b-7edb7c8e5a7c None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:05:53.474765 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 589/1189] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Sep 5 12:05:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:05:53.481073 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92e58e9-1959-4739-ad04-d0349f4563cf None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:05:53.589630 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92e58e9-1959-4739-ad04-d0349f4563cf None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:05:53.625794 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308e002c-42c9-46fc-974e-d01a86891be3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:05:53.626444 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308e002c-42c9-46fc-974e-d01a86891be3 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:05:53.626744 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308e002c-42c9-46fc-974e-d01a86891be3 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:05:53.627018 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308e002c-42c9-46fc-974e-d01a86891be3 None admin] PATH_INFO: `/v3/users/10c2c3e2b5274d7f822c3ccf9ae40686` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:05:53.628208 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308e002c-42c9-46fc-974e-d01a86891be3 None admin] RBAC: Authorizing `identity:get_user(user_id=10c2c3e2b5274d7f822c3ccf9ae40686)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:05:53.629682 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308e002c-42c9-46fc-974e-d01a86891be3 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:05:53.631301 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 601/1190] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Sep 5 12:05:53 2022] GET /identity/v3/users/10c2c3e2b5274d7f822c3ccf9ae40686 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:05:53.638154 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ead8a38-c66a-4863-824b-7edb7c8e5a7c None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:05:53.701888 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:05:53.745423 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ead8a38-c66a-4863-824b-7edb7c8e5a7c None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:05:53.783460 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abb7e9a-17eb-4f4f-ae09-3a6f9701ff05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:05:53.784111 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abb7e9a-17eb-4f4f-ae09-3a6f9701ff05 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:05:53.784392 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abb7e9a-17eb-4f4f-ae09-3a6f9701ff05 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:05:53.784663 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abb7e9a-17eb-4f4f-ae09-3a6f9701ff05 None admin] PATH_INFO: `/v3/projects/1cd9a855928d4f619728564adc6fe419` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:05:53.786455 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abb7e9a-17eb-4f4f-ae09-3a6f9701ff05 None admin] RBAC: Authorizing `identity:get_project(project_id=1cd9a855928d4f619728564adc6fe419)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:05:53.787345 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abb7e9a-17eb-4f4f-ae09-3a6f9701ff05 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:05:53.789061 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 590/1191] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Sep 5 12:05:53 2022] GET /identity/v3/projects/1cd9a855928d4f619728564adc6fe419 => generated 361 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:05:53.795288 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308e002c-42c9-46fc-974e-d01a86891be3 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:05:53.829147 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:05:53.903952 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308e002c-42c9-46fc-974e-d01a86891be3 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:05:53.939776 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957dab9a-a31f-4629-9a32-f9ca632307c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:05:53.940445 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957dab9a-a31f-4629-9a32-f9ca632307c2 None admin] REQUEST_METHOD: `PUT` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:05:53.940723 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957dab9a-a31f-4629-9a32-f9ca632307c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:05:53.941022 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957dab9a-a31f-4629-9a32-f9ca632307c2 None admin] PATH_INFO: `/v3/projects/1cd9a855928d4f619728564adc6fe419/users/10c2c3e2b5274d7f822c3ccf9ae40686/roles/16e2ccc8bd1b497d8cee780c1c7df0d2` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:05:53.942927 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957dab9a-a31f-4629-9a32-f9ca632307c2 None admin] RBAC: Authorizing `identity:create_grant(project_id=1cd9a855928d4f619728564adc6fe419, user_id=10c2c3e2b5274d7f822c3ccf9ae40686, role_id=16e2ccc8bd1b497d8cee780c1c7df0d2)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:05:53.944351 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957dab9a-a31f-4629-9a32-f9ca632307c2 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:05:53.960294 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 602/1192] 10.222.0.50 () {58 vars in 1439 bytes} [Mon Sep 5 12:05:53 2022] PUT /identity/v3/projects/1cd9a855928d4f619728564adc6fe419/users/10c2c3e2b5274d7f822c3ccf9ae40686/roles/16e2ccc8bd1b497d8cee780c1c7df0d2 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 12:05:55.870385 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e50b702-aebd-4a68-96b8-5c61f96060fa None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:05:55.870910 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e50b702-aebd-4a68-96b8-5c61f96060fa None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:05:55.871025 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e50b702-aebd-4a68-96b8-5c61f96060fa None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:05:55.872286 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 591/1193] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:05:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:05:55.877718 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb13154b-3d6d-4218-b626-b458c9e8aa88 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:05:55.878130 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb13154b-3d6d-4218-b626-b458c9e8aa88 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:05:55.878265 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb13154b-3d6d-4218-b626-b458c9e8aa88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:05:55.897146 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-cb13154b-3d6d-4218-b626-b458c9e8aa88 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:05:55.898610 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-cb13154b-3d6d-4218-b626-b458c9e8aa88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:05:55.980581 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 603/1194] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:05:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 12:05:56.250547 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e50b702-aebd-4a68-96b8-5c61f96060fa None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:05:56.356638 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e50b702-aebd-4a68-96b8-5c61f96060fa None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:05:56.384108 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:05:56.392015 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2546e688-7c27-4596-8225-17130e27dd30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:05:56.392657 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2546e688-7c27-4596-8225-17130e27dd30 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:05:56.392963 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2546e688-7c27-4596-8225-17130e27dd30 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:05:56.393240 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2546e688-7c27-4596-8225-17130e27dd30 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:05:56.404521 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2546e688-7c27-4596-8225-17130e27dd30 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:05:56.409368 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-2546e688-7c27-4596-8225-17130e27dd30 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 12:05:56.409368 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:05:56.409368 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:05:56.409368 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:05:56.409368 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:05:56.409368 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:05:56.409368 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:05:56.409368 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:05:56.409368 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:05:56.409368 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:05:56.409368 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:05:56.409368 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:05:56.409368 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:05:56.409368 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:05:56.409368 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:05:56.409368 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:05:56.410493 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:05:56.410493 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:05:56.410493 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:05:56.410493 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:05:56.410493 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:05:56.410493 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:05:56.410493 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:05:56.410493 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:05:56.410493 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:05:56.410493 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:05:56.410493 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:05:56.410493 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:05:56.410493 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:05:56.410493 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:05:56.410493 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:05:56.410493 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:05:56.411385 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:05:56.411385 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:05:56.411385 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:05:56.411385 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:05:56.411385 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:05:56.411385 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:05:56.411385 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:05:56.411385 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:05:56.411385 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:05:56.411385 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:05:56.411385 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 12:05:56.411385 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:05:56.411385 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 592/1195] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Sep 5 12:05:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:05:56.416723 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb13154b-3d6d-4218-b626-b458c9e8aa88 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:05:56.440468 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:05:56.523487 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb13154b-3d6d-4218-b626-b458c9e8aa88 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:05:56.558671 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ac3896-997f-479f-857f-28ce09a68289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:05:56.559272 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ac3896-997f-479f-857f-28ce09a68289 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:05:56.559549 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ac3896-997f-479f-857f-28ce09a68289 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:05:56.559818 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ac3896-997f-479f-857f-28ce09a68289 None admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:05:56.560482 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ac3896-997f-479f-857f-28ce09a68289 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:05:56.560779 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ac3896-997f-479f-857f-28ce09a68289 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:05:56.562191 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ac3896-997f-479f-857f-28ce09a68289 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:05:56.571614 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 604/1196] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Sep 5 12:05:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:05:56.577665 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2546e688-7c27-4596-8225-17130e27dd30 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:05:56.680484 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2546e688-7c27-4596-8225-17130e27dd30 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:05:56.716298 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c96f02-314d-4a05-a083-fbab29bee890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:05:56.716945 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c96f02-314d-4a05-a083-fbab29bee890 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:05:56.717231 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c96f02-314d-4a05-a083-fbab29bee890 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:05:56.717500 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c96f02-314d-4a05-a083-fbab29bee890 None admin] PATH_INFO: `/v3/users/10c2c3e2b5274d7f822c3ccf9ae40686` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:05:56.718646 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c96f02-314d-4a05-a083-fbab29bee890 None admin] RBAC: Authorizing `identity:get_user(user_id=10c2c3e2b5274d7f822c3ccf9ae40686)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:05:56.720097 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c96f02-314d-4a05-a083-fbab29bee890 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:05:56.721719 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 593/1197] 10.222.0.50 () {56 vars in 1177 bytes} [Mon Sep 5 12:05:56 2022] GET /identity/v3/users/10c2c3e2b5274d7f822c3ccf9ae40686 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:05:56.727759 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ac3896-997f-479f-857f-28ce09a68289 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:05:56.814406 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:05:56.832198 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ac3896-997f-479f-857f-28ce09a68289 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:05:56.871693 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e271dd6-d44d-424f-a1e9-87a613fa0ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:05:56.872330 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e271dd6-d44d-424f-a1e9-87a613fa0ccf None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:05:56.872607 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e271dd6-d44d-424f-a1e9-87a613fa0ccf None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:05:56.872879 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e271dd6-d44d-424f-a1e9-87a613fa0ccf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:05:56.955403 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e271dd6-d44d-424f-a1e9-87a613fa0ccf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:05:56.956882 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e271dd6-d44d-424f-a1e9-87a613fa0ccf None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:05:57.048253 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:05:57.066669 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 605/1198] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Sep 5 12:05:56 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 05 12:05:57.073874 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c96f02-314d-4a05-a083-fbab29bee890 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:05:57.132792 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:05:57.179478 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c96f02-314d-4a05-a083-fbab29bee890 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:05:57.215891 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1b2124-c2ea-4269-84fa-cc28089410a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:05:57.216541 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1b2124-c2ea-4269-84fa-cc28089410a1 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:05:57.216823 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1b2124-c2ea-4269-84fa-cc28089410a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:05:57.217125 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1b2124-c2ea-4269-84fa-cc28089410a1 None admin] PATH_INFO: `/v3/projects/1cd9a855928d4f619728564adc6fe419` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:05:57.218294 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1b2124-c2ea-4269-84fa-cc28089410a1 None admin] RBAC: Authorizing `identity:get_project(project_id=1cd9a855928d4f619728564adc6fe419)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:05:57.219766 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1b2124-c2ea-4269-84fa-cc28089410a1 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:05:57.221508 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 594/1199] 10.222.0.50 () {56 vars in 1186 bytes} [Mon Sep 5 12:05:57 2022] GET /identity/v3/projects/1cd9a855928d4f619728564adc6fe419 => generated 361 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:05:57.228467 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e271dd6-d44d-424f-a1e9-87a613fa0ccf None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:05:57.334786 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e271dd6-d44d-424f-a1e9-87a613fa0ccf None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:05:57.390415 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d376eaef-dfdf-4fc3-ba1a-c7927f8322c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:05:57.391028 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d376eaef-dfdf-4fc3-ba1a-c7927f8322c2 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:05:57.391310 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d376eaef-dfdf-4fc3-ba1a-c7927f8322c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:05:57.391584 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d376eaef-dfdf-4fc3-ba1a-c7927f8322c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:05:57.392320 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d376eaef-dfdf-4fc3-ba1a-c7927f8322c2 None admin] RBAC: Adding query filter params (role.id=16e2ccc8bd1b497d8cee780c1c7df0d2, scope.project.id=1cd9a855928d4f619728564adc6fe419, user.id=10c2c3e2b5274d7f822c3ccf9ae40686) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:05:57.392630 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d376eaef-dfdf-4fc3-ba1a-c7927f8322c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:05:57.394108 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d376eaef-dfdf-4fc3-ba1a-c7927f8322c2 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:05:57.400801 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 606/1200] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Sep 5 12:05:57 2022] GET /identity/v3/role_assignments?user.id=10c2c3e2b5274d7f822c3ccf9ae40686&scope.project.id=1cd9a855928d4f619728564adc6fe419&role.id=16e2ccc8bd1b497d8cee780c1c7df0d2 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:06:07.212191 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=38 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:06:07.398343 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=76 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:06:55.484353 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779311ef-6f01-4592-b8cb-ab56b681ce60 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:06:55.485266 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779311ef-6f01-4592-b8cb-ab56b681ce60 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:06:55.485533 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779311ef-6f01-4592-b8cb-ab56b681ce60 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:06:55.488476 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 595/1201] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:06:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:06:55.497245 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660f1622-ea89-4e60-a8c1-2e673c2da236 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:06:55.497950 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660f1622-ea89-4e60-a8c1-2e673c2da236 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:06:55.498037 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660f1622-ea89-4e60-a8c1-2e673c2da236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:06:55.522284 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-660f1622-ea89-4e60-a8c1-2e673c2da236 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:06:55.524409 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-660f1622-ea89-4e60-a8c1-2e673c2da236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:06:55.666965 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 607/1202] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:06:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 05 12:06:55.935614 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779311ef-6f01-4592-b8cb-ab56b681ce60 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:06:56.116850 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779311ef-6f01-4592-b8cb-ab56b681ce60 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:06:56.188568 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3f6369-a0d2-42af-8340-997648efc9de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:06:56.189250 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3f6369-a0d2-42af-8340-997648efc9de None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:06:56.189539 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3f6369-a0d2-42af-8340-997648efc9de None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:06:56.189804 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3f6369-a0d2-42af-8340-997648efc9de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:06:56.201948 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3f6369-a0d2-42af-8340-997648efc9de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:06:56.203422 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3f6369-a0d2-42af-8340-997648efc9de None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:06:56.225294 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-1a3f6369-a0d2-42af-8340-997648efc9de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:06:56.225294 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:06:56.225294 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:06:56.225294 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:06:56.225294 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:06:56.225294 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:06:56.225294 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:06:56.225294 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:06:56.225294 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:06:56.225294 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:06:56.225294 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:06:56.225294 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:06:56.225294 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:06:56.225294 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:06:56.225294 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:06:56.225294 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:06:56.227798 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:06:56.227798 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:06:56.227798 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:06:56.227798 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:06:56.227798 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:06:56.227798 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:06:56.227798 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:06:56.227798 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:06:56.227798 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:06:56.227798 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:06:56.227798 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:06:56.227798 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:06:56.227798 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:06:56.227798 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:06:56.227798 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:06:56.227798 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:06:56.227798 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:06:56.229807 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:06:56.229807 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:06:56.229807 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:06:56.232523 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 596/1203] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 5 12:06:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:06:56.240169 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660f1622-ea89-4e60-a8c1-2e673c2da236 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:06:56.413061 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660f1622-ea89-4e60-a8c1-2e673c2da236 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:06:56.451345 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:06:56.458475 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d437ae31-de3e-4be2-8504-b86c033fa98a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:06:56.459333 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d437ae31-de3e-4be2-8504-b86c033fa98a None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:06:56.459668 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d437ae31-de3e-4be2-8504-b86c033fa98a None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:06:56.460106 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d437ae31-de3e-4be2-8504-b86c033fa98a None admin] PATH_INFO: `/v3/domains` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:06:56.461668 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d437ae31-de3e-4be2-8504-b86c033fa98a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:06:56.466621 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d437ae31-de3e-4be2-8504-b86c033fa98a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:06:56.469751 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d437ae31-de3e-4be2-8504-b86c033fa98a None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:06:56.486144 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 608/1204] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 5 12:06:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:06:56.492830 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3f6369-a0d2-42af-8340-997648efc9de None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:06:56.559582 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:06:56.620887 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3f6369-a0d2-42af-8340-997648efc9de None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:06:56.662461 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c443a7c-d556-4be8-82b8-1466fd0ccfab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:06:56.663220 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c443a7c-d556-4be8-82b8-1466fd0ccfab None admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:06:56.663526 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c443a7c-d556-4be8-82b8-1466fd0ccfab None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:06:56.663874 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c443a7c-d556-4be8-82b8-1466fd0ccfab None admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:06:56.664604 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c443a7c-d556-4be8-82b8-1466fd0ccfab None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:06:56.666150 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c443a7c-d556-4be8-82b8-1466fd0ccfab None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:06:56.696996 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 597/1205] 10.222.0.50 () {60 vars in 1132 bytes} [Mon Sep 5 12:06:56 2022] POST /identity/v3/users => generated 251 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 12:06:59.688026 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef43cc45-db0f-4a9f-ad4f-3b20d1af5c79 None None] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:06:59.690349 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef43cc45-db0f-4a9f-ad4f-3b20d1af5c79 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:06:59.690349 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef43cc45-db0f-4a9f-ad4f-3b20d1af5c79 None None] PATH_INFO: `/` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:06:59.690660 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 609/1206] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:06:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:06:59.698425 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ee4ec5-65ab-4b5e-8b05-bac24af64686 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:06:59.699370 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ee4ec5-65ab-4b5e-8b05-bac24af64686 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:06:59.699370 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ee4ec5-65ab-4b5e-8b05-bac24af64686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:06:59.722673 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-51ee4ec5-65ab-4b5e-8b05-bac24af64686 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:06:59.723990 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-51ee4ec5-65ab-4b5e-8b05-bac24af64686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:06:59.848185 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 598/1207] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:06:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 12:07:00.140002 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef43cc45-db0f-4a9f-ad4f-3b20d1af5c79 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:07:00.326454 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef43cc45-db0f-4a9f-ad4f-3b20d1af5c79 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:07:00.386628 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3539db45-8888-4456-94ae-998dbc74aa5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:07:00.387336 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3539db45-8888-4456-94ae-998dbc74aa5f None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:07:00.387640 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3539db45-8888-4456-94ae-998dbc74aa5f None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:07:00.387878 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3539db45-8888-4456-94ae-998dbc74aa5f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:07:00.407099 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3539db45-8888-4456-94ae-998dbc74aa5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:07:00.412513 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application [None req-3539db45-8888-4456-94ae-998dbc74aa5f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 05 12:07:00.412513 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:07:00.412513 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:07:00.412513 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:07:00.412513 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:07:00.412513 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:07:00.412513 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:07:00.412513 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:07:00.412513 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:07:00.412513 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:07:00.412513 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:07:00.412513 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:07:00.412513 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:07:00.412513 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:07:00.412513 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:07:00.412513 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:07:00.415645 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:07:00.415645 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:07:00.415645 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:07:00.415645 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:07:00.415645 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:07:00.415645 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:07:00.415645 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:07:00.415645 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:07:00.415645 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:07:00.415645 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:07:00.415645 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:07:00.415645 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application with Lock( Sep 05 12:07:00.415645 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:07:00.415645 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:07:00.415645 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:07:00.415645 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:07:00.418394 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:07:00.418394 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:07:00.418394 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:07:00.418394 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:07:00.418394 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:07:00.418394 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:07:00.418394 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:07:00.418394 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:07:00.418394 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:07:00.418394 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:07:00.418394 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 05 12:07:00.418394 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:07:00.422717 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 610/1208] 10.222.0.50 () {56 vars in 1102 bytes} [Mon Sep 5 12:07:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:07:00.424559 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ee4ec5-65ab-4b5e-8b05-bac24af64686 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:07:00.495113 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:07:00.591775 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ee4ec5-65ab-4b5e-8b05-bac24af64686 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:07:00.658118 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99437b6f-abce-47d3-9e2d-c548962f09b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:07:00.658674 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99437b6f-abce-47d3-9e2d-c548962f09b7 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:07:00.658982 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99437b6f-abce-47d3-9e2d-c548962f09b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:07:00.659325 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99437b6f-abce-47d3-9e2d-c548962f09b7 None admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:07:00.660073 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99437b6f-abce-47d3-9e2d-c548962f09b7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:07:00.660646 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99437b6f-abce-47d3-9e2d-c548962f09b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:07:00.662142 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99437b6f-abce-47d3-9e2d-c548962f09b7 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:07:00.673063 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 599/1209] 10.222.0.50 () {56 vars in 1103 bytes} [Mon Sep 5 12:07:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:07:00.679766 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3539db45-8888-4456-94ae-998dbc74aa5f None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:07:00.764664 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:07:00.868564 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3539db45-8888-4456-94ae-998dbc74aa5f None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:07:00.919116 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d264cc3e-b8cd-4101-979e-50b8dcf3bcd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:07:00.919116 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d264cc3e-b8cd-4101-979e-50b8dcf3bcd7 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:07:00.919116 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d264cc3e-b8cd-4101-979e-50b8dcf3bcd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:07:00.919116 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d264cc3e-b8cd-4101-979e-50b8dcf3bcd7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:07:00.932072 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d264cc3e-b8cd-4101-979e-50b8dcf3bcd7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:07:00.934587 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d264cc3e-b8cd-4101-979e-50b8dcf3bcd7 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:07:00.963893 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application [None req-d264cc3e-b8cd-4101-979e-50b8dcf3bcd7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:07:00.963893 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:07:00.963893 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:07:00.963893 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:07:00.963893 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:07:00.963893 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:07:00.963893 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:07:00.963893 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:07:00.963893 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:07:00.963893 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:07:00.963893 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:07:00.963893 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:07:00.963893 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:07:00.963893 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:07:00.963893 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:07:00.963893 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:07:00.965761 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:07:00.965761 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:07:00.965761 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:07:00.965761 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:07:00.965761 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:07:00.965761 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:07:00.965761 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:07:00.965761 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application with Lock( Sep 05 12:07:00.965761 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:07:00.965761 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:07:00.965761 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:07:00.965761 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:07:00.965761 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:07:00.965761 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:07:00.965761 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:07:00.965761 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:07:00.965761 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:07:00.968165 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:07:00.968165 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:07:00.968165 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:07:00.968165 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 611/1210] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 5 12:07:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:07:00.972804 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99437b6f-abce-47d3-9e2d-c548962f09b7 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:07:01.138947 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:07:01.146433 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99437b6f-abce-47d3-9e2d-c548962f09b7 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:07:01.216026 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f62582c-ef2f-4a9c-b075-511904a9b84d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:07:01.216638 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f62582c-ef2f-4a9c-b075-511904a9b84d None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:07:01.217089 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f62582c-ef2f-4a9c-b075-511904a9b84d None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:07:01.217388 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f62582c-ef2f-4a9c-b075-511904a9b84d None admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:07:01.218261 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f62582c-ef2f-4a9c-b075-511904a9b84d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:07:01.218568 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f62582c-ef2f-4a9c-b075-511904a9b84d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:07:01.220226 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f62582c-ef2f-4a9c-b075-511904a9b84d None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:07:01.240104 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 600/1211] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 5 12:07:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:07:01.247116 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d264cc3e-b8cd-4101-979e-50b8dcf3bcd7 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:07:01.421889 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d264cc3e-b8cd-4101-979e-50b8dcf3bcd7 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:07:01.424562 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:07:01.482277 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d1eb97-df8b-4bed-8b10-b56c4e2e5802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:07:01.483206 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d1eb97-df8b-4bed-8b10-b56c4e2e5802 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:07:01.483847 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d1eb97-df8b-4bed-8b10-b56c4e2e5802 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:07:01.484333 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d1eb97-df8b-4bed-8b10-b56c4e2e5802 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:07:01.497944 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d1eb97-df8b-4bed-8b10-b56c4e2e5802 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:07:01.500106 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d1eb97-df8b-4bed-8b10-b56c4e2e5802 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:07:01.520704 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application [None req-31d1eb97-df8b-4bed-8b10-b56c4e2e5802 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 05 12:07:01.520704 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:07:01.520704 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:07:01.520704 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:07:01.520704 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:07:01.520704 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:07:01.520704 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:07:01.520704 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:07:01.520704 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:07:01.520704 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:07:01.520704 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:07:01.520704 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:07:01.520704 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 12:07:01.520704 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 12:07:01.520704 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 12:07:01.520704 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 12:07:01.522518 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:07:01.522518 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:07:01.522518 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 12:07:01.522518 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:07:01.522518 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 12:07:01.522518 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:07:01.522518 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:07:01.522518 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:07:01.522518 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:07:01.522518 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:07:01.522518 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:07:01.522518 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application with Lock( Sep 05 12:07:01.522518 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:07:01.522518 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:07:01.522518 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:07:01.522518 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:07:01.522518 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:07:01.522518 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:07:01.525115 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:07:01.525115 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:07:01.525115 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 12:07:01.525115 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 12:07:01.525115 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 12:07:01.525115 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 12:07:01.525115 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 12:07:01.525115 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 12:07:01.525115 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 05 12:07:01.525115 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:07:01.525115 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 612/1212] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 5 12:07:01 2022] GET /identity/v3/users/placement => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:07:01.531648 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f62582c-ef2f-4a9c-b075-511904a9b84d None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:07:01.696401 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f62582c-ef2f-4a9c-b075-511904a9b84d None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:07:01.777025 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3033f96c-1198-478c-9761-6591700a4136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:07:01.778356 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3033f96c-1198-478c-9761-6591700a4136 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:07:01.779032 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3033f96c-1198-478c-9761-6591700a4136 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:07:01.779702 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3033f96c-1198-478c-9761-6591700a4136 None admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:07:01.781244 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3033f96c-1198-478c-9761-6591700a4136 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:07:01.781995 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3033f96c-1198-478c-9761-6591700a4136 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:07:01.784813 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3033f96c-1198-478c-9761-6591700a4136 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:07:01.812952 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 601/1213] 10.222.0.50 () {56 vars in 1143 bytes} [Mon Sep 5 12:07:01 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:07:01.822004 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d1eb97-df8b-4bed-8b10-b56c4e2e5802 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:07:02.006083 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d1eb97-df8b-4bed-8b10-b56c4e2e5802 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:07:02.062284 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccc3f95-2103-4361-bcfe-8790c69a69ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:07:02.062835 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccc3f95-2103-4361-bcfe-8790c69a69ff None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:07:02.063107 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccc3f95-2103-4361-bcfe-8790c69a69ff None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:07:02.063375 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccc3f95-2103-4361-bcfe-8790c69a69ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:07:02.098287 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:07:02.145625 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccc3f95-2103-4361-bcfe-8790c69a69ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:07:02.147292 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccc3f95-2103-4361-bcfe-8790c69a69ff None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:07:02.263872 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 613/1214] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Sep 5 12:07:01 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 05 12:07:02.273813 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3033f96c-1198-478c-9761-6591700a4136 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:07:02.296268 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:07:02.399684 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3033f96c-1198-478c-9761-6591700a4136 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:07:02.441678 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537e0021-ba3e-4d60-84fe-84225f003d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:07:02.442834 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537e0021-ba3e-4d60-84fe-84225f003d3c None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:07:02.443368 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537e0021-ba3e-4d60-84fe-84225f003d3c None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:07:02.443739 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537e0021-ba3e-4d60-84fe-84225f003d3c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:07:02.459210 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537e0021-ba3e-4d60-84fe-84225f003d3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:07:02.461521 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537e0021-ba3e-4d60-84fe-84225f003d3c None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:07:02.479269 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-537e0021-ba3e-4d60-84fe-84225f003d3c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:07:02.479269 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:07:02.479269 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:07:02.479269 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:07:02.479269 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:07:02.479269 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:07:02.479269 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:07:02.479269 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:07:02.479269 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:07:02.479269 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:07:02.479269 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:07:02.479269 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:07:02.479269 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:07:02.479269 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:07:02.479269 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:07:02.479269 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:07:02.481409 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:07:02.481409 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:07:02.481409 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:07:02.481409 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:07:02.481409 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:07:02.481409 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:07:02.481409 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:07:02.481409 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:07:02.481409 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:07:02.481409 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:07:02.481409 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:07:02.481409 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:07:02.481409 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:07:02.481409 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:07:02.481409 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:07:02.481409 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:07:02.481409 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:07:02.483243 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:07:02.483243 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:07:02.483243 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:07:02.483243 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 602/1215] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 5 12:07:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:07:02.487704 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccc3f95-2103-4361-bcfe-8790c69a69ff None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:07:02.559956 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:07:02.613422 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccc3f95-2103-4361-bcfe-8790c69a69ff None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:07:02.655183 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f360f1e-b63d-455f-8429-e8891a65bd72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:07:02.655875 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f360f1e-b63d-455f-8429-e8891a65bd72 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:07:02.656211 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f360f1e-b63d-455f-8429-e8891a65bd72 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:07:02.656658 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f360f1e-b63d-455f-8429-e8891a65bd72 None admin] PATH_INFO: `/v3/domains` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:07:02.657398 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f360f1e-b63d-455f-8429-e8891a65bd72 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:07:02.657786 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f360f1e-b63d-455f-8429-e8891a65bd72 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:07:02.659276 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f360f1e-b63d-455f-8429-e8891a65bd72 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:07:02.679716 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 614/1216] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 5 12:07:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:07:02.681062 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537e0021-ba3e-4d60-84fe-84225f003d3c None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:07:02.775605 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:07:02.823595 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537e0021-ba3e-4d60-84fe-84225f003d3c None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:07:02.866244 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e377c6-d418-4611-b1fd-44211e8be954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:07:02.867420 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e377c6-d418-4611-b1fd-44211e8be954 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:07:02.867701 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e377c6-d418-4611-b1fd-44211e8be954 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:07:02.867974 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e377c6-d418-4611-b1fd-44211e8be954 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:07:02.875698 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e377c6-d418-4611-b1fd-44211e8be954 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:07:02.877218 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e377c6-d418-4611-b1fd-44211e8be954 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:07:02.891277 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-56e377c6-d418-4611-b1fd-44211e8be954 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:07:02.891277 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:07:02.891277 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:07:02.891277 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:07:02.891277 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:07:02.891277 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:07:02.891277 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:07:02.891277 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:07:02.891277 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:07:02.891277 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:07:02.891277 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:07:02.891277 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:07:02.891277 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 12:07:02.891277 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 12:07:02.891277 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 12:07:02.893284 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 12:07:02.893284 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:07:02.893284 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:07:02.893284 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:07:02.893284 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:07:02.893284 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:07:02.893284 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:07:02.893284 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:07:02.893284 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:07:02.893284 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:07:02.893284 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:07:02.893284 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:07:02.893284 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:07:02.893284 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:07:02.893284 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:07:02.893284 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:07:02.893284 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:07:02.894936 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 12:07:02.894936 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 12:07:02.894936 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 12:07:02.894936 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 12:07:02.894936 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 12:07:02.894936 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 12:07:02.894936 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:07:02.894936 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:07:02.894936 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 603/1217] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Sep 5 12:07:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:07:02.900168 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f360f1e-b63d-455f-8429-e8891a65bd72 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:07:03.038438 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f360f1e-b63d-455f-8429-e8891a65bd72 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:07:03.071460 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:07:03.083226 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934b0933-a4b2-46dc-8de1-2bb0f3425c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:07:03.083841 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934b0933-a4b2-46dc-8de1-2bb0f3425c6d None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:07:03.084117 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934b0933-a4b2-46dc-8de1-2bb0f3425c6d None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:07:03.084384 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934b0933-a4b2-46dc-8de1-2bb0f3425c6d None admin] PATH_INFO: `/v3/projects` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:07:03.085117 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934b0933-a4b2-46dc-8de1-2bb0f3425c6d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:07:03.085452 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934b0933-a4b2-46dc-8de1-2bb0f3425c6d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:07:03.087032 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934b0933-a4b2-46dc-8de1-2bb0f3425c6d None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:07:03.101125 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 615/1218] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Sep 5 12:07:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:07:03.108117 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e377c6-d418-4611-b1fd-44211e8be954 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:07:03.249422 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e377c6-d418-4611-b1fd-44211e8be954 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:07:03.290268 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:07:03.299124 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a65636e-c31d-4bc5-bbc7-6499b44bd723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:07:03.300000 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a65636e-c31d-4bc5-bbc7-6499b44bd723 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:07:03.300464 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a65636e-c31d-4bc5-bbc7-6499b44bd723 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:07:03.300962 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a65636e-c31d-4bc5-bbc7-6499b44bd723 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:07:03.301888 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a65636e-c31d-4bc5-bbc7-6499b44bd723 None admin] RBAC: Adding query filter params (role.id=fe10209913504171981606bfdf25a9bb, scope.project.id=ae4f8939fcc040bca99783a77e6ede4d, user.id=c5427d0752de4817b6aa25e28c2d9a30) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:07:03.302399 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a65636e-c31d-4bc5-bbc7-6499b44bd723 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:07:03.306042 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a65636e-c31d-4bc5-bbc7-6499b44bd723 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:07:03.315905 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 604/1219] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Sep 5 12:07:03 2022] GET /identity/v3/role_assignments?user.id=c5427d0752de4817b6aa25e28c2d9a30&scope.project.id=ae4f8939fcc040bca99783a77e6ede4d&role.id=fe10209913504171981606bfdf25a9bb => generated 259 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:07:05.356218 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c63f72-287d-4499-b816-be993f53dd75 None None] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:07:05.357640 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c63f72-287d-4499-b816-be993f53dd75 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:07:05.357640 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c63f72-287d-4499-b816-be993f53dd75 None None] PATH_INFO: `/` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:07:05.358727 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 616/1220] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:07:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 12:07:05.366061 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9829cf-1fde-456d-a17c-2eeadbfc44c2 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:07:05.367003 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9829cf-1fde-456d-a17c-2eeadbfc44c2 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:07:05.367003 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9829cf-1fde-456d-a17c-2eeadbfc44c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:07:05.391873 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-ce9829cf-1fde-456d-a17c-2eeadbfc44c2 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:07:05.393224 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-ce9829cf-1fde-456d-a17c-2eeadbfc44c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:07:05.496571 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 605/1221] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:07:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 12:07:05.780084 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c63f72-287d-4499-b816-be993f53dd75 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:07:05.904824 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c63f72-287d-4499-b816-be993f53dd75 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:07:05.948129 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d201d7-8c1a-4b9a-85a5-2c3f24a63a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:07:05.948857 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d201d7-8c1a-4b9a-85a5-2c3f24a63a2b None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:07:05.949215 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d201d7-8c1a-4b9a-85a5-2c3f24a63a2b None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:07:05.949586 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d201d7-8c1a-4b9a-85a5-2c3f24a63a2b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:07:05.963131 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d201d7-8c1a-4b9a-85a5-2c3f24a63a2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:07:05.968966 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application [None req-50d201d7-8c1a-4b9a-85a5-2c3f24a63a2b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 05 12:07:05.968966 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:07:05.968966 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:07:05.968966 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:07:05.968966 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:07:05.968966 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:07:05.968966 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:07:05.968966 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:07:05.968966 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:07:05.968966 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:07:05.968966 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:07:05.968966 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:07:05.968966 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:07:05.968966 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:07:05.968966 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:07:05.968966 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:07:05.970995 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:07:05.970995 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:07:05.970995 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:07:05.970995 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:07:05.970995 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:07:05.970995 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:07:05.970995 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:07:05.970995 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:07:05.970995 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:07:05.970995 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:07:05.970995 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:07:05.970995 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application with Lock( Sep 05 12:07:05.970995 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:07:05.970995 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:07:05.970995 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:07:05.970995 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:07:05.972743 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:07:05.972743 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:07:05.972743 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:07:05.972743 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:07:05.972743 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:07:05.972743 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:07:05.972743 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:07:05.972743 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:07:05.972743 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:07:05.972743 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:07:05.972743 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 05 12:07:05.972743 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:07:05.972743 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 617/1222] 10.222.0.50 () {56 vars in 1102 bytes} [Mon Sep 5 12:07:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 12:07:05.976389 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9829cf-1fde-456d-a17c-2eeadbfc44c2 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:07:06.142800 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9829cf-1fde-456d-a17c-2eeadbfc44c2 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:07:06.178268 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:07:06.193481 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca97968-a5d4-42a4-a6ee-3dd9e9e11a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:07:06.194098 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca97968-a5d4-42a4-a6ee-3dd9e9e11a55 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:07:06.194374 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca97968-a5d4-42a4-a6ee-3dd9e9e11a55 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:07:06.194675 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca97968-a5d4-42a4-a6ee-3dd9e9e11a55 None admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:07:06.195350 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca97968-a5d4-42a4-a6ee-3dd9e9e11a55 None admin] RBAC: Adding query filter params (name=service) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:07:06.195657 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca97968-a5d4-42a4-a6ee-3dd9e9e11a55 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:07:06.197077 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca97968-a5d4-42a4-a6ee-3dd9e9e11a55 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:07:06.205924 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 606/1223] 10.222.0.50 () {56 vars in 1103 bytes} [Mon Sep 5 12:07:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:07:06.211783 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d201d7-8c1a-4b9a-85a5-2c3f24a63a2b None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:07:06.263623 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:07:06.348617 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d201d7-8c1a-4b9a-85a5-2c3f24a63a2b None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:07:06.402367 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b487c93d-ab53-4533-ab1f-3b02df1dea4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:07:06.403122 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b487c93d-ab53-4533-ab1f-3b02df1dea4f None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:07:06.403281 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b487c93d-ab53-4533-ab1f-3b02df1dea4f None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:07:06.403535 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b487c93d-ab53-4533-ab1f-3b02df1dea4f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:07:06.416153 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b487c93d-ab53-4533-ab1f-3b02df1dea4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:07:06.417962 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b487c93d-ab53-4533-ab1f-3b02df1dea4f None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:07:06.439019 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application [None req-b487c93d-ab53-4533-ab1f-3b02df1dea4f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:07:06.439019 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:07:06.439019 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:07:06.439019 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:07:06.439019 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:07:06.439019 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:07:06.439019 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:07:06.439019 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:07:06.439019 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:07:06.439019 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:07:06.439019 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:07:06.439019 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:07:06.439019 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:07:06.439019 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:07:06.439019 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:07:06.439019 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:07:06.440375 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:07:06.440375 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:07:06.440375 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:07:06.440375 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:07:06.440375 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:07:06.440375 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:07:06.440375 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:07:06.440375 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application with Lock( Sep 05 12:07:06.440375 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:07:06.440375 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:07:06.440375 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:07:06.440375 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:07:06.440375 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:07:06.440375 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:07:06.440375 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:07:06.440375 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:07:06.440375 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:07:06.441632 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:07:06.441632 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:07:06.441632 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:07:06.441632 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 618/1224] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 5 12:07:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:07:06.447182 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca97968-a5d4-42a4-a6ee-3dd9e9e11a55 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:07:06.580693 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca97968-a5d4-42a4-a6ee-3dd9e9e11a55 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:07:06.625471 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d72eea1-ac96-4d3a-be4f-85199e3a9fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:07:06.626084 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d72eea1-ac96-4d3a-be4f-85199e3a9fe9 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:07:06.626375 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d72eea1-ac96-4d3a-be4f-85199e3a9fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:07:06.626635 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d72eea1-ac96-4d3a-be4f-85199e3a9fe9 None admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:07:06.627271 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d72eea1-ac96-4d3a-be4f-85199e3a9fe9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:07:06.627572 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d72eea1-ac96-4d3a-be4f-85199e3a9fe9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:07:06.628986 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d72eea1-ac96-4d3a-be4f-85199e3a9fe9 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:07:06.641867 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 607/1225] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 5 12:07:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:07:06.648612 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b487c93d-ab53-4533-ab1f-3b02df1dea4f None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:07:06.757761 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:07:06.764808 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b487c93d-ab53-4533-ab1f-3b02df1dea4f None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:07:06.808342 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb87a2d-ceee-4224-ace3-25b78db157ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:07:06.809061 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb87a2d-ceee-4224-ace3-25b78db157ac None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:07:06.809356 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb87a2d-ceee-4224-ace3-25b78db157ac None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:07:06.809605 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb87a2d-ceee-4224-ace3-25b78db157ac None admin] PATH_INFO: `/v3/users/placement` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:07:06.820595 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb87a2d-ceee-4224-ace3-25b78db157ac None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:07:06.823306 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb87a2d-ceee-4224-ace3-25b78db157ac None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:07:06.840862 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application [None req-dcb87a2d-ceee-4224-ace3-25b78db157ac None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 05 12:07:06.840862 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:07:06.840862 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:07:06.840862 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:07:06.840862 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:07:06.840862 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:07:06.840862 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:07:06.840862 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:07:06.840862 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:07:06.840862 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:07:06.840862 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:07:06.840862 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:07:06.840862 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 12:07:06.840862 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 12:07:06.840862 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 12:07:06.840862 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 12:07:06.842135 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:07:06.842135 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:07:06.842135 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 12:07:06.842135 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:07:06.842135 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 12:07:06.842135 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:07:06.842135 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:07:06.842135 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:07:06.842135 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:07:06.842135 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:07:06.842135 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:07:06.842135 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application with Lock( Sep 05 12:07:06.842135 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:07:06.842135 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:07:06.842135 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:07:06.842135 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:07:06.842135 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:07:06.842135 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:07:06.843197 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:07:06.843197 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:07:06.843197 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 12:07:06.843197 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 12:07:06.843197 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 12:07:06.843197 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 12:07:06.843197 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 12:07:06.843197 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 12:07:06.843197 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 05 12:07:06.843197 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:07:06.843197 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 619/1226] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 5 12:07:06 2022] GET /identity/v3/users/placement => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:07:06.849107 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d72eea1-ac96-4d3a-be4f-85199e3a9fe9 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:07:06.911233 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:07:06.968645 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d72eea1-ac96-4d3a-be4f-85199e3a9fe9 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:07:07.010769 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa76d924-9275-47b7-94a5-35404abb76dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:07:07.011450 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa76d924-9275-47b7-94a5-35404abb76dc None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:07:07.011835 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa76d924-9275-47b7-94a5-35404abb76dc None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:07:07.012167 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa76d924-9275-47b7-94a5-35404abb76dc None admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:07:07.013149 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa76d924-9275-47b7-94a5-35404abb76dc None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:07:07.013512 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa76d924-9275-47b7-94a5-35404abb76dc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:07:07.015550 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa76d924-9275-47b7-94a5-35404abb76dc None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:07:07.039081 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 608/1227] 10.222.0.50 () {56 vars in 1143 bytes} [Mon Sep 5 12:07:06 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:07:07.045607 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb87a2d-ceee-4224-ace3-25b78db157ac None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:07:07.177702 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb87a2d-ceee-4224-ace3-25b78db157ac None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:07:07.220135 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03f8b36-abc7-4534-80e7-c31636415c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:07:07.220874 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03f8b36-abc7-4534-80e7-c31636415c9d None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:07:07.221252 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03f8b36-abc7-4534-80e7-c31636415c9d None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:07:07.221598 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03f8b36-abc7-4534-80e7-c31636415c9d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:07:07.233181 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03f8b36-abc7-4534-80e7-c31636415c9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:07:07.234734 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03f8b36-abc7-4534-80e7-c31636415c9d None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:07:07.251724 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application [None req-a03f8b36-abc7-4534-80e7-c31636415c9d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:07:07.251724 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:07:07.251724 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:07:07.251724 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:07:07.251724 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:07:07.251724 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:07:07.251724 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:07:07.251724 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:07:07.251724 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:07:07.251724 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:07:07.251724 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:07:07.251724 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:07:07.251724 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:07:07.251724 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:07:07.251724 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:07:07.251724 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:07:07.253079 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:07:07.253079 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:07:07.253079 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:07:07.253079 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:07:07.253079 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:07:07.253079 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:07:07.253079 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:07:07.253079 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application with Lock( Sep 05 12:07:07.253079 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:07:07.253079 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:07:07.253079 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:07:07.253079 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:07:07.253079 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:07:07.253079 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:07:07.253079 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:07:07.253079 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:07:07.253079 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:07:07.254520 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:07:07.254520 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:07:07.254520 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:07:07.260183 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 620/1228] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 5 12:07:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:07:07.260391 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa76d924-9275-47b7-94a5-35404abb76dc None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:07:07.389355 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa76d924-9275-47b7-94a5-35404abb76dc None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:07:07.393792 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:07:07.447144 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcadfd8-a27b-43e7-a46f-e2211863ee9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:07:07.447766 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcadfd8-a27b-43e7-a46f-e2211863ee9b None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:07:07.448378 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcadfd8-a27b-43e7-a46f-e2211863ee9b None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:07:07.448378 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcadfd8-a27b-43e7-a46f-e2211863ee9b None admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:07:07.449028 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcadfd8-a27b-43e7-a46f-e2211863ee9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:07:07.449416 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcadfd8-a27b-43e7-a46f-e2211863ee9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:07:07.451397 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcadfd8-a27b-43e7-a46f-e2211863ee9b None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:07:07.467901 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 609/1229] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 5 12:07:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:07:07.476922 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03f8b36-abc7-4534-80e7-c31636415c9d None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:07:07.488009 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:07:07.600504 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03f8b36-abc7-4534-80e7-c31636415c9d None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:07:07.649722 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3546666b-87cf-473c-abbc-6671ee38ccd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:07:07.650740 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3546666b-87cf-473c-abbc-6671ee38ccd8 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:07:07.651229 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3546666b-87cf-473c-abbc-6671ee38ccd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:07:07.651634 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3546666b-87cf-473c-abbc-6671ee38ccd8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:07:07.661044 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3546666b-87cf-473c-abbc-6671ee38ccd8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:07:07.663176 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3546666b-87cf-473c-abbc-6671ee38ccd8 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:07:07.679624 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application [None req-3546666b-87cf-473c-abbc-6671ee38ccd8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:07:07.679624 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:07:07.679624 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:07:07.679624 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:07:07.679624 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:07:07.679624 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:07:07.679624 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:07:07.679624 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:07:07.679624 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:07:07.679624 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:07:07.679624 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:07:07.679624 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:07:07.679624 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 12:07:07.679624 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 12:07:07.679624 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 12:07:07.681577 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 12:07:07.681577 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:07:07.681577 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:07:07.681577 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:07:07.681577 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:07:07.681577 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:07:07.681577 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:07:07.681577 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:07:07.681577 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application with Lock( Sep 05 12:07:07.681577 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:07:07.681577 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:07:07.681577 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:07:07.681577 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:07:07.681577 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:07:07.681577 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:07:07.681577 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:07:07.681577 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:07:07.683190 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 12:07:07.683190 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 12:07:07.683190 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 12:07:07.683190 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 12:07:07.683190 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 12:07:07.683190 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 12:07:07.683190 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:07:07.683190 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:07:07.683190 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 621/1230] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Sep 5 12:07:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:07:07.689900 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcadfd8-a27b-43e7-a46f-e2211863ee9b None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:07:07.843550 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcadfd8-a27b-43e7-a46f-e2211863ee9b None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:07:07.892497 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d85b09a-72b9-424b-9f24-7350c58a4f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:07:07.893313 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d85b09a-72b9-424b-9f24-7350c58a4f9d None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:07:07.893695 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d85b09a-72b9-424b-9f24-7350c58a4f9d None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:07:07.894113 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d85b09a-72b9-424b-9f24-7350c58a4f9d None admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:07:07.895177 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d85b09a-72b9-424b-9f24-7350c58a4f9d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:07:07.895523 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d85b09a-72b9-424b-9f24-7350c58a4f9d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:07:07.897378 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d85b09a-72b9-424b-9f24-7350c58a4f9d None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:07:07.915318 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 610/1231] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Sep 5 12:07:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:07:07.921796 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3546666b-87cf-473c-abbc-6671ee38ccd8 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:07:08.030190 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:07:08.081896 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3546666b-87cf-473c-abbc-6671ee38ccd8 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:07:08.139569 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8eefe0-6227-46ec-bbe2-7ba32621fc7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:07:08.140354 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8eefe0-6227-46ec-bbe2-7ba32621fc7a None admin] REQUEST_METHOD: `PUT` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:07:08.140746 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8eefe0-6227-46ec-bbe2-7ba32621fc7a None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:07:08.141049 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8eefe0-6227-46ec-bbe2-7ba32621fc7a None admin] PATH_INFO: `/v3/projects/ae4f8939fcc040bca99783a77e6ede4d/users/c5427d0752de4817b6aa25e28c2d9a30/roles/fe10209913504171981606bfdf25a9bb` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:07:08.161153 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8eefe0-6227-46ec-bbe2-7ba32621fc7a None admin] RBAC: Authorizing `identity:create_grant(project_id=ae4f8939fcc040bca99783a77e6ede4d, user_id=c5427d0752de4817b6aa25e28c2d9a30, role_id=fe10209913504171981606bfdf25a9bb)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:07:08.163160 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8eefe0-6227-46ec-bbe2-7ba32621fc7a None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:07:08.178659 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 622/1232] 10.222.0.50 () {58 vars in 1439 bytes} [Mon Sep 5 12:07:07 2022] PUT /identity/v3/projects/ae4f8939fcc040bca99783a77e6ede4d/users/c5427d0752de4817b6aa25e28c2d9a30/roles/fe10209913504171981606bfdf25a9bb => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 12:07:10.158023 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a11498-136f-407f-92ab-c14e27419a32 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:07:10.158853 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a11498-136f-407f-92ab-c14e27419a32 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:07:10.158853 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a11498-136f-407f-92ab-c14e27419a32 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:07:10.160607 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 611/1233] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:07:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:07:10.167103 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588d836e-3c8b-464b-94fe-227ea90d189e None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:07:10.167661 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588d836e-3c8b-464b-94fe-227ea90d189e None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:07:10.167661 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588d836e-3c8b-464b-94fe-227ea90d189e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:07:10.187973 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-588d836e-3c8b-464b-94fe-227ea90d189e None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:07:10.189247 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-588d836e-3c8b-464b-94fe-227ea90d189e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:07:10.265917 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 623/1234] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:07:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 12:07:10.557944 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a11498-136f-407f-92ab-c14e27419a32 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:07:10.587511 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:07:10.683570 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a11498-136f-407f-92ab-c14e27419a32 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:07:10.727247 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4032c16e-75d5-40a3-837a-ea3f5c17e373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:07:10.728013 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4032c16e-75d5-40a3-837a-ea3f5c17e373 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:07:10.728328 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4032c16e-75d5-40a3-837a-ea3f5c17e373 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:07:10.728650 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4032c16e-75d5-40a3-837a-ea3f5c17e373 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:07:10.743788 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4032c16e-75d5-40a3-837a-ea3f5c17e373 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:07:10.749690 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-4032c16e-75d5-40a3-837a-ea3f5c17e373 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 05 12:07:10.749690 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:07:10.749690 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:07:10.749690 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:07:10.749690 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:07:10.749690 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:07:10.749690 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:07:10.749690 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:07:10.749690 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:07:10.749690 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:07:10.749690 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:07:10.749690 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:07:10.749690 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:07:10.749690 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:07:10.749690 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:07:10.749690 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:07:10.750784 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:07:10.750784 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:07:10.750784 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:07:10.750784 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:07:10.750784 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:07:10.750784 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:07:10.750784 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:07:10.750784 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:07:10.750784 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:07:10.750784 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:07:10.750784 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:07:10.750784 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:07:10.750784 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:07:10.750784 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:07:10.750784 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:07:10.750784 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:07:10.751650 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:07:10.751650 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:07:10.751650 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:07:10.751650 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:07:10.751650 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:07:10.751650 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:07:10.751650 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:07:10.751650 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:07:10.751650 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:07:10.751650 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:07:10.751650 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 05 12:07:10.751650 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:07:10.751650 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 612/1235] 10.222.0.50 () {56 vars in 1102 bytes} [Mon Sep 5 12:07:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:07:10.757904 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588d836e-3c8b-464b-94fe-227ea90d189e None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:07:10.829718 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:07:10.905207 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588d836e-3c8b-464b-94fe-227ea90d189e None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:07:10.947156 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6ba5c9-fb74-4b11-b33a-119f7cf88d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:07:10.947788 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6ba5c9-fb74-4b11-b33a-119f7cf88d10 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:07:10.948066 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6ba5c9-fb74-4b11-b33a-119f7cf88d10 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:07:10.948336 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6ba5c9-fb74-4b11-b33a-119f7cf88d10 None admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:07:10.949060 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6ba5c9-fb74-4b11-b33a-119f7cf88d10 None admin] RBAC: Adding query filter params (name=service) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:07:10.949364 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6ba5c9-fb74-4b11-b33a-119f7cf88d10 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:07:10.950786 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6ba5c9-fb74-4b11-b33a-119f7cf88d10 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:07:10.959989 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 624/1236] 10.222.0.50 () {56 vars in 1103 bytes} [Mon Sep 5 12:07:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:07:10.966543 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4032c16e-75d5-40a3-837a-ea3f5c17e373 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:07:11.099774 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:07:11.122735 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4032c16e-75d5-40a3-837a-ea3f5c17e373 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:07:11.171472 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce21bb9-3223-4306-b74e-7164a3e71267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:07:11.172713 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce21bb9-3223-4306-b74e-7164a3e71267 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:07:11.172814 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce21bb9-3223-4306-b74e-7164a3e71267 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:07:11.173167 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce21bb9-3223-4306-b74e-7164a3e71267 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:07:11.187928 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce21bb9-3223-4306-b74e-7164a3e71267 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:07:11.189818 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce21bb9-3223-4306-b74e-7164a3e71267 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:07:11.207476 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-7ce21bb9-3223-4306-b74e-7164a3e71267 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:07:11.207476 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:07:11.207476 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:07:11.207476 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:07:11.207476 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:07:11.207476 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:07:11.207476 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:07:11.207476 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:07:11.207476 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:07:11.207476 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:07:11.207476 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:07:11.207476 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:07:11.207476 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:07:11.207476 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:07:11.207476 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:07:11.207476 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:07:11.208586 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:07:11.208586 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:07:11.208586 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:07:11.208586 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:07:11.208586 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:07:11.208586 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:07:11.208586 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:07:11.208586 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:07:11.208586 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:07:11.208586 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:07:11.208586 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:07:11.208586 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:07:11.208586 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:07:11.208586 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:07:11.208586 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:07:11.208586 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:07:11.208586 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:07:11.209599 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:07:11.209599 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:07:11.209599 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:07:11.209599 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 613/1237] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 5 12:07:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 12:07:11.214715 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6ba5c9-fb74-4b11-b33a-119f7cf88d10 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:07:11.337833 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6ba5c9-fb74-4b11-b33a-119f7cf88d10 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:07:11.349315 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:07:11.382803 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187a3e98-2532-413f-9243-c93bb42d06d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:07:11.383422 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187a3e98-2532-413f-9243-c93bb42d06d4 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:07:11.383704 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187a3e98-2532-413f-9243-c93bb42d06d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:07:11.383977 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187a3e98-2532-413f-9243-c93bb42d06d4 None admin] PATH_INFO: `/v3/domains` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:07:11.384628 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187a3e98-2532-413f-9243-c93bb42d06d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:07:11.384954 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187a3e98-2532-413f-9243-c93bb42d06d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:07:11.386346 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187a3e98-2532-413f-9243-c93bb42d06d4 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:07:11.400344 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 625/1238] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 5 12:07:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:07:11.407165 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce21bb9-3223-4306-b74e-7164a3e71267 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:07:11.533462 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce21bb9-3223-4306-b74e-7164a3e71267 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:07:11.579050 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67cc66c-8ed9-4c11-85ba-77705eb0d401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:07:11.579770 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67cc66c-8ed9-4c11-85ba-77705eb0d401 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:07:11.580064 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67cc66c-8ed9-4c11-85ba-77705eb0d401 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:07:11.580354 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67cc66c-8ed9-4c11-85ba-77705eb0d401 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:07:11.586405 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:07:11.594825 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67cc66c-8ed9-4c11-85ba-77705eb0d401 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:07:11.597020 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67cc66c-8ed9-4c11-85ba-77705eb0d401 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:07:11.611738 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-a67cc66c-8ed9-4c11-85ba-77705eb0d401 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 05 12:07:11.611738 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:07:11.611738 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:07:11.611738 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:07:11.611738 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:07:11.611738 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:07:11.611738 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:07:11.611738 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:07:11.611738 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:07:11.611738 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:07:11.611738 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:07:11.611738 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:07:11.611738 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 12:07:11.611738 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 12:07:11.611738 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 12:07:11.611738 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 12:07:11.613069 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:07:11.613069 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:07:11.613069 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 12:07:11.613069 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:07:11.613069 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 12:07:11.613069 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:07:11.613069 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:07:11.613069 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:07:11.613069 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:07:11.613069 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:07:11.613069 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:07:11.613069 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:07:11.613069 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:07:11.613069 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:07:11.613069 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:07:11.613069 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:07:11.613069 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:07:11.613069 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:07:11.614637 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:07:11.614637 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:07:11.614637 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 12:07:11.614637 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 12:07:11.614637 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 12:07:11.614637 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 12:07:11.614637 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 12:07:11.614637 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 12:07:11.614637 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 05 12:07:11.614637 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:07:11.614637 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 614/1239] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 5 12:07:11 2022] GET /identity/v3/users/placement => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:07:11.619809 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187a3e98-2532-413f-9243-c93bb42d06d4 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:07:11.749972 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187a3e98-2532-413f-9243-c93bb42d06d4 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:07:11.798224 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192ed9a9-757c-430a-b559-5da148bc270d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:07:11.798973 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192ed9a9-757c-430a-b559-5da148bc270d None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:07:11.799257 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192ed9a9-757c-430a-b559-5da148bc270d None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:07:11.799594 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192ed9a9-757c-430a-b559-5da148bc270d None admin] PATH_INFO: `/v3/users` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:07:11.800509 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192ed9a9-757c-430a-b559-5da148bc270d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:07:11.800875 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192ed9a9-757c-430a-b559-5da148bc270d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:07:11.802354 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192ed9a9-757c-430a-b559-5da148bc270d None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:07:11.823048 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 626/1240] 10.222.0.50 () {56 vars in 1143 bytes} [Mon Sep 5 12:07:11 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:07:11.829633 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67cc66c-8ed9-4c11-85ba-77705eb0d401 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:07:11.973910 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67cc66c-8ed9-4c11-85ba-77705eb0d401 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:07:12.016582 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db88d499-3c31-451d-9c44-66f6d6727e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:07:12.017162 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db88d499-3c31-451d-9c44-66f6d6727e6a None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:07:12.017462 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db88d499-3c31-451d-9c44-66f6d6727e6a None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:07:12.017756 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db88d499-3c31-451d-9c44-66f6d6727e6a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:07:12.095420 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:07:12.103251 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db88d499-3c31-451d-9c44-66f6d6727e6a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:07:12.104736 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db88d499-3c31-451d-9c44-66f6d6727e6a None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:07:12.229406 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 615/1241] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Sep 5 12:07:11 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 05 12:07:12.235417 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192ed9a9-757c-430a-b559-5da148bc270d None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:07:12.265749 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:07:12.349669 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192ed9a9-757c-430a-b559-5da148bc270d None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:07:12.387274 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6a56a6-fffa-4ae5-9fdb-46022574a090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:07:12.387923 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6a56a6-fffa-4ae5-9fdb-46022574a090 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:07:12.388202 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6a56a6-fffa-4ae5-9fdb-46022574a090 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:07:12.388475 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6a56a6-fffa-4ae5-9fdb-46022574a090 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:07:12.400615 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6a56a6-fffa-4ae5-9fdb-46022574a090 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:07:12.402353 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6a56a6-fffa-4ae5-9fdb-46022574a090 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:07:12.419550 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application [None req-4a6a56a6-fffa-4ae5-9fdb-46022574a090 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:07:12.419550 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:07:12.419550 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:07:12.419550 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:07:12.419550 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:07:12.419550 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:07:12.419550 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:07:12.419550 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:07:12.419550 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:07:12.419550 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:07:12.419550 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:07:12.419550 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:07:12.419550 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:07:12.419550 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:07:12.419550 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:07:12.419550 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:07:12.420641 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:07:12.420641 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:07:12.420641 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:07:12.420641 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:07:12.420641 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:07:12.420641 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:07:12.420641 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:07:12.420641 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application with Lock( Sep 05 12:07:12.420641 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:07:12.420641 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:07:12.420641 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:07:12.420641 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:07:12.420641 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:07:12.420641 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:07:12.420641 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:07:12.420641 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:07:12.420641 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:07:12.421684 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:07:12.421684 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:07:12.421684 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:07:12.421684 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 627/1242] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 5 12:07:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:07:12.428944 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db88d499-3c31-451d-9c44-66f6d6727e6a None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:07:12.551180 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:07:12.558766 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db88d499-3c31-451d-9c44-66f6d6727e6a None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:07:12.598208 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296589a2-409f-4a24-9bf4-f6e90e272aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:07:12.598839 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296589a2-409f-4a24-9bf4-f6e90e272aad None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:07:12.599123 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296589a2-409f-4a24-9bf4-f6e90e272aad None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:07:12.599402 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296589a2-409f-4a24-9bf4-f6e90e272aad None admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:07:12.600109 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296589a2-409f-4a24-9bf4-f6e90e272aad None admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:07:12.600325 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296589a2-409f-4a24-9bf4-f6e90e272aad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:07:12.601797 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296589a2-409f-4a24-9bf4-f6e90e272aad None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:07:12.614089 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 616/1243] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 5 12:07:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:07:12.620493 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6a56a6-fffa-4ae5-9fdb-46022574a090 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:07:12.730646 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:07:12.754590 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6a56a6-fffa-4ae5-9fdb-46022574a090 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:07:12.790573 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93084f2b-106b-42f4-9ce3-2a42f3cc6933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:07:12.791223 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93084f2b-106b-42f4-9ce3-2a42f3cc6933 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:07:12.791513 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93084f2b-106b-42f4-9ce3-2a42f3cc6933 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:07:12.791791 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93084f2b-106b-42f4-9ce3-2a42f3cc6933 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:07:12.798970 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93084f2b-106b-42f4-9ce3-2a42f3cc6933 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:07:12.800417 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93084f2b-106b-42f4-9ce3-2a42f3cc6933 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:07:12.812610 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application [None req-93084f2b-106b-42f4-9ce3-2a42f3cc6933 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:07:12.812610 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:07:12.812610 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:07:12.812610 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:07:12.812610 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:07:12.812610 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:07:12.812610 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:07:12.812610 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:07:12.812610 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:07:12.812610 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:07:12.812610 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:07:12.812610 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:07:12.812610 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 12:07:12.812610 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 12:07:12.812610 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 12:07:12.814310 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 12:07:12.814310 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:07:12.814310 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:07:12.814310 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:07:12.814310 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:07:12.814310 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:07:12.814310 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:07:12.814310 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:07:12.814310 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application with Lock( Sep 05 12:07:12.814310 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:07:12.814310 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:07:12.814310 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:07:12.814310 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:07:12.814310 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:07:12.814310 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:07:12.814310 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:07:12.814310 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:07:12.815258 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 12:07:12.815258 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 12:07:12.815258 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 12:07:12.815258 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 12:07:12.815258 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 12:07:12.815258 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 12:07:12.815258 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:07:12.815258 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:07:12.815258 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 628/1244] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Sep 5 12:07:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:07:12.820720 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296589a2-409f-4a24-9bf4-f6e90e272aad None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:07:12.950272 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296589a2-409f-4a24-9bf4-f6e90e272aad None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:07:13.001229 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eea3dbd-c039-4f78-b93b-c198bb98247c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:07:13.002083 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eea3dbd-c039-4f78-b93b-c198bb98247c None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:07:13.002488 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eea3dbd-c039-4f78-b93b-c198bb98247c None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:07:13.002988 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eea3dbd-c039-4f78-b93b-c198bb98247c None admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:07:13.003874 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eea3dbd-c039-4f78-b93b-c198bb98247c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:07:13.004409 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eea3dbd-c039-4f78-b93b-c198bb98247c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:07:13.007165 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eea3dbd-c039-4f78-b93b-c198bb98247c None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:07:13.022651 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 617/1245] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Sep 5 12:07:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:07:13.029712 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93084f2b-106b-42f4-9ce3-2a42f3cc6933 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:07:13.152152 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93084f2b-106b-42f4-9ce3-2a42f3cc6933 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:07:13.190373 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680d09b9-c3f0-4387-969a-aad07930fdb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:07:13.191276 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680d09b9-c3f0-4387-969a-aad07930fdb4 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:07:13.191542 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680d09b9-c3f0-4387-969a-aad07930fdb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:07:13.191802 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680d09b9-c3f0-4387-969a-aad07930fdb4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:07:13.192568 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680d09b9-c3f0-4387-969a-aad07930fdb4 None admin] RBAC: Adding query filter params (role.id=fe10209913504171981606bfdf25a9bb, scope.project.id=ae4f8939fcc040bca99783a77e6ede4d, user.id=c5427d0752de4817b6aa25e28c2d9a30) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:07:13.192877 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680d09b9-c3f0-4387-969a-aad07930fdb4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:07:13.194331 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680d09b9-c3f0-4387-969a-aad07930fdb4 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:07:13.200508 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 629/1246] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Sep 5 12:07:13 2022] GET /identity/v3/role_assignments?user.id=c5427d0752de4817b6aa25e28c2d9a30&scope.project.id=ae4f8939fcc040bca99783a77e6ede4d&role.id=fe10209913504171981606bfdf25a9bb => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:07:15.300288 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967d51c0-bbcf-4e28-b282-128dd18f1b58 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:07:15.300920 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967d51c0-bbcf-4e28-b282-128dd18f1b58 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:07:15.300920 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967d51c0-bbcf-4e28-b282-128dd18f1b58 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:07:15.302327 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 618/1247] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:07:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:07:15.309293 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3483dd8b-f624-4bdd-93fe-6153f4f03599 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:07:15.309905 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3483dd8b-f624-4bdd-93fe-6153f4f03599 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:07:15.309905 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3483dd8b-f624-4bdd-93fe-6153f4f03599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:07:15.317071 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:07:15.340265 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-3483dd8b-f624-4bdd-93fe-6153f4f03599 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:07:15.341811 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-3483dd8b-f624-4bdd-93fe-6153f4f03599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:07:15.432415 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 630/1248] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:07:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 12:07:15.736799 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967d51c0-bbcf-4e28-b282-128dd18f1b58 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:07:15.759356 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:07:15.887301 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967d51c0-bbcf-4e28-b282-128dd18f1b58 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:07:15.930087 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c567133-1520-4132-a00b-2a949810b38c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:07:15.930742 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c567133-1520-4132-a00b-2a949810b38c None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:07:15.931023 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c567133-1520-4132-a00b-2a949810b38c None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:07:15.931293 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c567133-1520-4132-a00b-2a949810b38c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:07:15.944356 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c567133-1520-4132-a00b-2a949810b38c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:07:15.950044 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-6c567133-1520-4132-a00b-2a949810b38c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 12:07:15.950044 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:07:15.950044 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:07:15.950044 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:07:15.950044 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:07:15.950044 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:07:15.950044 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:07:15.950044 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:07:15.950044 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:07:15.950044 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:07:15.950044 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:07:15.950044 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:07:15.950044 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:07:15.950044 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:07:15.950044 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:07:15.950044 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:07:15.951319 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:07:15.951319 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:07:15.951319 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:07:15.951319 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:07:15.951319 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:07:15.951319 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:07:15.951319 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:07:15.951319 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:07:15.951319 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:07:15.951319 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:07:15.951319 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:07:15.951319 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:07:15.951319 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:07:15.951319 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:07:15.951319 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:07:15.951319 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:07:15.952379 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:07:15.952379 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:07:15.952379 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:07:15.952379 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:07:15.952379 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:07:15.952379 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:07:15.952379 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:07:15.952379 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:07:15.952379 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:07:15.952379 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:07:15.952379 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 12:07:15.952379 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:07:15.957922 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3483dd8b-f624-4bdd-93fe-6153f4f03599 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:07:15.960305 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 619/1249] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Sep 5 12:07:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:07:16.099056 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3483dd8b-f624-4bdd-93fe-6153f4f03599 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:07:16.149058 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:07:16.155369 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31cdffa-10c2-4944-901e-15016c5e78ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:07:16.156421 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31cdffa-10c2-4944-901e-15016c5e78ef None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:07:16.156922 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31cdffa-10c2-4944-901e-15016c5e78ef None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:07:16.157335 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31cdffa-10c2-4944-901e-15016c5e78ef None admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:07:16.158517 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31cdffa-10c2-4944-901e-15016c5e78ef None admin] RBAC: Adding query filter params (name=admin) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:07:16.159064 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31cdffa-10c2-4944-901e-15016c5e78ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:07:16.160910 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31cdffa-10c2-4944-901e-15016c5e78ef None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:07:16.173225 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 631/1250] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Sep 5 12:07:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:07:16.180445 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c567133-1520-4132-a00b-2a949810b38c None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:07:16.300425 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:07:16.329605 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c567133-1520-4132-a00b-2a949810b38c None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:07:16.373141 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87bb3bf-b580-4ba2-ac82-3626058fe536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:07:16.373780 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87bb3bf-b580-4ba2-ac82-3626058fe536 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:07:16.374059 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87bb3bf-b580-4ba2-ac82-3626058fe536 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:07:16.374347 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87bb3bf-b580-4ba2-ac82-3626058fe536 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:07:16.386361 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87bb3bf-b580-4ba2-ac82-3626058fe536 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:07:16.387972 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87bb3bf-b580-4ba2-ac82-3626058fe536 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:07:16.406664 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-f87bb3bf-b580-4ba2-ac82-3626058fe536 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:07:16.406664 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:07:16.406664 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:07:16.406664 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:07:16.406664 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:07:16.406664 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:07:16.406664 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:07:16.406664 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:07:16.406664 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:07:16.406664 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:07:16.406664 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:07:16.406664 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:07:16.406664 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:07:16.406664 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:07:16.406664 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:07:16.406664 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:07:16.408041 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:07:16.408041 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:07:16.408041 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:07:16.408041 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:07:16.408041 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:07:16.408041 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:07:16.408041 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:07:16.408041 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:07:16.408041 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:07:16.408041 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:07:16.408041 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:07:16.408041 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:07:16.408041 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:07:16.408041 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:07:16.408041 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:07:16.408041 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:07:16.408041 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:07:16.408981 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:07:16.408981 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:07:16.408981 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:07:16.408981 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 620/1251] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 5 12:07:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:07:16.415105 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31cdffa-10c2-4944-901e-15016c5e78ef None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:07:16.566729 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31cdffa-10c2-4944-901e-15016c5e78ef None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:07:16.613585 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09218ec-7f73-4b13-832a-23a6d01f4925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:07:16.614219 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09218ec-7f73-4b13-832a-23a6d01f4925 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:07:16.614504 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09218ec-7f73-4b13-832a-23a6d01f4925 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:07:16.614777 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09218ec-7f73-4b13-832a-23a6d01f4925 None admin] PATH_INFO: `/v3/domains` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:07:16.615427 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09218ec-7f73-4b13-832a-23a6d01f4925 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:07:16.615732 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09218ec-7f73-4b13-832a-23a6d01f4925 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:07:16.617262 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09218ec-7f73-4b13-832a-23a6d01f4925 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:07:16.633030 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 632/1252] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 5 12:07:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:07:16.640925 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87bb3bf-b580-4ba2-ac82-3626058fe536 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:07:16.779784 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87bb3bf-b580-4ba2-ac82-3626058fe536 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:07:16.822672 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:07:16.833140 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a369fdbd-b697-427b-8d54-8ae02eb2fc68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:07:16.833792 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a369fdbd-b697-427b-8d54-8ae02eb2fc68 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:07:16.834071 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a369fdbd-b697-427b-8d54-8ae02eb2fc68 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:07:16.834343 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a369fdbd-b697-427b-8d54-8ae02eb2fc68 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:07:16.844419 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a369fdbd-b697-427b-8d54-8ae02eb2fc68 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:07:16.845895 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a369fdbd-b697-427b-8d54-8ae02eb2fc68 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:07:16.859135 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-a369fdbd-b697-427b-8d54-8ae02eb2fc68 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 05 12:07:16.859135 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:07:16.859135 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:07:16.859135 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:07:16.859135 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:07:16.859135 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:07:16.859135 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:07:16.859135 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:07:16.859135 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:07:16.859135 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:07:16.859135 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:07:16.859135 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:07:16.859135 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 12:07:16.859135 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 12:07:16.859135 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 12:07:16.859135 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 12:07:16.861235 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:07:16.861235 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:07:16.861235 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 12:07:16.861235 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:07:16.861235 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 12:07:16.861235 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:07:16.861235 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:07:16.861235 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:07:16.861235 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:07:16.861235 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:07:16.861235 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:07:16.861235 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:07:16.861235 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:07:16.861235 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:07:16.861235 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:07:16.861235 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:07:16.861235 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:07:16.861235 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:07:16.862944 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:07:16.862944 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:07:16.862944 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 12:07:16.862944 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 12:07:16.862944 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 12:07:16.862944 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 12:07:16.862944 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 12:07:16.862944 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 12:07:16.862944 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 05 12:07:16.862944 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:07:16.862944 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 621/1253] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 5 12:07:16 2022] GET /identity/v3/users/placement => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 05 12:07:16.867144 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09218ec-7f73-4b13-832a-23a6d01f4925 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:07:16.951505 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:07:17.025623 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09218ec-7f73-4b13-832a-23a6d01f4925 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:07:17.088172 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acdf78d-82a4-4a80-99e5-9b1b2fa0a1f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:07:17.089626 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acdf78d-82a4-4a80-99e5-9b1b2fa0a1f7 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:07:17.090159 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acdf78d-82a4-4a80-99e5-9b1b2fa0a1f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:07:17.090868 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acdf78d-82a4-4a80-99e5-9b1b2fa0a1f7 None admin] PATH_INFO: `/v3/users` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:07:17.092649 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acdf78d-82a4-4a80-99e5-9b1b2fa0a1f7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:07:17.093295 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acdf78d-82a4-4a80-99e5-9b1b2fa0a1f7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:07:17.095968 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acdf78d-82a4-4a80-99e5-9b1b2fa0a1f7 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:07:17.119004 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 633/1254] 10.222.0.50 () {56 vars in 1143 bytes} [Mon Sep 5 12:07:16 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:07:17.125322 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a369fdbd-b697-427b-8d54-8ae02eb2fc68 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:07:17.242522 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a369fdbd-b697-427b-8d54-8ae02eb2fc68 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:07:17.283337 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c106848-c53c-4520-a259-378a8b8314c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:07:17.284029 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c106848-c53c-4520-a259-378a8b8314c9 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:07:17.284345 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c106848-c53c-4520-a259-378a8b8314c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:07:17.284676 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c106848-c53c-4520-a259-378a8b8314c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:07:17.347754 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:07:17.364217 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c106848-c53c-4520-a259-378a8b8314c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:07:17.365747 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c106848-c53c-4520-a259-378a8b8314c9 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:07:17.475434 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 622/1255] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Sep 5 12:07:17 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 05 12:07:17.482235 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acdf78d-82a4-4a80-99e5-9b1b2fa0a1f7 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:07:17.599958 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acdf78d-82a4-4a80-99e5-9b1b2fa0a1f7 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:07:17.614162 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:07:17.637848 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765d1c4a-b931-4fd3-948b-02690fa98b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:07:17.638480 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765d1c4a-b931-4fd3-948b-02690fa98b71 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:07:17.638764 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765d1c4a-b931-4fd3-948b-02690fa98b71 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:07:17.639038 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765d1c4a-b931-4fd3-948b-02690fa98b71 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:07:17.649433 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765d1c4a-b931-4fd3-948b-02690fa98b71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:07:17.650865 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765d1c4a-b931-4fd3-948b-02690fa98b71 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:07:17.666301 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application [None req-765d1c4a-b931-4fd3-948b-02690fa98b71 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:07:17.666301 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:07:17.666301 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:07:17.666301 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:07:17.666301 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:07:17.666301 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:07:17.666301 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:07:17.666301 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:07:17.666301 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:07:17.666301 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:07:17.666301 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:07:17.666301 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:07:17.666301 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:07:17.666301 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:07:17.666301 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:07:17.666301 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:07:17.667471 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:07:17.667471 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:07:17.667471 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:07:17.667471 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:07:17.667471 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:07:17.667471 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:07:17.667471 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:07:17.667471 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application with Lock( Sep 05 12:07:17.667471 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:07:17.667471 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:07:17.667471 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:07:17.667471 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:07:17.667471 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:07:17.667471 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:07:17.667471 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:07:17.667471 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:07:17.667471 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:07:17.668561 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:07:17.668561 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:07:17.668561 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:07:17.668561 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 634/1256] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 5 12:07:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:07:17.673389 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c106848-c53c-4520-a259-378a8b8314c9 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:07:17.775412 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:07:17.791821 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c106848-c53c-4520-a259-378a8b8314c9 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:07:17.829221 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d8f8bd-fe0d-4069-906f-53febcbb76d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:07:17.829840 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d8f8bd-fe0d-4069-906f-53febcbb76d2 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:07:17.830102 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d8f8bd-fe0d-4069-906f-53febcbb76d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:07:17.830375 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d8f8bd-fe0d-4069-906f-53febcbb76d2 None admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:07:17.831034 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d8f8bd-fe0d-4069-906f-53febcbb76d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:07:17.831335 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d8f8bd-fe0d-4069-906f-53febcbb76d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:07:17.832750 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d8f8bd-fe0d-4069-906f-53febcbb76d2 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:07:17.845905 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 623/1257] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 5 12:07:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:07:17.852648 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765d1c4a-b931-4fd3-948b-02690fa98b71 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:07:17.964470 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765d1c4a-b931-4fd3-948b-02690fa98b71 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:07:18.008482 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268fdebb-6390-4281-b795-6ada6094fafa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:07:18.009052 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268fdebb-6390-4281-b795-6ada6094fafa None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:07:18.009332 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268fdebb-6390-4281-b795-6ada6094fafa None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:07:18.010946 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268fdebb-6390-4281-b795-6ada6094fafa None admin] PATH_INFO: `/v3/projects/service` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:07:18.017395 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268fdebb-6390-4281-b795-6ada6094fafa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:07:18.018969 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268fdebb-6390-4281-b795-6ada6094fafa None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:07:18.032185 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application [None req-268fdebb-6390-4281-b795-6ada6094fafa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:07:18.032185 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:07:18.032185 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:07:18.032185 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:07:18.032185 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:07:18.032185 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:07:18.032185 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:07:18.032185 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:07:18.032185 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:07:18.032185 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:07:18.032185 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:07:18.032185 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:07:18.032185 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 12:07:18.032185 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 12:07:18.032185 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 12:07:18.034157 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 12:07:18.034157 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:07:18.034157 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:07:18.034157 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:07:18.034157 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:07:18.034157 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:07:18.034157 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:07:18.034157 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:07:18.034157 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application with Lock( Sep 05 12:07:18.034157 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:07:18.034157 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:07:18.034157 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:07:18.034157 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:07:18.034157 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:07:18.034157 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:07:18.034157 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:07:18.034157 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:07:18.035349 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 12:07:18.035349 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 12:07:18.035349 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 12:07:18.035349 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 12:07:18.035349 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 12:07:18.035349 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 12:07:18.035349 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:07:18.035349 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:07:18.035349 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 635/1258] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Sep 5 12:07:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:07:18.040236 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d8f8bd-fe0d-4069-906f-53febcbb76d2 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:07:18.173395 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d8f8bd-fe0d-4069-906f-53febcbb76d2 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:07:18.213206 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f64c92d-8496-4806-add8-ed0faa622588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:07:18.213841 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f64c92d-8496-4806-add8-ed0faa622588 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:07:18.214186 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f64c92d-8496-4806-add8-ed0faa622588 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:07:18.214490 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f64c92d-8496-4806-add8-ed0faa622588 None admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:07:18.215291 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f64c92d-8496-4806-add8-ed0faa622588 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:07:18.215665 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f64c92d-8496-4806-add8-ed0faa622588 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:07:18.217321 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f64c92d-8496-4806-add8-ed0faa622588 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:07:18.230480 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 624/1259] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Sep 5 12:07:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:07:18.237049 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268fdebb-6390-4281-b795-6ada6094fafa None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:07:18.266195 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:07:18.354560 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268fdebb-6390-4281-b795-6ada6094fafa None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:07:18.396150 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612dcfbb-9dd8-44e6-867b-5e6179cedd5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:07:18.396805 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612dcfbb-9dd8-44e6-867b-5e6179cedd5e None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:07:18.397165 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612dcfbb-9dd8-44e6-867b-5e6179cedd5e None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:07:18.397439 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612dcfbb-9dd8-44e6-867b-5e6179cedd5e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:07:18.399057 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612dcfbb-9dd8-44e6-867b-5e6179cedd5e None admin] RBAC: Adding query filter params (role.id=16e2ccc8bd1b497d8cee780c1c7df0d2, scope.project.id=ae4f8939fcc040bca99783a77e6ede4d, user.id=c5427d0752de4817b6aa25e28c2d9a30) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:07:18.399399 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612dcfbb-9dd8-44e6-867b-5e6179cedd5e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:07:18.400992 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612dcfbb-9dd8-44e6-867b-5e6179cedd5e None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:07:18.408110 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 636/1260] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Sep 5 12:07:18 2022] GET /identity/v3/role_assignments?user.id=c5427d0752de4817b6aa25e28c2d9a30&scope.project.id=ae4f8939fcc040bca99783a77e6ede4d&role.id=16e2ccc8bd1b497d8cee780c1c7df0d2 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:07:20.321540 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19ea55a-e9e9-4ad8-91ba-5594afef1103 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:07:20.322101 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19ea55a-e9e9-4ad8-91ba-5594afef1103 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:07:20.322101 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19ea55a-e9e9-4ad8-91ba-5594afef1103 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:07:20.323408 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 625/1261] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:07:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:07:20.328556 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64936979-ff6d-4a62-8759-025eeaa761b5 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:07:20.329011 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64936979-ff6d-4a62-8759-025eeaa761b5 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:07:20.329147 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64936979-ff6d-4a62-8759-025eeaa761b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:07:20.347083 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-64936979-ff6d-4a62-8759-025eeaa761b5 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:07:20.348305 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-64936979-ff6d-4a62-8759-025eeaa761b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:07:20.414897 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 637/1262] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:07:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 05 12:07:20.692188 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19ea55a-e9e9-4ad8-91ba-5594afef1103 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:07:20.703149 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:07:20.794858 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19ea55a-e9e9-4ad8-91ba-5594afef1103 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:07:20.828589 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0706274-c1ac-4561-949d-954d6edb3717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:07:20.829250 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0706274-c1ac-4561-949d-954d6edb3717 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:07:20.829530 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0706274-c1ac-4561-949d-954d6edb3717 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:07:20.829803 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0706274-c1ac-4561-949d-954d6edb3717 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:07:20.840323 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0706274-c1ac-4561-949d-954d6edb3717 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:07:20.845113 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-d0706274-c1ac-4561-949d-954d6edb3717 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 12:07:20.845113 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:07:20.845113 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:07:20.845113 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:07:20.845113 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:07:20.845113 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:07:20.845113 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:07:20.845113 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:07:20.845113 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:07:20.845113 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:07:20.845113 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:07:20.845113 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:07:20.845113 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:07:20.845113 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:07:20.845113 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:07:20.845113 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:07:20.846225 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:07:20.846225 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:07:20.846225 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:07:20.846225 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:07:20.846225 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:07:20.846225 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:07:20.846225 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:07:20.846225 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:07:20.846225 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:07:20.846225 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:07:20.846225 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:07:20.846225 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:07:20.846225 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:07:20.846225 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:07:20.846225 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:07:20.846225 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:07:20.847292 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:07:20.847292 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:07:20.847292 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:07:20.847292 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:07:20.847292 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:07:20.847292 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:07:20.847292 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:07:20.847292 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:07:20.847292 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:07:20.847292 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:07:20.847292 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 12:07:20.847292 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:07:20.847292 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 626/1263] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Sep 5 12:07:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:07:20.852827 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64936979-ff6d-4a62-8759-025eeaa761b5 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:07:20.870672 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:07:20.949676 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64936979-ff6d-4a62-8759-025eeaa761b5 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:07:20.982717 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a5cedc-eb08-4418-96a4-46b941612880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:07:20.983326 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a5cedc-eb08-4418-96a4-46b941612880 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:07:20.983604 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a5cedc-eb08-4418-96a4-46b941612880 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:07:20.983877 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a5cedc-eb08-4418-96a4-46b941612880 None admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:07:20.984537 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a5cedc-eb08-4418-96a4-46b941612880 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:07:20.984842 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a5cedc-eb08-4418-96a4-46b941612880 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:07:20.986220 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a5cedc-eb08-4418-96a4-46b941612880 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:07:20.994039 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 638/1264] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Sep 5 12:07:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:07:20.999760 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0706274-c1ac-4561-949d-954d6edb3717 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:07:21.065053 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:07:21.098404 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0706274-c1ac-4561-949d-954d6edb3717 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:07:21.138116 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301e4c7b-7c20-4839-92a4-1895f85dfc7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:07:21.138815 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301e4c7b-7c20-4839-92a4-1895f85dfc7a None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:07:21.139118 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301e4c7b-7c20-4839-92a4-1895f85dfc7a None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:07:21.139435 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301e4c7b-7c20-4839-92a4-1895f85dfc7a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:07:21.151982 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301e4c7b-7c20-4839-92a4-1895f85dfc7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:07:21.153358 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301e4c7b-7c20-4839-92a4-1895f85dfc7a None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:07:21.169796 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-301e4c7b-7c20-4839-92a4-1895f85dfc7a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:07:21.169796 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:07:21.169796 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:07:21.169796 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:07:21.169796 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:07:21.169796 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:07:21.169796 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:07:21.169796 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:07:21.169796 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:07:21.169796 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:07:21.169796 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:07:21.169796 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:07:21.169796 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:07:21.169796 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:07:21.169796 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:07:21.169796 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:07:21.172541 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:07:21.172541 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:07:21.172541 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:07:21.172541 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:07:21.172541 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:07:21.172541 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:07:21.172541 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:07:21.172541 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:07:21.172541 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:07:21.172541 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:07:21.172541 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:07:21.172541 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:07:21.172541 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:07:21.172541 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:07:21.172541 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:07:21.172541 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:07:21.172541 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:07:21.174483 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:07:21.174483 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:07:21.174483 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:07:21.174483 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 627/1265] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 5 12:07:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:07:21.177502 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a5cedc-eb08-4418-96a4-46b941612880 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:07:21.263587 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:07:21.282812 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a5cedc-eb08-4418-96a4-46b941612880 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:07:21.317229 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ea5b99-9b82-4be7-9f45-ed314a49bc83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:07:21.317828 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ea5b99-9b82-4be7-9f45-ed314a49bc83 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:07:21.318111 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ea5b99-9b82-4be7-9f45-ed314a49bc83 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:07:21.318385 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ea5b99-9b82-4be7-9f45-ed314a49bc83 None admin] PATH_INFO: `/v3/domains` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:07:21.319030 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ea5b99-9b82-4be7-9f45-ed314a49bc83 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:07:21.319836 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ea5b99-9b82-4be7-9f45-ed314a49bc83 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:07:21.321232 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ea5b99-9b82-4be7-9f45-ed314a49bc83 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:07:21.333161 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 639/1266] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 5 12:07:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:07:21.339416 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301e4c7b-7c20-4839-92a4-1895f85dfc7a None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:07:21.440011 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301e4c7b-7c20-4839-92a4-1895f85dfc7a None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:07:21.460673 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:07:21.477529 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a4f417-16fc-4306-b053-712338e4851f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:07:21.478157 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a4f417-16fc-4306-b053-712338e4851f None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:07:21.478434 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a4f417-16fc-4306-b053-712338e4851f None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:07:21.478702 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a4f417-16fc-4306-b053-712338e4851f None admin] PATH_INFO: `/v3/users/placement` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:07:21.486266 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a4f417-16fc-4306-b053-712338e4851f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:07:21.487698 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a4f417-16fc-4306-b053-712338e4851f None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:07:21.498890 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-c7a4f417-16fc-4306-b053-712338e4851f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 05 12:07:21.498890 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:07:21.498890 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:07:21.498890 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:07:21.498890 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:07:21.498890 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:07:21.498890 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:07:21.498890 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:07:21.498890 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:07:21.498890 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:07:21.498890 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:07:21.498890 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:07:21.498890 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 12:07:21.498890 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 12:07:21.498890 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 12:07:21.498890 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 12:07:21.499995 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:07:21.499995 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:07:21.499995 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 12:07:21.499995 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:07:21.499995 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 12:07:21.499995 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:07:21.499995 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:07:21.499995 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:07:21.499995 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:07:21.499995 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:07:21.499995 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:07:21.499995 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:07:21.499995 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:07:21.499995 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:07:21.499995 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:07:21.499995 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:07:21.499995 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:07:21.499995 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:07:21.501265 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:07:21.501265 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:07:21.501265 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 12:07:21.501265 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 12:07:21.501265 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 12:07:21.501265 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 12:07:21.501265 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 12:07:21.501265 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 12:07:21.501265 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 05 12:07:21.501265 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:07:21.501265 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 628/1267] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 5 12:07:21 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:07:21.505954 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ea5b99-9b82-4be7-9f45-ed314a49bc83 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:07:21.604395 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ea5b99-9b82-4be7-9f45-ed314a49bc83 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:07:21.638898 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564b1956-85ca-4178-95cd-7fcbe6d0146e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:07:21.639499 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564b1956-85ca-4178-95cd-7fcbe6d0146e None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:07:21.639780 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564b1956-85ca-4178-95cd-7fcbe6d0146e None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:07:21.640051 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564b1956-85ca-4178-95cd-7fcbe6d0146e None admin] PATH_INFO: `/v3/users` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:07:21.640771 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564b1956-85ca-4178-95cd-7fcbe6d0146e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:07:21.641106 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564b1956-85ca-4178-95cd-7fcbe6d0146e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:07:21.642520 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564b1956-85ca-4178-95cd-7fcbe6d0146e None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:07:21.651909 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:07:21.662037 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 640/1268] 10.222.0.50 () {56 vars in 1143 bytes} [Mon Sep 5 12:07:21 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:07:21.667727 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a4f417-16fc-4306-b053-712338e4851f None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:07:21.769072 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a4f417-16fc-4306-b053-712338e4851f None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:07:21.805923 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ce9437-86e3-4a56-8cb0-841f81f86bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:07:21.806488 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ce9437-86e3-4a56-8cb0-841f81f86bcf None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:07:21.806767 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ce9437-86e3-4a56-8cb0-841f81f86bcf None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:07:21.807040 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ce9437-86e3-4a56-8cb0-841f81f86bcf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:07:21.818962 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ce9437-86e3-4a56-8cb0-841f81f86bcf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:07:21.821037 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ce9437-86e3-4a56-8cb0-841f81f86bcf None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:07:21.836968 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-04ce9437-86e3-4a56-8cb0-841f81f86bcf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:07:21.836968 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:07:21.836968 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:07:21.836968 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:07:21.836968 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:07:21.836968 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:07:21.836968 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:07:21.836968 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:07:21.836968 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:07:21.836968 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:07:21.836968 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:07:21.836968 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:07:21.836968 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:07:21.836968 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:07:21.836968 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:07:21.836968 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:07:21.838195 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:07:21.838195 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:07:21.838195 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:07:21.838195 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:07:21.838195 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:07:21.838195 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:07:21.838195 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:07:21.838195 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:07:21.838195 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:07:21.838195 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:07:21.838195 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:07:21.838195 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:07:21.838195 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:07:21.838195 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:07:21.838195 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:07:21.838195 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:07:21.838195 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:07:21.839287 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:07:21.839287 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:07:21.839287 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:07:21.839287 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 629/1269] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 5 12:07:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:07:21.844165 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564b1956-85ca-4178-95cd-7fcbe6d0146e None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:07:21.947936 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564b1956-85ca-4178-95cd-7fcbe6d0146e None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:07:21.981148 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714fa4ad-d459-496d-b894-733080301b9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:07:21.981749 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714fa4ad-d459-496d-b894-733080301b9e None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:07:21.982028 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714fa4ad-d459-496d-b894-733080301b9e None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:07:21.982301 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714fa4ad-d459-496d-b894-733080301b9e None admin] PATH_INFO: `/v3/domains` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:07:21.982937 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714fa4ad-d459-496d-b894-733080301b9e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:07:21.983244 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714fa4ad-d459-496d-b894-733080301b9e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:07:21.984598 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714fa4ad-d459-496d-b894-733080301b9e None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:07:21.996230 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 641/1270] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 5 12:07:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:07:22.001937 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ce9437-86e3-4a56-8cb0-841f81f86bcf None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:07:22.034066 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:07:22.102940 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ce9437-86e3-4a56-8cb0-841f81f86bcf None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:07:22.138591 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2c7061-f5b0-4825-85d4-2f04b71161e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:07:22.139241 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2c7061-f5b0-4825-85d4-2f04b71161e2 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:07:22.139525 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2c7061-f5b0-4825-85d4-2f04b71161e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:07:22.139790 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2c7061-f5b0-4825-85d4-2f04b71161e2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:07:22.146512 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2c7061-f5b0-4825-85d4-2f04b71161e2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:07:22.148206 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2c7061-f5b0-4825-85d4-2f04b71161e2 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:07:22.159274 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-9a2c7061-f5b0-4825-85d4-2f04b71161e2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:07:22.159274 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:07:22.159274 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:07:22.159274 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:07:22.159274 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:07:22.159274 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:07:22.159274 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:07:22.159274 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:07:22.159274 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:07:22.159274 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:07:22.159274 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:07:22.159274 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:07:22.159274 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 12:07:22.159274 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 12:07:22.159274 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 12:07:22.160343 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 12:07:22.160343 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:07:22.160343 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:07:22.160343 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:07:22.160343 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:07:22.160343 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:07:22.160343 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:07:22.160343 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:07:22.160343 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:07:22.160343 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:07:22.160343 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:07:22.160343 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:07:22.160343 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:07:22.160343 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:07:22.160343 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:07:22.160343 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:07:22.160343 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:07:22.161312 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 12:07:22.161312 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 12:07:22.161312 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 12:07:22.161312 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 12:07:22.161312 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 12:07:22.161312 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 12:07:22.161312 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:07:22.161312 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:07:22.161312 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 630/1271] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Sep 5 12:07:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:07:22.166715 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714fa4ad-d459-496d-b894-733080301b9e None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:07:22.223852 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:07:22.265744 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714fa4ad-d459-496d-b894-733080301b9e None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:07:22.298818 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c056517d-db72-4a27-b11d-2cfdf7c29acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:07:22.299417 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c056517d-db72-4a27-b11d-2cfdf7c29acf None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:07:22.299697 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c056517d-db72-4a27-b11d-2cfdf7c29acf None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:07:22.299970 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c056517d-db72-4a27-b11d-2cfdf7c29acf None admin] PATH_INFO: `/v3/projects` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:07:22.300657 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c056517d-db72-4a27-b11d-2cfdf7c29acf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:07:22.300987 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c056517d-db72-4a27-b11d-2cfdf7c29acf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:07:22.302407 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c056517d-db72-4a27-b11d-2cfdf7c29acf None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:07:22.314011 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 642/1272] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Sep 5 12:07:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:07:22.320133 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2c7061-f5b0-4825-85d4-2f04b71161e2 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:07:22.408697 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:07:22.418168 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2c7061-f5b0-4825-85d4-2f04b71161e2 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:07:22.450057 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51811dea-2b5a-461d-8c2c-6a15b30f8203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:07:22.450692 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51811dea-2b5a-461d-8c2c-6a15b30f8203 None admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:07:22.450968 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51811dea-2b5a-461d-8c2c-6a15b30f8203 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:07:22.451237 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51811dea-2b5a-461d-8c2c-6a15b30f8203 None admin] PATH_INFO: `/v3/projects/ae4f8939fcc040bca99783a77e6ede4d/users/c5427d0752de4817b6aa25e28c2d9a30/roles/16e2ccc8bd1b497d8cee780c1c7df0d2` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:07:22.453107 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51811dea-2b5a-461d-8c2c-6a15b30f8203 None admin] RBAC: Authorizing `identity:create_grant(project_id=ae4f8939fcc040bca99783a77e6ede4d, user_id=c5427d0752de4817b6aa25e28c2d9a30, role_id=16e2ccc8bd1b497d8cee780c1c7df0d2)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:07:22.454537 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51811dea-2b5a-461d-8c2c-6a15b30f8203 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:07:22.467087 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 631/1273] 10.222.0.50 () {58 vars in 1439 bytes} [Mon Sep 5 12:07:22 2022] PUT /identity/v3/projects/ae4f8939fcc040bca99783a77e6ede4d/users/c5427d0752de4817b6aa25e28c2d9a30/roles/16e2ccc8bd1b497d8cee780c1c7df0d2 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:07:24.336552 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd56f05-66a6-4f32-b399-f3eb79b287e1 None None] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:07:24.337120 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd56f05-66a6-4f32-b399-f3eb79b287e1 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:07:24.337120 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd56f05-66a6-4f32-b399-f3eb79b287e1 None None] PATH_INFO: `/` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:07:24.338468 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 643/1274] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:07:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:07:24.343821 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a202bf10-4cfe-4ddd-bb73-bc8c71911936 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:07:24.344211 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a202bf10-4cfe-4ddd-bb73-bc8c71911936 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:07:24.344371 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a202bf10-4cfe-4ddd-bb73-bc8c71911936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:07:24.362416 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-a202bf10-4cfe-4ddd-bb73-bc8c71911936 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:07:24.363629 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-a202bf10-4cfe-4ddd-bb73-bc8c71911936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:07:24.431179 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 632/1275] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:07:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 12:07:24.696739 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd56f05-66a6-4f32-b399-f3eb79b287e1 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:07:24.796488 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd56f05-66a6-4f32-b399-f3eb79b287e1 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:07:24.814437 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:07:24.835611 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3c12ac-3603-4d6e-ae4c-3ee459780721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:07:24.836665 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3c12ac-3603-4d6e-ae4c-3ee459780721 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:07:24.837204 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3c12ac-3603-4d6e-ae4c-3ee459780721 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:07:24.837693 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3c12ac-3603-4d6e-ae4c-3ee459780721 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:07:24.854612 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3c12ac-3603-4d6e-ae4c-3ee459780721 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 05 12:07:24.864575 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application [None req-cd3c12ac-3603-4d6e-ae4c-3ee459780721 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 12:07:24.864575 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:07:24.864575 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:07:24.864575 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:07:24.864575 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:07:24.864575 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:07:24.864575 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:07:24.864575 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:07:24.864575 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:07:24.864575 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:07:24.864575 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:07:24.864575 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:07:24.864575 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 05 12:07:24.864575 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 05 12:07:24.864575 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 05 12:07:24.864575 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 05 12:07:24.865704 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 05 12:07:24.865704 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 05 12:07:24.865704 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 05 12:07:24.865704 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 05 12:07:24.865704 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:07:24.865704 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:07:24.865704 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:07:24.865704 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:07:24.865704 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:07:24.865704 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:07:24.865704 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:07:24.865704 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application with Lock( Sep 05 12:07:24.865704 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:07:24.865704 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:07:24.865704 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:07:24.865704 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:07:24.867265 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:07:24.867265 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:07:24.867265 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:07:24.867265 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:07:24.867265 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 05 12:07:24.867265 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 05 12:07:24.867265 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 05 12:07:24.867265 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 05 12:07:24.867265 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 05 12:07:24.867265 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 05 12:07:24.867265 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 05 12:07:24.867265 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:07:24.867265 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 644/1276] 10.222.0.50 () {56 vars in 1096 bytes} [Mon Sep 5 12:07:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:07:24.873079 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a202bf10-4cfe-4ddd-bb73-bc8c71911936 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:07:24.953218 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:07:24.972749 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a202bf10-4cfe-4ddd-bb73-bc8c71911936 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:07:25.008023 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9f5c70-7a56-44df-8d42-116f9c508c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:07:25.008655 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9f5c70-7a56-44df-8d42-116f9c508c4c None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:07:25.008958 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9f5c70-7a56-44df-8d42-116f9c508c4c None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:07:25.009232 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9f5c70-7a56-44df-8d42-116f9c508c4c None admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:07:25.009914 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9f5c70-7a56-44df-8d42-116f9c508c4c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:07:25.010214 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9f5c70-7a56-44df-8d42-116f9c508c4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:07:25.011618 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9f5c70-7a56-44df-8d42-116f9c508c4c None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:07:25.021416 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 633/1277] 10.222.0.50 () {56 vars in 1099 bytes} [Mon Sep 5 12:07:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:07:25.027503 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3c12ac-3603-4d6e-ae4c-3ee459780721 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:07:25.136331 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3c12ac-3603-4d6e-ae4c-3ee459780721 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:07:25.178261 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb870b4d-9efb-4be8-8ba2-441891199006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:07:25.179480 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb870b4d-9efb-4be8-8ba2-441891199006 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:07:25.179852 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb870b4d-9efb-4be8-8ba2-441891199006 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:07:25.180133 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb870b4d-9efb-4be8-8ba2-441891199006 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:07:25.193603 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb870b4d-9efb-4be8-8ba2-441891199006 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:07:25.195482 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb870b4d-9efb-4be8-8ba2-441891199006 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:07:25.213823 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application [None req-cb870b4d-9efb-4be8-8ba2-441891199006 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:07:25.213823 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:07:25.213823 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:07:25.213823 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:07:25.213823 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:07:25.213823 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:07:25.213823 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:07:25.213823 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:07:25.213823 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:07:25.213823 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:07:25.213823 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:07:25.213823 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:07:25.213823 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:07:25.213823 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:07:25.213823 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:07:25.213823 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:07:25.214998 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:07:25.214998 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:07:25.214998 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:07:25.214998 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:07:25.214998 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:07:25.214998 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:07:25.214998 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:07:25.214998 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application with Lock( Sep 05 12:07:25.214998 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:07:25.214998 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:07:25.214998 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:07:25.214998 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:07:25.214998 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:07:25.214998 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:07:25.214998 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:07:25.214998 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:07:25.214998 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:07:25.216103 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:07:25.216103 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:07:25.216103 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:07:25.216103 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 645/1278] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 5 12:07:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:07:25.220874 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9f5c70-7a56-44df-8d42-116f9c508c4c None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:07:25.321678 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9f5c70-7a56-44df-8d42-116f9c508c4c None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:07:25.355050 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16cd850-5982-434e-a98b-252a5655271c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:07:25.355670 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16cd850-5982-434e-a98b-252a5655271c None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:07:25.355919 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16cd850-5982-434e-a98b-252a5655271c None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:07:25.356189 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16cd850-5982-434e-a98b-252a5655271c None admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:07:25.356830 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16cd850-5982-434e-a98b-252a5655271c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:07:25.357167 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16cd850-5982-434e-a98b-252a5655271c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:07:25.358538 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16cd850-5982-434e-a98b-252a5655271c None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:07:25.370533 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 634/1279] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 5 12:07:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:07:25.376243 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb870b4d-9efb-4be8-8ba2-441891199006 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:07:25.407827 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:07:25.477292 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb870b4d-9efb-4be8-8ba2-441891199006 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:07:25.509491 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed59cc18-1027-4c08-b588-5e19a4fa4f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:07:25.510113 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed59cc18-1027-4c08-b588-5e19a4fa4f66 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:07:25.510393 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed59cc18-1027-4c08-b588-5e19a4fa4f66 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:07:25.510663 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed59cc18-1027-4c08-b588-5e19a4fa4f66 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:07:25.517950 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed59cc18-1027-4c08-b588-5e19a4fa4f66 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:07:25.519383 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed59cc18-1027-4c08-b588-5e19a4fa4f66 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:07:25.531032 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application [None req-ed59cc18-1027-4c08-b588-5e19a4fa4f66 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 05 12:07:25.531032 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:07:25.531032 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:07:25.531032 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:07:25.531032 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:07:25.531032 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:07:25.531032 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:07:25.531032 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:07:25.531032 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:07:25.531032 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:07:25.531032 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:07:25.531032 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:07:25.531032 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 05 12:07:25.531032 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 05 12:07:25.531032 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 05 12:07:25.531032 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 05 12:07:25.536535 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:07:25.536535 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:07:25.536535 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 05 12:07:25.536535 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:07:25.536535 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 05 12:07:25.536535 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 05 12:07:25.536535 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:07:25.536535 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:07:25.536535 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:07:25.536535 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:07:25.536535 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:07:25.536535 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application with Lock( Sep 05 12:07:25.536535 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:07:25.536535 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:07:25.536535 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:07:25.536535 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:07:25.536535 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:07:25.536535 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:07:25.537720 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:07:25.537720 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:07:25.537720 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 05 12:07:25.537720 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 05 12:07:25.537720 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 05 12:07:25.537720 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 05 12:07:25.537720 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 05 12:07:25.537720 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 05 12:07:25.537720 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 05 12:07:25.537720 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:07:25.537720 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 646/1280] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 5 12:07:25 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:07:25.538892 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16cd850-5982-434e-a98b-252a5655271c None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:07:25.542414 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:07:25.636452 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16cd850-5982-434e-a98b-252a5655271c None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:07:25.669668 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f91aec3-ee8d-4780-a6c5-ca2a3e6050a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:07:25.670269 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f91aec3-ee8d-4780-a6c5-ca2a3e6050a6 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:07:25.670553 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f91aec3-ee8d-4780-a6c5-ca2a3e6050a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:07:25.670812 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f91aec3-ee8d-4780-a6c5-ca2a3e6050a6 None admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:07:25.671527 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f91aec3-ee8d-4780-a6c5-ca2a3e6050a6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:07:25.671828 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f91aec3-ee8d-4780-a6c5-ca2a3e6050a6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:07:25.673272 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f91aec3-ee8d-4780-a6c5-ca2a3e6050a6 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:07:25.689790 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 635/1281] 10.222.0.50 () {56 vars in 1143 bytes} [Mon Sep 5 12:07:25 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:07:25.696057 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed59cc18-1027-4c08-b588-5e19a4fa4f66 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:07:25.784388 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:07:25.793920 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed59cc18-1027-4c08-b588-5e19a4fa4f66 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:07:25.826041 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a1cdcf-7758-4baa-b250-077fa0c452bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:07:25.826638 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a1cdcf-7758-4baa-b250-077fa0c452bd None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:07:25.826915 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a1cdcf-7758-4baa-b250-077fa0c452bd None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:07:25.827195 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a1cdcf-7758-4baa-b250-077fa0c452bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:07:25.890972 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a1cdcf-7758-4baa-b250-077fa0c452bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:07:25.892389 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a1cdcf-7758-4baa-b250-077fa0c452bd None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:07:25.976496 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:07:25.986497 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 647/1282] 10.222.0.50 () {58 vars in 1282 bytes} [Mon Sep 5 12:07:25 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 05 12:07:25.992414 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f91aec3-ee8d-4780-a6c5-ca2a3e6050a6 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:07:26.054132 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:07:26.092131 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f91aec3-ee8d-4780-a6c5-ca2a3e6050a6 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:07:26.130717 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d8f54b-bcae-4ebe-8b23-d9ef80ab49bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:07:26.131352 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d8f54b-bcae-4ebe-8b23-d9ef80ab49bf None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:07:26.131630 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d8f54b-bcae-4ebe-8b23-d9ef80ab49bf None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:07:26.132500 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d8f54b-bcae-4ebe-8b23-d9ef80ab49bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:07:26.142468 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d8f54b-bcae-4ebe-8b23-d9ef80ab49bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:07:26.143903 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d8f54b-bcae-4ebe-8b23-d9ef80ab49bf None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:07:26.158246 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-62d8f54b-bcae-4ebe-8b23-d9ef80ab49bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:07:26.158246 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:07:26.158246 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:07:26.158246 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:07:26.158246 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:07:26.158246 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:07:26.158246 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:07:26.158246 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:07:26.158246 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:07:26.158246 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:07:26.158246 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:07:26.158246 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:07:26.158246 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 05 12:07:26.158246 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 05 12:07:26.158246 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 05 12:07:26.158246 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 05 12:07:26.159337 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:07:26.159337 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:07:26.159337 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:07:26.159337 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:07:26.159337 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:07:26.159337 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:07:26.159337 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:07:26.159337 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:07:26.159337 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:07:26.159337 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:07:26.159337 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:07:26.159337 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:07:26.159337 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:07:26.159337 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:07:26.159337 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:07:26.159337 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:07:26.159337 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 05 12:07:26.160421 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 05 12:07:26.160421 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 05 12:07:26.160421 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:07:26.160421 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 636/1283] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 5 12:07:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:07:26.165185 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a1cdcf-7758-4baa-b250-077fa0c452bd None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:07:26.260051 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a1cdcf-7758-4baa-b250-077fa0c452bd None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:07:26.292303 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3de159-ad90-4dd7-99df-89fe4fd9b16d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:07:26.292920 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3de159-ad90-4dd7-99df-89fe4fd9b16d None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:07:26.293191 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3de159-ad90-4dd7-99df-89fe4fd9b16d None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:07:26.293456 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3de159-ad90-4dd7-99df-89fe4fd9b16d None admin] PATH_INFO: `/v3/domains` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:07:26.294115 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3de159-ad90-4dd7-99df-89fe4fd9b16d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:07:26.294380 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3de159-ad90-4dd7-99df-89fe4fd9b16d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:07:26.295725 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3de159-ad90-4dd7-99df-89fe4fd9b16d None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:07:26.307069 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 648/1284] 10.222.0.50 () {56 vars in 1109 bytes} [Mon Sep 5 12:07:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:07:26.312808 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d8f54b-bcae-4ebe-8b23-d9ef80ab49bf None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:07:26.412837 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d8f54b-bcae-4ebe-8b23-d9ef80ab49bf None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:07:26.426648 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:07:26.447176 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914c087c-61fc-4c88-9853-66c0ecb9a006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:07:26.447804 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914c087c-61fc-4c88-9853-66c0ecb9a006 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:07:26.448088 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914c087c-61fc-4c88-9853-66c0ecb9a006 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:07:26.448392 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914c087c-61fc-4c88-9853-66c0ecb9a006 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:07:26.454984 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914c087c-61fc-4c88-9853-66c0ecb9a006 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:07:26.456439 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914c087c-61fc-4c88-9853-66c0ecb9a006 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:07:26.467723 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application [None req-914c087c-61fc-4c88-9853-66c0ecb9a006 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:07:26.467723 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:07:26.467723 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:07:26.467723 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:07:26.467723 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:07:26.467723 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:07:26.467723 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:07:26.467723 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:07:26.467723 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:07:26.467723 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:07:26.467723 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:07:26.467723 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:07:26.467723 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 05 12:07:26.467723 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 05 12:07:26.467723 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 05 12:07:26.468751 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 05 12:07:26.468751 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:07:26.468751 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:07:26.468751 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:07:26.468751 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:07:26.468751 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:07:26.468751 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:07:26.468751 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:07:26.468751 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application with Lock( Sep 05 12:07:26.468751 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:07:26.468751 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:07:26.468751 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:07:26.468751 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:07:26.468751 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:07:26.468751 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:07:26.468751 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:07:26.468751 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:07:26.469896 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 05 12:07:26.469896 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 05 12:07:26.469896 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 05 12:07:26.469896 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 05 12:07:26.469896 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 05 12:07:26.469896 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 05 12:07:26.469896 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 05 12:07:26.469896 dv-cinder-855189-1-smb devstack@keystone.service[81720]: ERROR keystone.server.flask.application Sep 05 12:07:26.469896 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 637/1285] 10.222.0.50 () {56 vars in 1111 bytes} [Mon Sep 5 12:07:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:07:26.474870 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3de159-ad90-4dd7-99df-89fe4fd9b16d None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:07:26.524653 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:07:26.574812 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3de159-ad90-4dd7-99df-89fe4fd9b16d None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:07:26.608752 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db16f33-68cd-4ab1-9917-bc96c1623072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:07:26.609390 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db16f33-68cd-4ab1-9917-bc96c1623072 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:07:26.609678 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db16f33-68cd-4ab1-9917-bc96c1623072 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:07:26.609953 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db16f33-68cd-4ab1-9917-bc96c1623072 None admin] PATH_INFO: `/v3/projects` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:07:26.610645 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db16f33-68cd-4ab1-9917-bc96c1623072 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:07:26.610953 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db16f33-68cd-4ab1-9917-bc96c1623072 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:07:26.612384 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db16f33-68cd-4ab1-9917-bc96c1623072 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:07:26.625777 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 649/1286] 10.222.0.50 () {56 vars in 1148 bytes} [Mon Sep 5 12:07:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:07:26.631982 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914c087c-61fc-4c88-9853-66c0ecb9a006 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:07:26.733294 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914c087c-61fc-4c88-9853-66c0ecb9a006 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:07:26.766851 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf2f5fc-c5aa-4e8b-8498-7753cb3696c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:07:26.767453 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf2f5fc-c5aa-4e8b-8498-7753cb3696c1 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:07:26.767732 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf2f5fc-c5aa-4e8b-8498-7753cb3696c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:07:26.768004 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf2f5fc-c5aa-4e8b-8498-7753cb3696c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:07:26.768724 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf2f5fc-c5aa-4e8b-8498-7753cb3696c1 None admin] RBAC: Adding query filter params (role.id=16e2ccc8bd1b497d8cee780c1c7df0d2, scope.project.id=ae4f8939fcc040bca99783a77e6ede4d, user.id=c5427d0752de4817b6aa25e28c2d9a30) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:07:26.769066 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf2f5fc-c5aa-4e8b-8498-7753cb3696c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:07:26.770525 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf2f5fc-c5aa-4e8b-8498-7753cb3696c1 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:07:26.776975 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 638/1287] 10.222.0.50 () {56 vars in 1374 bytes} [Mon Sep 5 12:07:26 2022] GET /identity/v3/role_assignments?user.id=c5427d0752de4817b6aa25e28c2d9a30&scope.project.id=ae4f8939fcc040bca99783a77e6ede4d&role.id=16e2ccc8bd1b497d8cee780c1c7df0d2 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:07:28.730623 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc70491-e670-4ac9-9a24-51cbc4b2e657 None None] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:07:28.731196 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc70491-e670-4ac9-9a24-51cbc4b2e657 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:07:28.731196 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc70491-e670-4ac9-9a24-51cbc4b2e657 None None] PATH_INFO: `/` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:07:28.732521 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 650/1288] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:07:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:07:28.737604 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafe285b-900b-43f9-8784-d6717271a331 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:07:28.738011 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafe285b-900b-43f9-8784-d6717271a331 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:07:28.738150 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafe285b-900b-43f9-8784-d6717271a331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:07:28.757073 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-fafe285b-900b-43f9-8784-d6717271a331 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:07:28.758265 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-fafe285b-900b-43f9-8784-d6717271a331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:07:28.787952 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:07:28.826269 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 639/1289] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:07:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 12:07:29.093987 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc70491-e670-4ac9-9a24-51cbc4b2e657 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:07:29.206390 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc70491-e670-4ac9-9a24-51cbc4b2e657 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:07:29.217765 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:07:29.241218 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2d9bcd-03bb-4cba-9f71-3637e20d4974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:07:29.241848 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2d9bcd-03bb-4cba-9f71-3637e20d4974 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:07:29.242127 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2d9bcd-03bb-4cba-9f71-3637e20d4974 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:07:29.242394 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2d9bcd-03bb-4cba-9f71-3637e20d4974 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:07:29.242972 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2d9bcd-03bb-4cba-9f71-3637e20d4974 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:07:29.244318 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2d9bcd-03bb-4cba-9f71-3637e20d4974 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:07:29.253010 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application [None req-4a2d9bcd-03bb-4cba-9f71-3637e20d4974 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 05 12:07:29.253010 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:07:29.253010 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 05 12:07:29.253010 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 05 12:07:29.253010 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 05 12:07:29.253010 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 05 12:07:29.253010 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 05 12:07:29.253010 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 12:07:29.253010 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 05 12:07:29.253010 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:07:29.253010 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 12:07:29.253010 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:07:29.253010 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:07:29.253010 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:07:29.253010 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:07:29.253010 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:07:29.253010 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:07:29.254216 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:07:29.254216 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:07:29.254216 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:07:29.254216 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:07:29.254216 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:07:29.254216 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:07:29.254216 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 05 12:07:29.254216 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 05 12:07:29.254216 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 05 12:07:29.254216 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 05 12:07:29.254216 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:07:29.254216 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:07:29.254216 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:07:29.254216 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:07:29.254216 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:07:29.254216 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:07:29.255118 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:07:29.255118 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application with Lock( Sep 05 12:07:29.255118 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:07:29.255118 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:07:29.255118 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:07:29.255118 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:07:29.255118 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:07:29.255118 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:07:29.255118 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:07:29.255118 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:07:29.255118 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 05 12:07:29.255118 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 12:07:29.255118 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 05 12:07:29.255118 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:07:29.255118 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 651/1290] 10.222.0.50 () {56 vars in 1117 bytes} [Mon Sep 5 12:07:29 2022] GET /identity/v3/services/placement => generated 90 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:07:29.260070 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafe285b-900b-43f9-8784-d6717271a331 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:07:29.356657 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafe285b-900b-43f9-8784-d6717271a331 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:07:29.390262 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a53e1b-a866-496b-9f0f-9b75e5e823cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:07:29.390859 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a53e1b-a866-496b-9f0f-9b75e5e823cc None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:07:29.391135 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a53e1b-a866-496b-9f0f-9b75e5e823cc None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:07:29.391403 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a53e1b-a866-496b-9f0f-9b75e5e823cc None admin] PATH_INFO: `/v3/services` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:07:29.392022 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a53e1b-a866-496b-9f0f-9b75e5e823cc None admin] RBAC: Adding query filter params (name=placement) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:07:29.392320 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a53e1b-a866-496b-9f0f-9b75e5e823cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:07:29.393712 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a53e1b-a866-496b-9f0f-9b75e5e823cc None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:07:29.398999 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 640/1291] 10.222.0.50 () {56 vars in 1116 bytes} [Mon Sep 5 12:07:29 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:07:29.405038 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2d9bcd-03bb-4cba-9f71-3637e20d4974 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:07:29.502744 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2d9bcd-03bb-4cba-9f71-3637e20d4974 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:07:29.536065 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a9d705-f444-4608-9b4b-b98e7e18505b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:07:29.536670 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a9d705-f444-4608-9b4b-b98e7e18505b None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:07:29.536981 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a9d705-f444-4608-9b4b-b98e7e18505b None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:07:29.537259 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a9d705-f444-4608-9b4b-b98e7e18505b None admin] PATH_INFO: `/v3/services` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:07:29.537889 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a9d705-f444-4608-9b4b-b98e7e18505b None admin] RBAC: Adding query filter params (type=placement) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:07:29.538244 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a9d705-f444-4608-9b4b-b98e7e18505b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:07:29.539613 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a9d705-f444-4608-9b4b-b98e7e18505b None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:07:29.543986 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 652/1292] 10.222.0.50 () {56 vars in 1116 bytes} [Mon Sep 5 12:07:29 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:07:31.417642 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18143b21-d8ec-446c-a7eb-89750d14bfd6 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:07:31.418243 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18143b21-d8ec-446c-a7eb-89750d14bfd6 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:07:31.418243 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18143b21-d8ec-446c-a7eb-89750d14bfd6 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:07:31.419514 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 641/1293] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:07:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:07:31.424684 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fc296c-4cf9-4321-8896-973e90e3cd76 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:07:31.425112 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fc296c-4cf9-4321-8896-973e90e3cd76 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:07:31.425272 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fc296c-4cf9-4321-8896-973e90e3cd76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:07:31.443159 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-89fc296c-4cf9-4321-8896-973e90e3cd76 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:07:31.444345 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-89fc296c-4cf9-4321-8896-973e90e3cd76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:07:31.474404 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:07:31.511402 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 653/1294] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:07:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 12:07:31.778096 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18143b21-d8ec-446c-a7eb-89750d14bfd6 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:07:31.811043 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:07:31.881227 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18143b21-d8ec-446c-a7eb-89750d14bfd6 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:07:31.914456 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e373c47-941e-407b-b188-1b62b9fa6cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:07:31.915054 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e373c47-941e-407b-b188-1b62b9fa6cda None admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:07:31.915331 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e373c47-941e-407b-b188-1b62b9fa6cda None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:07:31.915599 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e373c47-941e-407b-b188-1b62b9fa6cda None admin] PATH_INFO: `/v3/services` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:07:31.916251 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e373c47-941e-407b-b188-1b62b9fa6cda None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:07:31.917644 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e373c47-941e-407b-b188-1b62b9fa6cda None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:07:31.932033 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 642/1295] 10.222.0.50 () {60 vars in 1141 bytes} [Mon Sep 5 12:07:31 2022] POST /identity/v3/services => generated 246 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:07:33.822842 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ec50ee-b4e1-458c-8480-8d5ff7ce5b87 None None] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:07:33.823351 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ec50ee-b4e1-458c-8480-8d5ff7ce5b87 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:07:33.823449 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ec50ee-b4e1-458c-8480-8d5ff7ce5b87 None None] PATH_INFO: `/` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:07:33.824735 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 654/1296] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:07:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:07:33.829797 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f36b5d-029c-4bbc-a36b-9889ab9ad3a6 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:07:33.830200 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f36b5d-029c-4bbc-a36b-9889ab9ad3a6 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:07:33.830353 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f36b5d-029c-4bbc-a36b-9889ab9ad3a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:07:33.850223 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-36f36b5d-029c-4bbc-a36b-9889ab9ad3a6 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:07:33.851450 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-36f36b5d-029c-4bbc-a36b-9889ab9ad3a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:07:33.923400 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 643/1297] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:07:33 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 12:07:34.195799 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ec50ee-b4e1-458c-8480-8d5ff7ce5b87 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:07:34.296222 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ec50ee-b4e1-458c-8480-8d5ff7ce5b87 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:07:34.329129 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c14805-4f09-4be3-8b6a-4b1f819a25be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:07:34.329748 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c14805-4f09-4be3-8b6a-4b1f819a25be None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:07:34.330031 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c14805-4f09-4be3-8b6a-4b1f819a25be None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:07:34.330306 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c14805-4f09-4be3-8b6a-4b1f819a25be None admin] PATH_INFO: `/v3/services/placement` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:07:34.330890 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c14805-4f09-4be3-8b6a-4b1f819a25be None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:07:34.332249 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c14805-4f09-4be3-8b6a-4b1f819a25be None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:07:34.341398 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application [None req-64c14805-4f09-4be3-8b6a-4b1f819a25be None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 05 12:07:34.341398 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:07:34.341398 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 05 12:07:34.341398 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 05 12:07:34.341398 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 05 12:07:34.341398 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 05 12:07:34.341398 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 05 12:07:34.341398 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 12:07:34.341398 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 05 12:07:34.341398 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:07:34.341398 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 12:07:34.341398 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:07:34.341398 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:07:34.341398 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:07:34.341398 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:07:34.341398 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:07:34.341398 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:07:34.342754 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:07:34.342754 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:07:34.342754 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:07:34.342754 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:07:34.342754 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:07:34.342754 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:07:34.342754 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 05 12:07:34.342754 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 05 12:07:34.342754 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 05 12:07:34.342754 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 05 12:07:34.342754 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:07:34.342754 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:07:34.342754 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:07:34.342754 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:07:34.342754 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:07:34.342754 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:07:34.343988 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:07:34.343988 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application with Lock( Sep 05 12:07:34.343988 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:07:34.343988 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:07:34.343988 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:07:34.343988 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:07:34.343988 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:07:34.343988 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:07:34.343988 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:07:34.343988 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:07:34.343988 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 05 12:07:34.343988 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 12:07:34.343988 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 05 12:07:34.343988 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:07:34.343988 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 655/1298] 10.222.0.50 () {56 vars in 1117 bytes} [Mon Sep 5 12:07:34 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:07:34.348505 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f36b5d-029c-4bbc-a36b-9889ab9ad3a6 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:07:34.367278 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:07:34.447205 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f36b5d-029c-4bbc-a36b-9889ab9ad3a6 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:07:34.480946 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6162f229-bf51-41ab-8f3f-871674dfff99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:07:34.481558 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6162f229-bf51-41ab-8f3f-871674dfff99 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:07:34.481839 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6162f229-bf51-41ab-8f3f-871674dfff99 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:07:34.482113 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6162f229-bf51-41ab-8f3f-871674dfff99 None admin] PATH_INFO: `/v3/services` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:07:34.482743 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6162f229-bf51-41ab-8f3f-871674dfff99 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:07:34.483047 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6162f229-bf51-41ab-8f3f-871674dfff99 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:07:34.484424 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6162f229-bf51-41ab-8f3f-871674dfff99 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:07:34.489629 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 644/1299] 10.222.0.50 () {56 vars in 1116 bytes} [Mon Sep 5 12:07:34 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:07:34.495533 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c14805-4f09-4be3-8b6a-4b1f819a25be None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:07:34.526797 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:07:34.594114 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c14805-4f09-4be3-8b6a-4b1f819a25be None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:07:34.628217 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111aae96-eed9-471a-b4f0-1bd5f106ecca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:07:34.628829 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111aae96-eed9-471a-b4f0-1bd5f106ecca None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:07:34.629137 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111aae96-eed9-471a-b4f0-1bd5f106ecca None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:07:34.629414 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111aae96-eed9-471a-b4f0-1bd5f106ecca None admin] PATH_INFO: `/v3/endpoints` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:07:34.630122 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111aae96-eed9-471a-b4f0-1bd5f106ecca None admin] RBAC: Adding query filter params (interface=public, service_id=eb6a0a4b18db477c880c9aeaa5e51020, region_id=RegionOne) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:07:34.630436 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111aae96-eed9-471a-b4f0-1bd5f106ecca None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:07:34.632336 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111aae96-eed9-471a-b4f0-1bd5f106ecca None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:07:34.637503 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 656/1300] 10.222.0.50 () {56 vars in 1251 bytes} [Mon Sep 5 12:07:34 2022] GET /identity/v3/endpoints?service_id=eb6a0a4b18db477c880c9aeaa5e51020&interface=public®ion_id=RegionOne => generated 194 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:07:34.643327 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6162f229-bf51-41ab-8f3f-871674dfff99 None admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:07:34.723288 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:07:34.740812 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6162f229-bf51-41ab-8f3f-871674dfff99 None admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:07:34.774821 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4b1e1f-7d53-4ae5-8ae8-8e40e7f5029d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:07:34.775422 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4b1e1f-7d53-4ae5-8ae8-8e40e7f5029d None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:07:34.775700 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4b1e1f-7d53-4ae5-8ae8-8e40e7f5029d None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:07:34.775970 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4b1e1f-7d53-4ae5-8ae8-8e40e7f5029d None admin] PATH_INFO: `/v3/services` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:07:34.776567 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4b1e1f-7d53-4ae5-8ae8-8e40e7f5029d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:07:34.777963 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4b1e1f-7d53-4ae5-8ae8-8e40e7f5029d None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:07:34.784746 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 645/1301] 10.222.0.50 () {56 vars in 1087 bytes} [Mon Sep 5 12:07:34 2022] GET /identity/v3/services => generated 2191 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:07:36.671638 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdce9c8-2f3b-444f-a4d5-bab68e4c2642 None None] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:07:36.672220 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdce9c8-2f3b-444f-a4d5-bab68e4c2642 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:07:36.672220 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdce9c8-2f3b-444f-a4d5-bab68e4c2642 None None] PATH_INFO: `/` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:07:36.673579 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 657/1302] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:07:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:07:36.679745 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245f0771-9bce-4cff-86b3-cc9c2d583f3a None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:07:36.680262 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245f0771-9bce-4cff-86b3-cc9c2d583f3a None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:07:36.680262 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245f0771-9bce-4cff-86b3-cc9c2d583f3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:07:36.700409 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-245f0771-9bce-4cff-86b3-cc9c2d583f3a None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:07:36.701657 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-245f0771-9bce-4cff-86b3-cc9c2d583f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:07:36.768499 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 646/1303] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:07:36 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 05 12:07:37.039216 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdce9c8-2f3b-444f-a4d5-bab68e4c2642 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:07:37.140742 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:07:37.149833 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdce9c8-2f3b-444f-a4d5-bab68e4c2642 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:07:37.189423 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90579d7-6b10-41be-92f4-20f1130864e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:07:37.190051 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90579d7-6b10-41be-92f4-20f1130864e9 None admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:07:37.190330 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90579d7-6b10-41be-92f4-20f1130864e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:07:37.190601 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90579d7-6b10-41be-92f4-20f1130864e9 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:07:37.191180 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90579d7-6b10-41be-92f4-20f1130864e9 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:07:37.192528 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90579d7-6b10-41be-92f4-20f1130864e9 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:07:37.201209 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application [None req-f90579d7-6b10-41be-92f4-20f1130864e9 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 05 12:07:37.201209 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:07:37.201209 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 05 12:07:37.201209 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 05 12:07:37.201209 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 05 12:07:37.201209 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 05 12:07:37.201209 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 05 12:07:37.201209 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 12:07:37.201209 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 05 12:07:37.201209 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:07:37.201209 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 05 12:07:37.201209 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:07:37.201209 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 05 12:07:37.201209 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 05 12:07:37.201209 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 05 12:07:37.201209 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 05 12:07:37.201209 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 05 12:07:37.202478 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 05 12:07:37.202478 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 05 12:07:37.202478 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 05 12:07:37.202478 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 05 12:07:37.202478 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 05 12:07:37.202478 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 05 12:07:37.202478 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 05 12:07:37.202478 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 05 12:07:37.202478 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 05 12:07:37.202478 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 05 12:07:37.202478 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 05 12:07:37.202478 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 05 12:07:37.202478 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 05 12:07:37.202478 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 05 12:07:37.202478 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 05 12:07:37.202478 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.get_or_create( Sep 05 12:07:37.203509 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 05 12:07:37.203509 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application with Lock( Sep 05 12:07:37.203509 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 05 12:07:37.203509 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self._enter() Sep 05 12:07:37.203509 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 05 12:07:37.203509 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 05 12:07:37.203509 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 05 12:07:37.203509 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application return self.creator() Sep 05 12:07:37.203509 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 05 12:07:37.203509 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application created_value = creator( Sep 05 12:07:37.203509 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 05 12:07:37.203509 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 05 12:07:37.203509 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 05 12:07:37.203509 dv-cinder-855189-1-smb devstack@keystone.service[81719]: ERROR keystone.server.flask.application Sep 05 12:07:37.203509 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 658/1304] 10.222.0.50 () {56 vars in 1117 bytes} [Mon Sep 5 12:07:37 2022] GET /identity/v3/services/placement => generated 90 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 05 12:07:37.208339 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245f0771-9bce-4cff-86b3-cc9c2d583f3a None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:07:37.285263 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:07:37.308782 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245f0771-9bce-4cff-86b3-cc9c2d583f3a None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:07:37.341804 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da84411-58eb-4ad8-b958-99932bf5c754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:07:37.342403 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da84411-58eb-4ad8-b958-99932bf5c754 None admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:07:37.342684 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da84411-58eb-4ad8-b958-99932bf5c754 None admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:07:37.342955 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da84411-58eb-4ad8-b958-99932bf5c754 None admin] PATH_INFO: `/v3/services` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:07:37.343575 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da84411-58eb-4ad8-b958-99932bf5c754 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:07:37.343873 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da84411-58eb-4ad8-b958-99932bf5c754 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:07:37.345269 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da84411-58eb-4ad8-b958-99932bf5c754 None admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:07:37.350279 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 647/1305] 10.222.0.50 () {56 vars in 1116 bytes} [Mon Sep 5 12:07:37 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:07:37.356665 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90579d7-6b10-41be-92f4-20f1130864e9 None admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:07:37.456137 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90579d7-6b10-41be-92f4-20f1130864e9 None admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:07:37.490114 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755dcaaa-3e1a-47d8-bcff-97a128ce20d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:07:37.490715 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755dcaaa-3e1a-47d8-bcff-97a128ce20d5 None admin] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:07:37.491483 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755dcaaa-3e1a-47d8-bcff-97a128ce20d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:07:37.491753 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755dcaaa-3e1a-47d8-bcff-97a128ce20d5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:07:37.492461 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755dcaaa-3e1a-47d8-bcff-97a128ce20d5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:07:37.493855 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755dcaaa-3e1a-47d8-bcff-97a128ce20d5 None admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:07:37.513989 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 659/1306] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 5 12:07:37 2022] POST /identity/v3/endpoints => generated 331 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:07:47.347337 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=30 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:07:47.508817 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:08:42.107689 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6142d62f-925a-4ada-93a6-65f6fe4cef1a None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:08:42.108256 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6142d62f-925a-4ada-93a6-65f6fe4cef1a None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:08:42.108256 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6142d62f-925a-4ada-93a6-65f6fe4cef1a None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:08:42.115886 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c04c956-8450-4d2e-8762-9aafb91bf3e3 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:08:42.115886 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c04c956-8450-4d2e-8762-9aafb91bf3e3 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:08:42.116328 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c04c956-8450-4d2e-8762-9aafb91bf3e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:08:42.120854 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 648/1307] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:08:42 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:08:42.318514 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-2c04c956-8450-4d2e-8762-9aafb91bf3e3 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:08:42.322278 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-2c04c956-8450-4d2e-8762-9aafb91bf3e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:08:42.471952 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 660/1308] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:08:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 12:08:42.763761 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073b22fc-bfc6-449d-ad38-90d77cc65ec2 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:08:42.764210 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073b22fc-bfc6-449d-ad38-90d77cc65ec2 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:08:42.764591 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073b22fc-bfc6-449d-ad38-90d77cc65ec2 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:08:42.766231 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 649/1309] 10.222.0.50 () {54 vars in 965 bytes} [Mon Sep 5 12:08:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 12:08:42.773540 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0af4c27-b9e8-471c-a7db-e4637b999f2c None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:08:42.774004 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0af4c27-b9e8-471c-a7db-e4637b999f2c None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:08:42.774389 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0af4c27-b9e8-471c-a7db-e4637b999f2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:08:42.873494 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-e0af4c27-b9e8-471c-a7db-e4637b999f2c None None] MFA Rules not processed for user `4994b4faa4ec4aa088f3dc32c9c5614d`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:08:42.874902 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-e0af4c27-b9e8-471c-a7db-e4637b999f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:08:42.902794 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:08:42.971329 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 661/1310] 10.222.0.50 () {58 vars in 1062 bytes} [Mon Sep 5 12:08:42 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:08:42.980575 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073b22fc-bfc6-449d-ad38-90d77cc65ec2 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:08:42.982383 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-073b22fc-bfc6-449d-ad38-90d77cc65ec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:08:43.100760 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073b22fc-bfc6-449d-ad38-90d77cc65ec2 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:08:43.181792 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11234d9-4a2c-48ae-b3a3-8085c0e33a04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4994b4faa4ec4aa088f3dc32c9c5614d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:08:43.182471 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11234d9-4a2c-48ae-b3a3-8085c0e33a04 service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:08:43.182771 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11234d9-4a2c-48ae-b3a3-8085c0e33a04 service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:08:43.182967 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11234d9-4a2c-48ae-b3a3-8085c0e33a04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:08:43.184532 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-e11234d9-4a2c-48ae-b3a3-8085c0e33a04 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:08:43.244465 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:08:43.305048 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11234d9-4a2c-48ae-b3a3-8085c0e33a04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:08:43.306511 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11234d9-4a2c-48ae-b3a3-8085c0e33a04 service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:08:43.327239 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 650/1311] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:08:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:08:45.579338 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e40a8cc-7c8d-4c3d-9d64-e7def9f4d088 None None] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:08:45.579869 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e40a8cc-7c8d-4c3d-9d64-e7def9f4d088 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:08:45.579869 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e40a8cc-7c8d-4c3d-9d64-e7def9f4d088 None None] PATH_INFO: `/` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:08:45.581269 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 662/1312] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:08:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:08:45.587819 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf7265b-57bc-4885-8ccc-6001c4b47edf None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:08:45.588277 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf7265b-57bc-4885-8ccc-6001c4b47edf None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:08:45.588568 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf7265b-57bc-4885-8ccc-6001c4b47edf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:08:45.669684 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-4bf7265b-57bc-4885-8ccc-6001c4b47edf None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:08:45.670934 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-4bf7265b-57bc-4885-8ccc-6001c4b47edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:08:45.778290 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 651/1313] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:08:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:08:46.064203 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e40a8cc-7c8d-4c3d-9d64-e7def9f4d088 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:08:46.066035 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-4e40a8cc-7c8d-4c3d-9d64-e7def9f4d088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:08:46.168679 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e40a8cc-7c8d-4c3d-9d64-e7def9f4d088 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:08:46.238927 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:08:46.242316 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae3ea2f-a28b-4f81-85f1-3d4cf0802190 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4994b4faa4ec4aa088f3dc32c9c5614d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:08:46.243128 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae3ea2f-a28b-4f81-85f1-3d4cf0802190 service neutron] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:08:46.243621 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae3ea2f-a28b-4f81-85f1-3d4cf0802190 service neutron] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:08:46.243945 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae3ea2f-a28b-4f81-85f1-3d4cf0802190 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:08:46.245845 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-3ae3ea2f-a28b-4f81-85f1-3d4cf0802190 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:08:46.358365 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae3ea2f-a28b-4f81-85f1-3d4cf0802190 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:08:46.359827 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae3ea2f-a28b-4f81-85f1-3d4cf0802190 service neutron] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:08:46.380832 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 663/1314] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:08:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:08:48.602545 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5b9e3e-8b7b-41e1-8672-e7a269dd5369 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:08:48.603069 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5b9e3e-8b7b-41e1-8672-e7a269dd5369 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:08:48.603069 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5b9e3e-8b7b-41e1-8672-e7a269dd5369 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:08:48.604416 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 652/1315] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:08:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:08:48.609445 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72421d74-201d-486a-9034-f22dc38c3d37 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:08:48.609839 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72421d74-201d-486a-9034-f22dc38c3d37 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:08:48.609995 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72421d74-201d-486a-9034-f22dc38c3d37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:08:48.681722 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-72421d74-201d-486a-9034-f22dc38c3d37 None None] MFA Rules not processed for user `5f0c885f940345c6b98a71ea1ff0ff13`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:08:48.682886 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-72421d74-201d-486a-9034-f22dc38c3d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:08:48.739167 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:08:48.788776 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 664/1316] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:08:48 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:08:49.080099 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5b9e3e-8b7b-41e1-8672-e7a269dd5369 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:08:49.081712 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-fd5b9e3e-8b7b-41e1-8672-e7a269dd5369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:08:49.091491 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:08:49.193147 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5b9e3e-8b7b-41e1-8672-e7a269dd5369 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:08:49.267647 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82a2152-09a8-4626-891c-871bd03fd892 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4994b4faa4ec4aa088f3dc32c9c5614d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:08:49.268248 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82a2152-09a8-4626-891c-871bd03fd892 service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:08:49.268522 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82a2152-09a8-4626-891c-871bd03fd892 service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:08:49.268786 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82a2152-09a8-4626-891c-871bd03fd892 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:08:49.270396 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-f82a2152-09a8-4626-891c-871bd03fd892 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:08:49.331019 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:08:49.379058 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82a2152-09a8-4626-891c-871bd03fd892 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:08:49.380515 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82a2152-09a8-4626-891c-871bd03fd892 service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:08:49.399278 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 653/1317] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:08:49 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:08:51.833383 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f19d9d8-473b-4a45-96aa-9e08c9d9d39a None None] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:08:51.834444 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f19d9d8-473b-4a45-96aa-9e08c9d9d39a None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:08:51.834444 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f19d9d8-473b-4a45-96aa-9e08c9d9d39a None None] PATH_INFO: `/` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:08:51.835782 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 665/1318] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:08:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:08:51.841291 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af5847b-32c0-4bbe-9863-7efd27c8536c None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:08:51.842011 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af5847b-32c0-4bbe-9863-7efd27c8536c None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:08:51.842011 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af5847b-32c0-4bbe-9863-7efd27c8536c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:08:51.914477 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-3af5847b-32c0-4bbe-9863-7efd27c8536c None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:08:51.915634 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-3af5847b-32c0-4bbe-9863-7efd27c8536c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:08:52.021924 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 654/1319] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:08:51 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:08:52.331448 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a517493-1401-4da1-a42a-8ca8bbc0967c None None] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:08:52.331723 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a517493-1401-4da1-a42a-8ca8bbc0967c None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:08:52.331998 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a517493-1401-4da1-a42a-8ca8bbc0967c None None] PATH_INFO: `/` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:08:52.333433 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 666/1320] 10.222.0.50 () {54 vars in 965 bytes} [Mon Sep 5 12:08:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:08:52.339949 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec410b6-df84-476f-99b7-32ec1f9c50af None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:08:52.340254 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec410b6-df84-476f-99b7-32ec1f9c50af None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:08:52.340507 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec410b6-df84-476f-99b7-32ec1f9c50af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:08:52.368251 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:08:52.428798 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-cec410b6-df84-476f-99b7-32ec1f9c50af None None] MFA Rules not processed for user `4994b4faa4ec4aa088f3dc32c9c5614d`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:08:52.430045 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-cec410b6-df84-476f-99b7-32ec1f9c50af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:08:52.515045 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 655/1321] 10.222.0.50 () {58 vars in 1062 bytes} [Mon Sep 5 12:08:52 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 12:08:52.524848 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a517493-1401-4da1-a42a-8ca8bbc0967c None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:08:52.526468 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-0a517493-1401-4da1-a42a-8ca8bbc0967c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:08:52.647015 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a517493-1401-4da1-a42a-8ca8bbc0967c None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:08:52.729268 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df04c58-c79d-4bc8-8f0c-0ff1ba7833d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4994b4faa4ec4aa088f3dc32c9c5614d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:08:52.729880 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df04c58-c79d-4bc8-8f0c-0ff1ba7833d7 service neutron] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:08:52.730159 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df04c58-c79d-4bc8-8f0c-0ff1ba7833d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:08:52.730454 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df04c58-c79d-4bc8-8f0c-0ff1ba7833d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:08:52.732119 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-4df04c58-c79d-4bc8-8f0c-0ff1ba7833d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:08:52.740846 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:08:52.855693 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df04c58-c79d-4bc8-8f0c-0ff1ba7833d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:08:52.857165 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df04c58-c79d-4bc8-8f0c-0ff1ba7833d7 service neutron] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:08:52.876277 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 667/1322] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:08:52 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:08:56.454538 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d43c742-d148-4af8-a5a0-024d0fe33794 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:08:56.455082 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d43c742-d148-4af8-a5a0-024d0fe33794 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:08:56.455536 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d43c742-d148-4af8-a5a0-024d0fe33794 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:08:56.458251 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 656/1323] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:08:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:08:56.465779 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec89879-75fa-4e9f-a926-f511fcf2886e None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:08:56.466495 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec89879-75fa-4e9f-a926-f511fcf2886e None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:08:56.466747 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec89879-75fa-4e9f-a926-f511fcf2886e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:08:56.559314 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-9ec89879-75fa-4e9f-a926-f511fcf2886e None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:08:56.560642 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-9ec89879-75fa-4e9f-a926-f511fcf2886e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:08:56.645472 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:08:56.700611 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 668/1324] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:08:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:08:57.214186 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d43c742-d148-4af8-a5a0-024d0fe33794 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:08:57.216939 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-6d43c742-d148-4af8-a5a0-024d0fe33794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:08:57.414445 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d43c742-d148-4af8-a5a0-024d0fe33794 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:08:57.439232 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:08:57.550824 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0384250-40f6-4480-90a0-5cc2a4d65701 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4994b4faa4ec4aa088f3dc32c9c5614d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:08:57.551538 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0384250-40f6-4480-90a0-5cc2a4d65701 service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:08:57.551716 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0384250-40f6-4480-90a0-5cc2a4d65701 service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:08:57.552019 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0384250-40f6-4480-90a0-5cc2a4d65701 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:08:57.554422 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-d0384250-40f6-4480-90a0-5cc2a4d65701 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:08:57.719624 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0384250-40f6-4480-90a0-5cc2a4d65701 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:08:57.720999 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0384250-40f6-4480-90a0-5cc2a4d65701 service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:08:57.742881 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 657/1325] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:08:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 530 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:09:00.110574 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aa969c-a4cf-4dd9-8f43-e5fc81586eaf None None] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:09:00.111932 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aa969c-a4cf-4dd9-8f43-e5fc81586eaf None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:09:00.111932 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aa969c-a4cf-4dd9-8f43-e5fc81586eaf None None] PATH_INFO: `/` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:09:00.112724 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 669/1326] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:09:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:09:00.118505 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a52d9cf-5a06-4417-b5cb-8210473a082f None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:09:00.119016 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a52d9cf-5a06-4417-b5cb-8210473a082f None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:09:00.119111 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a52d9cf-5a06-4417-b5cb-8210473a082f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:09:00.181078 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:09:00.202759 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-7a52d9cf-5a06-4417-b5cb-8210473a082f None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:09:00.204222 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-7a52d9cf-5a06-4417-b5cb-8210473a082f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:09:00.326298 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 658/1327] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:09:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:09:00.635429 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aa969c-a4cf-4dd9-8f43-e5fc81586eaf None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:09:00.639116 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-01aa969c-a4cf-4dd9-8f43-e5fc81586eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:09:00.846147 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aa969c-a4cf-4dd9-8f43-e5fc81586eaf None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:09:00.958769 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4b728c-9d66-446d-8670-7dc595b48f16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4994b4faa4ec4aa088f3dc32c9c5614d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:09:00.959393 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4b728c-9d66-446d-8670-7dc595b48f16 service neutron] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:09:00.959667 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4b728c-9d66-446d-8670-7dc595b48f16 service neutron] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:09:00.959948 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4b728c-9d66-446d-8670-7dc595b48f16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:09:00.961675 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-9f4b728c-9d66-446d-8670-7dc595b48f16 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:09:00.981868 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:09:01.137636 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4b728c-9d66-446d-8670-7dc595b48f16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:09:01.139258 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4b728c-9d66-446d-8670-7dc595b48f16 service neutron] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:09:01.162251 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 670/1328] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:09:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 528 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:09:03.309424 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbe5c83-a33f-42ad-9cdd-9f4327a305f9 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:09:03.310050 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbe5c83-a33f-42ad-9cdd-9f4327a305f9 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:09:03.310158 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbe5c83-a33f-42ad-9cdd-9f4327a305f9 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:09:03.311796 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 659/1329] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:09:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:09:03.318160 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cb3177-4482-4042-af08-0ec02fb69118 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:09:03.318757 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cb3177-4482-4042-af08-0ec02fb69118 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:09:03.318757 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cb3177-4482-4042-af08-0ec02fb69118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:09:03.409624 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-63cb3177-4482-4042-af08-0ec02fb69118 None None] MFA Rules not processed for user `5f0c885f940345c6b98a71ea1ff0ff13`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:09:03.411202 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-63cb3177-4482-4042-af08-0ec02fb69118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:09:03.502206 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:09:03.543110 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 671/1330] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:09:03 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:09:03.830593 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbe5c83-a33f-42ad-9cdd-9f4327a305f9 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:09:03.833868 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-4fbe5c83-a33f-42ad-9cdd-9f4327a305f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:09:03.968429 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbe5c83-a33f-42ad-9cdd-9f4327a305f9 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:09:03.991187 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:09:04.056731 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4519178-1117-4b48-ac88-f1f5d5ee0681 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4994b4faa4ec4aa088f3dc32c9c5614d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:09:04.057360 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4519178-1117-4b48-ac88-f1f5d5ee0681 service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:09:04.057744 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4519178-1117-4b48-ac88-f1f5d5ee0681 service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:09:04.058168 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4519178-1117-4b48-ac88-f1f5d5ee0681 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:09:04.060609 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-d4519178-1117-4b48-ac88-f1f5d5ee0681 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:09:04.201460 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4519178-1117-4b48-ac88-f1f5d5ee0681 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:09:04.202932 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4519178-1117-4b48-ac88-f1f5d5ee0681 service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:09:04.224286 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 660/1331] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:09:03 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:09:06.554555 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc303dd-260c-459d-a1cf-d0224a744963 None None] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:09:06.555316 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc303dd-260c-459d-a1cf-d0224a744963 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:09:06.555316 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc303dd-260c-459d-a1cf-d0224a744963 None None] PATH_INFO: `/` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:09:06.556464 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 672/1332] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:09:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:09:06.561936 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5821faf-960f-40a3-b767-a7a399654855 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:09:06.562403 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5821faf-960f-40a3-b767-a7a399654855 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:09:06.562514 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5821faf-960f-40a3-b767-a7a399654855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:09:06.633304 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:09:06.637366 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-d5821faf-960f-40a3-b767-a7a399654855 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:09:06.638812 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-d5821faf-960f-40a3-b767-a7a399654855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:09:06.745712 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 661/1333] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:09:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:09:07.034257 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc303dd-260c-459d-a1cf-d0224a744963 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:09:07.035841 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-ccc303dd-260c-459d-a1cf-d0224a744963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:09:07.156110 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc303dd-260c-459d-a1cf-d0224a744963 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:09:07.231339 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3413f1fd-f895-4634-8e1b-c534ad3f6ebc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4994b4faa4ec4aa088f3dc32c9c5614d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:09:07.231949 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3413f1fd-f895-4634-8e1b-c534ad3f6ebc service neutron] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:09:07.232230 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3413f1fd-f895-4634-8e1b-c534ad3f6ebc service neutron] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:09:07.232502 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3413f1fd-f895-4634-8e1b-c534ad3f6ebc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:09:07.234165 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-3413f1fd-f895-4634-8e1b-c534ad3f6ebc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:09:07.263289 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:09:07.350203 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3413f1fd-f895-4634-8e1b-c534ad3f6ebc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:09:07.351665 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3413f1fd-f895-4634-8e1b-c534ad3f6ebc service neutron] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:09:07.371233 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 673/1334] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:09:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:09:09.373565 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d5b880-46ed-46c9-978b-3776c96b630c None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:09:09.374157 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d5b880-46ed-46c9-978b-3776c96b630c None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:09:09.374157 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d5b880-46ed-46c9-978b-3776c96b630c None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:09:09.375712 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 662/1335] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:09:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 12:09:09.381578 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64bccb9-59af-4274-9100-ab8635a36f5e None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:09:09.382279 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64bccb9-59af-4274-9100-ab8635a36f5e None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:09:09.382279 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64bccb9-59af-4274-9100-ab8635a36f5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:09:09.453623 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-d64bccb9-59af-4274-9100-ab8635a36f5e None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:09:09.454850 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-d64bccb9-59af-4274-9100-ab8635a36f5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:09:09.539876 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:09:09.565502 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 674/1336] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:09:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:09:09.871845 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d5b880-46ed-46c9-978b-3776c96b630c None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:09:09.873786 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-39d5b880-46ed-46c9-978b-3776c96b630c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:09:09.987320 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d5b880-46ed-46c9-978b-3776c96b630c None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:09:10.016541 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:09:10.066167 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fe2aa8-c32c-416e-9515-f7110e59a80c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4994b4faa4ec4aa088f3dc32c9c5614d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:09:10.066772 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fe2aa8-c32c-416e-9515-f7110e59a80c service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:09:10.067046 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fe2aa8-c32c-416e-9515-f7110e59a80c service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:09:10.067317 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fe2aa8-c32c-416e-9515-f7110e59a80c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:09:10.069525 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-73fe2aa8-c32c-416e-9515-f7110e59a80c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:09:10.192201 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fe2aa8-c32c-416e-9515-f7110e59a80c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:09:10.194198 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fe2aa8-c32c-416e-9515-f7110e59a80c service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:09:10.217963 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 663/1337] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:09:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:09:12.582763 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9fb997-de2e-4c10-b043-88e8d3619558 None None] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:09:12.584000 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9fb997-de2e-4c10-b043-88e8d3619558 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:09:12.584000 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9fb997-de2e-4c10-b043-88e8d3619558 None None] PATH_INFO: `/` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:09:12.585222 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 675/1338] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:09:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:09:12.591222 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bfb0ca-1fe2-42ea-96f8-f8b847eb9a2d None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:09:12.591993 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bfb0ca-1fe2-42ea-96f8-f8b847eb9a2d None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:09:12.592150 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bfb0ca-1fe2-42ea-96f8-f8b847eb9a2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:09:12.668708 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-27bfb0ca-1fe2-42ea-96f8-f8b847eb9a2d None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:09:12.669933 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-27bfb0ca-1fe2-42ea-96f8-f8b847eb9a2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:09:12.678881 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:09:12.774572 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 664/1339] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:09:12 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:09:13.071312 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9fb997-de2e-4c10-b043-88e8d3619558 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:09:13.074331 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-1c9fb997-de2e-4c10-b043-88e8d3619558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:09:13.204850 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9fb997-de2e-4c10-b043-88e8d3619558 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:09:13.307122 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0542c6f2-0c1c-4f51-9cad-05ccabf4b11e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4994b4faa4ec4aa088f3dc32c9c5614d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:09:13.308172 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0542c6f2-0c1c-4f51-9cad-05ccabf4b11e service neutron] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:09:13.308606 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0542c6f2-0c1c-4f51-9cad-05ccabf4b11e service neutron] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:09:13.309156 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0542c6f2-0c1c-4f51-9cad-05ccabf4b11e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:09:13.312407 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-0542c6f2-0c1c-4f51-9cad-05ccabf4b11e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:09:13.366838 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:09:13.449437 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0542c6f2-0c1c-4f51-9cad-05ccabf4b11e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:09:13.451200 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0542c6f2-0c1c-4f51-9cad-05ccabf4b11e service neutron] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:09:13.470278 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 676/1340] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:09:13 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:09:17.651964 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1a58f8-ac07-4a23-98ba-59e3eecd34b5 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:09:17.651964 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1a58f8-ac07-4a23-98ba-59e3eecd34b5 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:09:17.652858 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1a58f8-ac07-4a23-98ba-59e3eecd34b5 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:09:17.653867 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 665/1341] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:09:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 12:09:17.659459 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c95641-a7ec-463c-a7d2-1a41a4c0b054 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:09:17.659994 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c95641-a7ec-463c-a7d2-1a41a4c0b054 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:09:17.659994 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c95641-a7ec-463c-a7d2-1a41a4c0b054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:09:17.754133 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-19c95641-a7ec-463c-a7d2-1a41a4c0b054 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:09:17.755457 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-19c95641-a7ec-463c-a7d2-1a41a4c0b054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:09:17.876100 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:09:17.891297 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 677/1342] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:09:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:09:18.208829 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1a58f8-ac07-4a23-98ba-59e3eecd34b5 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:09:18.210441 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-9a1a58f8-ac07-4a23-98ba-59e3eecd34b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:09:18.332327 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1a58f8-ac07-4a23-98ba-59e3eecd34b5 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:09:18.377588 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:09:18.427109 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cec1fd-5a03-422c-8be2-721776a0a9d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4994b4faa4ec4aa088f3dc32c9c5614d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:09:18.427995 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cec1fd-5a03-422c-8be2-721776a0a9d8 service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:09:18.428276 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cec1fd-5a03-422c-8be2-721776a0a9d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:09:18.428650 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cec1fd-5a03-422c-8be2-721776a0a9d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:09:18.431020 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-84cec1fd-5a03-422c-8be2-721776a0a9d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:09:18.577572 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cec1fd-5a03-422c-8be2-721776a0a9d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:09:18.579191 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cec1fd-5a03-422c-8be2-721776a0a9d8 service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:09:18.607894 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 666/1343] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:09:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 12:09:21.533464 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2741fc-71e7-4166-9e7c-38cff25f4ee5 None None] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:09:21.534023 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2741fc-71e7-4166-9e7c-38cff25f4ee5 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:09:21.534023 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2741fc-71e7-4166-9e7c-38cff25f4ee5 None None] PATH_INFO: `/` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:09:21.535372 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 678/1344] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:09:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:09:21.541451 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c9f06e-9bd9-4098-ae81-f7adc4df90f3 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:09:21.541982 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c9f06e-9bd9-4098-ae81-f7adc4df90f3 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:09:21.541982 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c9f06e-9bd9-4098-ae81-f7adc4df90f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:09:21.611964 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-93c9f06e-9bd9-4098-ae81-f7adc4df90f3 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:09:21.613222 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-93c9f06e-9bd9-4098-ae81-f7adc4df90f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:09:21.632120 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:09:21.719193 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 667/1345] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:09:21 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:09:21.999797 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2741fc-71e7-4166-9e7c-38cff25f4ee5 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:09:22.001455 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-6f2741fc-71e7-4166-9e7c-38cff25f4ee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:09:22.116634 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2741fc-71e7-4166-9e7c-38cff25f4ee5 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:09:22.204270 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22d069a-72bc-4dcd-86d1-df3c8e5b484c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4994b4faa4ec4aa088f3dc32c9c5614d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:09:22.204881 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22d069a-72bc-4dcd-86d1-df3c8e5b484c service neutron] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:09:22.205192 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22d069a-72bc-4dcd-86d1-df3c8e5b484c service neutron] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:09:22.205464 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22d069a-72bc-4dcd-86d1-df3c8e5b484c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:09:22.207135 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-f22d069a-72bc-4dcd-86d1-df3c8e5b484c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:09:22.256470 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:09:22.327538 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22d069a-72bc-4dcd-86d1-df3c8e5b484c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:09:22.329025 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22d069a-72bc-4dcd-86d1-df3c8e5b484c service neutron] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:09:22.350136 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 679/1346] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:09:21 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 12:09:26.563960 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499e499b-c65f-4556-a0a8-3b5c304fbf8c None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:09:26.564573 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499e499b-c65f-4556-a0a8-3b5c304fbf8c None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:09:26.564573 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499e499b-c65f-4556-a0a8-3b5c304fbf8c None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:09:26.565880 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 668/1347] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:09:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:09:26.571464 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ef94d1-6f30-4914-9c30-1c7c6768a7e6 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:09:26.571979 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ef94d1-6f30-4914-9c30-1c7c6768a7e6 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:09:26.572084 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ef94d1-6f30-4914-9c30-1c7c6768a7e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:09:26.658991 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-04ef94d1-6f30-4914-9c30-1c7c6768a7e6 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:09:26.661686 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-04ef94d1-6f30-4914-9c30-1c7c6768a7e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:09:26.781816 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:09:26.784437 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 680/1348] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:09:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:09:27.072104 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499e499b-c65f-4556-a0a8-3b5c304fbf8c None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:09:27.073856 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-499e499b-c65f-4556-a0a8-3b5c304fbf8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:09:27.182850 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499e499b-c65f-4556-a0a8-3b5c304fbf8c None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:09:27.231614 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:09:27.260543 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083d6ac0-d26a-4295-9eeb-a28281a1924b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4994b4faa4ec4aa088f3dc32c9c5614d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:09:27.261104 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083d6ac0-d26a-4295-9eeb-a28281a1924b service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:09:27.261392 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083d6ac0-d26a-4295-9eeb-a28281a1924b service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:09:27.261664 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083d6ac0-d26a-4295-9eeb-a28281a1924b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:09:27.263277 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-083d6ac0-d26a-4295-9eeb-a28281a1924b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:09:27.375970 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083d6ac0-d26a-4295-9eeb-a28281a1924b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:09:27.377463 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083d6ac0-d26a-4295-9eeb-a28281a1924b service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:09:27.396489 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 669/1349] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:09:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:09:32.530522 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e34e8-6b83-4cb3-93e1-ad1f1b95e030 None None] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:09:32.530982 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e34e8-6b83-4cb3-93e1-ad1f1b95e030 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:09:32.531092 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e34e8-6b83-4cb3-93e1-ad1f1b95e030 None None] PATH_INFO: `/` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:09:32.532969 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 681/1350] 10.222.0.50 () {54 vars in 921 bytes} [Mon Sep 5 12:09:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:09:32.538344 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aed51c2-d488-4b7f-a0d7-1ccef37f1808 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:09:32.538722 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aed51c2-d488-4b7f-a0d7-1ccef37f1808 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:09:32.538875 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aed51c2-d488-4b7f-a0d7-1ccef37f1808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:09:32.626296 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-3aed51c2-d488-4b7f-a0d7-1ccef37f1808 None None] MFA Rules not processed for user `c5427d0752de4817b6aa25e28c2d9a30`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:09:32.627007 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-3aed51c2-d488-4b7f-a0d7-1ccef37f1808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:09:32.672724 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:09:32.786656 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 670/1351] 10.222.0.50 () {58 vars in 1018 bytes} [Mon Sep 5 12:09:32 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:09:37.028301 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c92bfd-fb95-47fa-a25e-4b0c47ccdf26 None None] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:09:37.028938 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c92bfd-fb95-47fa-a25e-4b0c47ccdf26 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:09:37.028938 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c92bfd-fb95-47fa-a25e-4b0c47ccdf26 None None] PATH_INFO: `/` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:09:37.030467 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 682/1352] 10.222.0.50 () {54 vars in 921 bytes} [Mon Sep 5 12:09:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:09:37.035638 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68abf9a-3f1c-4c19-b960-9c2181220fb2 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:09:37.036707 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68abf9a-3f1c-4c19-b960-9c2181220fb2 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:09:37.037029 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68abf9a-3f1c-4c19-b960-9c2181220fb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:09:37.123218 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-b68abf9a-3f1c-4c19-b960-9c2181220fb2 None None] MFA Rules not processed for user `c5427d0752de4817b6aa25e28c2d9a30`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:09:37.124448 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-b68abf9a-3f1c-4c19-b960-9c2181220fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:09:37.202759 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:09:37.243546 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 671/1353] 10.222.0.50 () {58 vars in 1018 bytes} [Mon Sep 5 12:09:37 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 12:09:38.618866 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9c619c-1a7e-4ee8-b3a5-70a6b66a0a4a None None] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:09:38.619397 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9c619c-1a7e-4ee8-b3a5-70a6b66a0a4a None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:09:38.619479 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9c619c-1a7e-4ee8-b3a5-70a6b66a0a4a None None] PATH_INFO: `/` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:09:38.620772 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 683/1354] 10.222.0.50 () {54 vars in 921 bytes} [Mon Sep 5 12:09:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:09:38.626124 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc742a17-ffdc-4486-86be-544d5798bef3 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:09:38.626558 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc742a17-ffdc-4486-86be-544d5798bef3 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:09:38.626679 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc742a17-ffdc-4486-86be-544d5798bef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:09:38.704374 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-fc742a17-ffdc-4486-86be-544d5798bef3 None None] MFA Rules not processed for user `c5427d0752de4817b6aa25e28c2d9a30`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:09:38.705875 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-fc742a17-ffdc-4486-86be-544d5798bef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:09:38.820598 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 672/1355] 10.222.0.50 () {58 vars in 1018 bytes} [Mon Sep 5 12:09:38 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:09:42.237613 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f48159c-1cbe-4793-8b52-06871a409709 None None] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:09:42.238376 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f48159c-1cbe-4793-8b52-06871a409709 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:09:42.238376 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f48159c-1cbe-4793-8b52-06871a409709 None None] PATH_INFO: `/` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:09:42.239539 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 684/1356] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:09:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 12:09:42.245256 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4e51dd-f5b7-4952-a578-fce2b78d95e4 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:09:42.245971 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4e51dd-f5b7-4952-a578-fce2b78d95e4 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:09:42.246285 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4e51dd-f5b7-4952-a578-fce2b78d95e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:09:42.285673 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:09:42.321053 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-1c4e51dd-f5b7-4952-a578-fce2b78d95e4 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:09:42.322479 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-1c4e51dd-f5b7-4952-a578-fce2b78d95e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:09:42.480835 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 673/1357] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:09:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:09:42.811764 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3fb096-bb0e-48c9-b82e-dd8a76898e3f None None] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:09:42.812464 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3fb096-bb0e-48c9-b82e-dd8a76898e3f None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:09:42.813076 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3fb096-bb0e-48c9-b82e-dd8a76898e3f None None] PATH_INFO: `/` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:09:42.815500 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 685/1358] 10.222.0.50 () {54 vars in 962 bytes} [Mon Sep 5 12:09:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:09:42.825677 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8659fd3-e914-4c98-8801-1b037e441c1d None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:09:42.826139 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8659fd3-e914-4c98-8801-1b037e441c1d None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:09:42.826634 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8659fd3-e914-4c98-8801-1b037e441c1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:09:42.970047 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-c8659fd3-e914-4c98-8801-1b037e441c1d None None] MFA Rules not processed for user `cb060ff495bc4abb83ff88992fb7be09`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:09:42.971986 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-c8659fd3-e914-4c98-8801-1b037e441c1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:09:43.061166 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:09:43.139265 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 674/1359] 10.222.0.50 () {58 vars in 1059 bytes} [Mon Sep 5 12:09:42 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:09:43.147555 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3fb096-bb0e-48c9-b82e-dd8a76898e3f None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:09:43.149977 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-ac3fb096-bb0e-48c9-b82e-dd8a76898e3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:09:43.314152 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3fb096-bb0e-48c9-b82e-dd8a76898e3f None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:09:43.408371 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:09:43.465216 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75285d1-82f8-47df-9cd4-21f2e9843ad4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb060ff495bc4abb83ff88992fb7be09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:09:43.466277 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75285d1-82f8-47df-9cd4-21f2e9843ad4 service nova] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:09:43.466790 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75285d1-82f8-47df-9cd4-21f2e9843ad4 service nova] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:09:43.467262 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75285d1-82f8-47df-9cd4-21f2e9843ad4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:09:43.469284 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-c75285d1-82f8-47df-9cd4-21f2e9843ad4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:09:43.573547 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75285d1-82f8-47df-9cd4-21f2e9843ad4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:09:43.575433 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75285d1-82f8-47df-9cd4-21f2e9843ad4 service nova] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:09:43.603832 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 686/1360] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:09:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:09:46.168673 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f81bb1-0571-4e0c-aadc-ced9b6d0dadb None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:09:46.169339 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f81bb1-0571-4e0c-aadc-ced9b6d0dadb None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:09:46.169339 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f81bb1-0571-4e0c-aadc-ced9b6d0dadb None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:09:46.173140 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 675/1361] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:09:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:09:46.177734 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b576a98c-6f1c-4782-8f95-4e1083b9d02e None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:09:46.178352 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b576a98c-6f1c-4782-8f95-4e1083b9d02e None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:09:46.178352 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b576a98c-6f1c-4782-8f95-4e1083b9d02e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:09:46.274913 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-b576a98c-6f1c-4782-8f95-4e1083b9d02e None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:09:46.276300 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-b576a98c-6f1c-4782-8f95-4e1083b9d02e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:09:46.341397 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:09:46.434919 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 687/1362] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:09:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:09:46.777625 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f81bb1-0571-4e0c-aadc-ced9b6d0dadb None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:09:46.779412 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-c0f81bb1-0571-4e0c-aadc-ced9b6d0dadb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:09:47.012956 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f81bb1-0571-4e0c-aadc-ced9b6d0dadb None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:09:47.027745 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:09:47.198585 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5487893c-1c96-402b-aaff-53464a6b6128 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb060ff495bc4abb83ff88992fb7be09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:09:47.200027 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5487893c-1c96-402b-aaff-53464a6b6128 service nova] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:09:47.200027 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5487893c-1c96-402b-aaff-53464a6b6128 service nova] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:09:47.200027 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5487893c-1c96-402b-aaff-53464a6b6128 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:09:47.202402 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-5487893c-1c96-402b-aaff-53464a6b6128 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:09:47.328643 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5487893c-1c96-402b-aaff-53464a6b6128 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:09:47.330530 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5487893c-1c96-402b-aaff-53464a6b6128 service nova] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:09:47.360413 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 676/1363] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:09:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 583 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:09:49.837192 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f66024-2403-4127-9618-b00426a2e5a3 None None] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:09:49.837774 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f66024-2403-4127-9618-b00426a2e5a3 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:09:49.837905 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f66024-2403-4127-9618-b00426a2e5a3 None None] PATH_INFO: `/` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:09:49.839270 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 688/1364] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:09:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:09:49.846738 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad60bf71-e7b5-4fb3-8b5e-81564304e07e None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:09:49.847292 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad60bf71-e7b5-4fb3-8b5e-81564304e07e None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:09:49.847784 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad60bf71-e7b5-4fb3-8b5e-81564304e07e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:09:49.875204 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:09:49.970806 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-ad60bf71-e7b5-4fb3-8b5e-81564304e07e None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:09:49.972845 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-ad60bf71-e7b5-4fb3-8b5e-81564304e07e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:09:50.128138 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 677/1365] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:09:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:09:50.445753 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bd7fa3-7992-4706-a9c8-982724cb801d None None] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:09:50.446042 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bd7fa3-7992-4706-a9c8-982724cb801d None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:09:50.446357 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bd7fa3-7992-4706-a9c8-982724cb801d None None] PATH_INFO: `/` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:09:50.448374 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 689/1366] 10.222.0.50 () {54 vars in 962 bytes} [Mon Sep 5 12:09:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:09:50.454566 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0df8fa5-f209-4de6-b6ef-7a6098e568f7 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:09:50.454813 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0df8fa5-f209-4de6-b6ef-7a6098e568f7 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:09:50.454955 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0df8fa5-f209-4de6-b6ef-7a6098e568f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:09:50.558612 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-f0df8fa5-f209-4de6-b6ef-7a6098e568f7 None None] MFA Rules not processed for user `cb060ff495bc4abb83ff88992fb7be09`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:09:50.560108 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-f0df8fa5-f209-4de6-b6ef-7a6098e568f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:09:50.608445 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:09:50.740360 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 678/1367] 10.222.0.50 () {58 vars in 1059 bytes} [Mon Sep 5 12:09:50 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 12:09:50.751996 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bd7fa3-7992-4706-a9c8-982724cb801d None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:09:50.760196 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-69bd7fa3-7992-4706-a9c8-982724cb801d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:09:50.992072 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bd7fa3-7992-4706-a9c8-982724cb801d None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:09:51.019054 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:09:51.146401 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cd0049-081b-43f2-8ce2-3b24bf7c5b4e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb060ff495bc4abb83ff88992fb7be09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:09:51.147980 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cd0049-081b-43f2-8ce2-3b24bf7c5b4e service nova] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:09:51.148371 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cd0049-081b-43f2-8ce2-3b24bf7c5b4e service nova] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:09:51.148716 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cd0049-081b-43f2-8ce2-3b24bf7c5b4e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:09:51.150836 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-38cd0049-081b-43f2-8ce2-3b24bf7c5b4e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:09:51.312532 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cd0049-081b-43f2-8ce2-3b24bf7c5b4e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:09:51.315324 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cd0049-081b-43f2-8ce2-3b24bf7c5b4e service nova] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:09:51.343136 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 690/1368] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:09:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 592 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:09:52.323854 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25ff696-3a94-4f51-9983-197d7d4242e8 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:09:52.324707 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25ff696-3a94-4f51-9983-197d7d4242e8 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:09:52.324707 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25ff696-3a94-4f51-9983-197d7d4242e8 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:09:52.326116 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 679/1369] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:09:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:09:52.331526 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4409a1ab-d1b1-4468-a4b3-f847ab91f80c None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:09:52.332342 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4409a1ab-d1b1-4468-a4b3-f847ab91f80c None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:09:52.332342 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4409a1ab-d1b1-4468-a4b3-f847ab91f80c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:09:52.371464 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:09:52.413658 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-4409a1ab-d1b1-4468-a4b3-f847ab91f80c None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:09:52.414897 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-4409a1ab-d1b1-4468-a4b3-f847ab91f80c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:09:52.523714 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 691/1370] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:09:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:09:53.181250 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b017c6-2973-4a57-be56-157ba9ced174 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:09:53.181551 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b017c6-2973-4a57-be56-157ba9ced174 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:09:53.181895 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b017c6-2973-4a57-be56-157ba9ced174 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:09:53.183453 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 680/1371] 10.222.0.50 () {54 vars in 964 bytes} [Mon Sep 5 12:09:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:09:53.190049 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e813530-ca93-43e1-b1f0-bb2562fad413 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:09:53.190685 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e813530-ca93-43e1-b1f0-bb2562fad413 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:09:53.191308 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e813530-ca93-43e1-b1f0-bb2562fad413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:09:53.307070 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-5e813530-ca93-43e1-b1f0-bb2562fad413 None None] MFA Rules not processed for user `37633bbae0c2423c81ccd61ac3a17ccf`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:09:53.308472 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-5e813530-ca93-43e1-b1f0-bb2562fad413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:09:53.382758 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:09:53.431423 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 692/1372] 10.222.0.50 () {58 vars in 1061 bytes} [Mon Sep 5 12:09:53 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 12:09:53.439726 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b017c6-2973-4a57-be56-157ba9ced174 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:09:53.442098 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-d8b017c6-2973-4a57-be56-157ba9ced174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:09:53.523684 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbc96c0-d2c4-4b36-a6bc-458ab02ba99d None None] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:09:53.523878 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbc96c0-d2c4-4b36-a6bc-458ab02ba99d None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:09:53.524186 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbc96c0-d2c4-4b36-a6bc-458ab02ba99d None None] PATH_INFO: `/` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:09:53.530083 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 693/1373] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:09:53 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:09:53.531504 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2897cb-e57c-4759-b1f1-3a792d9342db None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:09:53.531824 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2897cb-e57c-4759-b1f1-3a792d9342db None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:09:53.532070 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2897cb-e57c-4759-b1f1-3a792d9342db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:09:53.599321 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b017c6-2973-4a57-be56-157ba9ced174 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:09:53.629684 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-0d2897cb-e57c-4759-b1f1-3a792d9342db None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:09:53.632717 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-0d2897cb-e57c-4759-b1f1-3a792d9342db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:09:53.646187 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:09:53.693637 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28765f78-3176-4cac-b14b-2533e6c843b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37633bbae0c2423c81ccd61ac3a17ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:09:53.694756 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28765f78-3176-4cac-b14b-2533e6c843b5 service cinder] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:09:53.695040 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28765f78-3176-4cac-b14b-2533e6c843b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:09:53.695912 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28765f78-3176-4cac-b14b-2533e6c843b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:09:53.700542 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-28765f78-3176-4cac-b14b-2533e6c843b5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:09:53.842453 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 694/1374] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:09:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:09:53.870135 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28765f78-3176-4cac-b14b-2533e6c843b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:09:53.872828 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28765f78-3176-4cac-b14b-2533e6c843b5 service cinder] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:09:53.912621 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 681/1375] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:09:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:09:54.196237 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2897cb-e57c-4759-b1f1-3a792d9342db None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:09:54.197846 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-0d2897cb-e57c-4759-b1f1-3a792d9342db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:09:54.267993 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:09:54.337618 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2897cb-e57c-4759-b1f1-3a792d9342db None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:09:54.484653 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acda62f-3517-4889-9b07-9125c4d3f56b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb060ff495bc4abb83ff88992fb7be09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:09:54.485406 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acda62f-3517-4889-9b07-9125c4d3f56b service nova] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:09:54.485720 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acda62f-3517-4889-9b07-9125c4d3f56b service nova] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:09:54.485847 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acda62f-3517-4889-9b07-9125c4d3f56b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:09:54.487884 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-2acda62f-3517-4889-9b07-9125c4d3f56b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:09:54.544006 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:09:54.607154 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acda62f-3517-4889-9b07-9125c4d3f56b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:09:54.609064 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acda62f-3517-4889-9b07-9125c4d3f56b service nova] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:09:54.632567 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 695/1376] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:09:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:09:56.696254 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa0b5b3-7eae-46d0-b899-435a37ebee09 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:09:56.696804 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa0b5b3-7eae-46d0-b899-435a37ebee09 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:09:56.696804 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa0b5b3-7eae-46d0-b899-435a37ebee09 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:09:56.698547 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 682/1377] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:09:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:09:56.704314 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7191c10-8ccf-4401-873d-1b7a47b59b74 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:09:56.704839 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7191c10-8ccf-4401-873d-1b7a47b59b74 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:09:56.704965 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7191c10-8ccf-4401-873d-1b7a47b59b74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:09:56.786198 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-d7191c10-8ccf-4401-873d-1b7a47b59b74 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:09:56.787681 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-d7191c10-8ccf-4401-873d-1b7a47b59b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:09:56.889139 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 696/1378] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:09:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:09:57.197150 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa0b5b3-7eae-46d0-b899-435a37ebee09 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:09:57.198672 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-1aa0b5b3-7eae-46d0-b899-435a37ebee09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:09:57.290384 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:09:57.369218 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa0b5b3-7eae-46d0-b899-435a37ebee09 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:09:57.483456 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa46532-2184-45ba-ba59-169fdcd5df45 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb060ff495bc4abb83ff88992fb7be09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:09:57.483975 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa46532-2184-45ba-ba59-169fdcd5df45 service nova] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:09:57.484255 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa46532-2184-45ba-ba59-169fdcd5df45 service nova] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:09:57.484525 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa46532-2184-45ba-ba59-169fdcd5df45 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:09:57.486319 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-8aa46532-2184-45ba-ba59-169fdcd5df45 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:09:57.521959 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:09:57.598937 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa46532-2184-45ba-ba59-169fdcd5df45 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:09:57.600548 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa46532-2184-45ba-ba59-169fdcd5df45 service nova] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:09:57.627741 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 683/1379] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:09:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:09:59.653778 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a4db1f-cb0e-462b-9782-26209da97f6e None None] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:09:59.654808 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a4db1f-cb0e-462b-9782-26209da97f6e None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:09:59.655088 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a4db1f-cb0e-462b-9782-26209da97f6e None None] PATH_INFO: `/` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:09:59.656937 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 697/1380] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:09:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:09:59.663420 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682df402-3dac-4444-9e90-d59efd300cc8 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:09:59.663949 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682df402-3dac-4444-9e90-d59efd300cc8 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:09:59.663949 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682df402-3dac-4444-9e90-d59efd300cc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:09:59.748084 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-682df402-3dac-4444-9e90-d59efd300cc8 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:09:59.749412 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-682df402-3dac-4444-9e90-d59efd300cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:09:59.878244 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 684/1381] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:09:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:10:00.182925 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a4db1f-cb0e-462b-9782-26209da97f6e None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:10:00.184650 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-44a4db1f-cb0e-462b-9782-26209da97f6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:10:00.211965 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:10:00.348309 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a4db1f-cb0e-462b-9782-26209da97f6e None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:10:00.452402 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:10:00.474085 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915acf40-ca31-41a6-9eac-2bb914f0650e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb060ff495bc4abb83ff88992fb7be09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:10:00.474852 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915acf40-ca31-41a6-9eac-2bb914f0650e service nova] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:00.475229 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915acf40-ca31-41a6-9eac-2bb914f0650e service nova] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:00.475602 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915acf40-ca31-41a6-9eac-2bb914f0650e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:00.477359 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-915acf40-ca31-41a6-9eac-2bb914f0650e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:10:00.586805 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915acf40-ca31-41a6-9eac-2bb914f0650e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:10:00.588601 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915acf40-ca31-41a6-9eac-2bb914f0650e service nova] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:10:00.608490 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 698/1382] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:10:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:10:02.650389 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dbffff-cd84-4ca1-a810-14cae3a766ca None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:02.651057 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dbffff-cd84-4ca1-a810-14cae3a766ca None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:02.651057 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dbffff-cd84-4ca1-a810-14cae3a766ca None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:02.652379 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 685/1383] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:10:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:10:02.658348 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea07887-a748-4316-82f6-706c3857d8e5 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:02.658851 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea07887-a748-4316-82f6-706c3857d8e5 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:02.659063 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea07887-a748-4316-82f6-706c3857d8e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:02.735979 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-2ea07887-a748-4316-82f6-706c3857d8e5 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:10:02.737296 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-2ea07887-a748-4316-82f6-706c3857d8e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:10:02.803359 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:10:02.849643 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 699/1384] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:10:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:10:03.235123 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dbffff-cd84-4ca1-a810-14cae3a766ca None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:10:03.236828 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-34dbffff-cd84-4ca1-a810-14cae3a766ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:10:03.247604 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:10:03.395629 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dbffff-cd84-4ca1-a810-14cae3a766ca None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:10:03.505377 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:10:03.540806 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133fe044-dcf6-49ba-b732-3f9e407de25c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb060ff495bc4abb83ff88992fb7be09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:10:03.541446 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133fe044-dcf6-49ba-b732-3f9e407de25c service nova] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:03.541777 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133fe044-dcf6-49ba-b732-3f9e407de25c service nova] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:03.542063 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133fe044-dcf6-49ba-b732-3f9e407de25c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:03.543629 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-133fe044-dcf6-49ba-b732-3f9e407de25c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:10:03.664528 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133fe044-dcf6-49ba-b732-3f9e407de25c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:10:03.668482 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133fe044-dcf6-49ba-b732-3f9e407de25c service nova] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:10:03.710596 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 686/1385] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:10:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:10:05.744298 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca133ac6-5814-45b2-aaf6-f7b24417b48f None None] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:05.744880 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca133ac6-5814-45b2-aaf6-f7b24417b48f None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:05.745307 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca133ac6-5814-45b2-aaf6-f7b24417b48f None None] PATH_INFO: `/` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:05.747152 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 700/1386] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:10:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:10:05.752765 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff918607-3361-437e-984f-2b5d463c4e3d None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:05.753264 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff918607-3361-437e-984f-2b5d463c4e3d None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:05.753383 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff918607-3361-437e-984f-2b5d463c4e3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:05.826418 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-ff918607-3361-437e-984f-2b5d463c4e3d None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:10:05.827683 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-ff918607-3361-437e-984f-2b5d463c4e3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:10:05.884665 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:10:05.957258 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 687/1387] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:10:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:10:06.246548 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca133ac6-5814-45b2-aaf6-f7b24417b48f None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:10:06.248503 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-ca133ac6-5814-45b2-aaf6-f7b24417b48f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:10:06.455847 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca133ac6-5814-45b2-aaf6-f7b24417b48f None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:10:06.503133 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:10:06.584357 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a7256f-53bd-417b-b832-d4eb13190730 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb060ff495bc4abb83ff88992fb7be09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:10:06.585042 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a7256f-53bd-417b-b832-d4eb13190730 service nova] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:06.585685 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a7256f-53bd-417b-b832-d4eb13190730 service nova] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:06.585685 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a7256f-53bd-417b-b832-d4eb13190730 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:06.587270 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-56a7256f-53bd-417b-b832-d4eb13190730 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:10:06.703038 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a7256f-53bd-417b-b832-d4eb13190730 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:10:06.704674 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a7256f-53bd-417b-b832-d4eb13190730 service nova] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:10:06.726309 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 701/1388] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:10:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:10:08.785852 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0b370f-65f6-4d39-8072-844e99df324c None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:08.786414 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0b370f-65f6-4d39-8072-844e99df324c None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:08.786414 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0b370f-65f6-4d39-8072-844e99df324c None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:08.787762 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 688/1389] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:10:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:10:08.793317 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82259e80-1e55-42fc-90da-1cd4bf48a3ea None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:08.793764 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82259e80-1e55-42fc-90da-1cd4bf48a3ea None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:08.793878 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82259e80-1e55-42fc-90da-1cd4bf48a3ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:08.854396 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:10:08.862347 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-82259e80-1e55-42fc-90da-1cd4bf48a3ea None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:10:08.863611 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-82259e80-1e55-42fc-90da-1cd4bf48a3ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:10:08.980149 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 702/1390] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:10:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:10:09.245085 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f7a96c-a81a-41bc-9a6b-2bb9101e7453 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:09.245375 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f7a96c-a81a-41bc-9a6b-2bb9101e7453 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:09.245624 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f7a96c-a81a-41bc-9a6b-2bb9101e7453 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:09.246975 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 689/1391] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:10:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:10:09.252040 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6f2455-fe96-42c8-a365-d69cdb4269ca None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:09.252325 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6f2455-fe96-42c8-a365-d69cdb4269ca None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:09.252599 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6f2455-fe96-42c8-a365-d69cdb4269ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:09.278746 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f7a96c-a81a-41bc-9a6b-2bb9101e7453 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:10:09.280531 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-63f7a96c-a81a-41bc-9a6b-2bb9101e7453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:10:09.327465 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-aa6f2455-fe96-42c8-a365-d69cdb4269ca None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:10:09.328692 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-aa6f2455-fe96-42c8-a365-d69cdb4269ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:10:09.411328 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:10:09.446551 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f7a96c-a81a-41bc-9a6b-2bb9101e7453 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:10:09.446856 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 703/1392] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:10:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:10:09.482456 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:10:09.584534 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecac26d6-fae4-45a8-b8b6-c8c7b86c15a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb060ff495bc4abb83ff88992fb7be09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:10:09.585346 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecac26d6-fae4-45a8-b8b6-c8c7b86c15a2 service nova] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:09.585739 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecac26d6-fae4-45a8-b8b6-c8c7b86c15a2 service nova] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:09.586102 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecac26d6-fae4-45a8-b8b6-c8c7b86c15a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:09.587829 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-ecac26d6-fae4-45a8-b8b6-c8c7b86c15a2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:10:09.688873 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecac26d6-fae4-45a8-b8b6-c8c7b86c15a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:10:09.690546 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecac26d6-fae4-45a8-b8b6-c8c7b86c15a2 service nova] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:10:09.713081 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 690/1393] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:10:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 12:10:09.764884 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33060cfc-8d44-4658-b083-347d007fbdee None None] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:09.765192 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33060cfc-8d44-4658-b083-347d007fbdee None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:09.765471 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33060cfc-8d44-4658-b083-347d007fbdee None None] PATH_INFO: `/` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:09.766845 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 704/1394] 10.222.0.50 () {54 vars in 961 bytes} [Mon Sep 5 12:10:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 12:10:09.772937 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b518d477-0108-4887-aad6-5b455a573d72 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:09.773224 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b518d477-0108-4887-aad6-5b455a573d72 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:09.773498 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b518d477-0108-4887-aad6-5b455a573d72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:09.828508 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:10:09.880824 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-b518d477-0108-4887-aad6-5b455a573d72 None None] MFA Rules not processed for user `b2b08e831af84a658b0f5b28ad03e4f7`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:10:09.882115 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-b518d477-0108-4887-aad6-5b455a573d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:10:09.977457 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 691/1395] 10.222.0.50 () {58 vars in 1058 bytes} [Mon Sep 5 12:10:09 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:10:09.985517 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33060cfc-8d44-4658-b083-347d007fbdee None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:10:09.987217 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-33060cfc-8d44-4658-b083-347d007fbdee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:10:10.107522 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33060cfc-8d44-4658-b083-347d007fbdee None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:10:10.188366 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a452f2fa-d4e2-4f61-8452-c53a8d558d4d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b08e831af84a658b0f5b28ad03e4f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:10:10.189297 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a452f2fa-d4e2-4f61-8452-c53a8d558d4d service glance] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:10.189946 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a452f2fa-d4e2-4f61-8452-c53a8d558d4d service glance] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:10.190407 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a452f2fa-d4e2-4f61-8452-c53a8d558d4d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:10.193246 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-a452f2fa-d4e2-4f61-8452-c53a8d558d4d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:10:10.241579 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:10:10.325293 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a452f2fa-d4e2-4f61-8452-c53a8d558d4d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:10:10.326737 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a452f2fa-d4e2-4f61-8452-c53a8d558d4d service glance] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:10:10.345976 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 705/1396] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:10:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:10:11.137126 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0545fa63-0e72-4354-9406-2839d2d82a05 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:11.138104 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0545fa63-0e72-4354-9406-2839d2d82a05 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:11.138382 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0545fa63-0e72-4354-9406-2839d2d82a05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:11.214886 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-0545fa63-0e72-4354-9406-2839d2d82a05 None None] MFA Rules not processed for user `bacc8ece8df24bf498c1d55ca2918224`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:10:11.216113 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-0545fa63-0e72-4354-9406-2839d2d82a05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:10:11.308140 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:10:11.317780 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 692/1397] 10.222.0.50 () {58 vars in 1009 bytes} [Mon Sep 5 12:10:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:10:11.370994 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4606feae-ea9b-408d-bb6a-0f789b7a0a53 None None] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:11.371552 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4606feae-ea9b-408d-bb6a-0f789b7a0a53 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:11.371552 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4606feae-ea9b-408d-bb6a-0f789b7a0a53 None None] PATH_INFO: `/` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:11.372936 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 706/1398] 10.222.0.50 () {54 vars in 943 bytes} [Mon Sep 5 12:10:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:10:11.380297 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1775df2-75c4-4183-b1ac-7622e24890c8 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:11.380688 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1775df2-75c4-4183-b1ac-7622e24890c8 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:11.381069 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1775df2-75c4-4183-b1ac-7622e24890c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:11.467969 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-e1775df2-75c4-4183-b1ac-7622e24890c8 None None] MFA Rules not processed for user `ea2b32d58d964585a24e7c5784a8355f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:10:11.469236 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-e1775df2-75c4-4183-b1ac-7622e24890c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:10:11.589892 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 693/1399] 10.222.0.50 () {58 vars in 1040 bytes} [Mon Sep 5 12:10:11 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 12:10:11.600568 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4606feae-ea9b-408d-bb6a-0f789b7a0a53 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:10:11.602158 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-4606feae-ea9b-408d-bb6a-0f789b7a0a53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:10:11.678331 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8fc8ce-0a0d-4efb-89bf-0cc10084aa13 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:11.678544 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8fc8ce-0a0d-4efb-89bf-0cc10084aa13 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:11.678715 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8fc8ce-0a0d-4efb-89bf-0cc10084aa13 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:11.680365 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 694/1400] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:10:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:10:11.685575 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f40570-dc40-49b2-9f70-97b3d928bdcb None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:11.685852 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f40570-dc40-49b2-9f70-97b3d928bdcb None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:11.686120 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f40570-dc40-49b2-9f70-97b3d928bdcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:11.759085 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:10:11.763161 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-e7f40570-dc40-49b2-9f70-97b3d928bdcb None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:10:11.765146 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-e7f40570-dc40-49b2-9f70-97b3d928bdcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:10:11.772543 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4606feae-ea9b-408d-bb6a-0f789b7a0a53 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:10:11.775451 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:10:11.876907 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 695/1401] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:10:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 12:10:11.913715 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ac5fc7-fb43-45e8-b98a-c6cd5a669639 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2b32d58d964585a24e7c5784a8355f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:10:11.914333 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ac5fc7-fb43-45e8-b98a-c6cd5a669639 service swift] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:11.914613 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ac5fc7-fb43-45e8-b98a-c6cd5a669639 service swift] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:11.914905 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ac5fc7-fb43-45e8-b98a-c6cd5a669639 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:11.916569 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-d2ac5fc7-fb43-45e8-b98a-c6cd5a669639 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:10:12.005581 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ac5fc7-fb43-45e8-b98a-c6cd5a669639 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:10:12.007447 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ac5fc7-fb43-45e8-b98a-c6cd5a669639 service swift] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:10:12.017198 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 707/1402] 10.222.0.50 () {60 vars in 1384 bytes} [Mon Sep 5 12:10:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 05 12:10:12.174594 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f40570-dc40-49b2-9f70-97b3d928bdcb None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:10:12.175856 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-e7f40570-dc40-49b2-9f70-97b3d928bdcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:10:12.355746 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f40570-dc40-49b2-9f70-97b3d928bdcb None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:10:12.389084 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:10:12.541806 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a41dbb-2ce0-4057-87dc-e98f99229547 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb060ff495bc4abb83ff88992fb7be09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:10:12.542533 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a41dbb-2ce0-4057-87dc-e98f99229547 service nova] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:12.542875 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a41dbb-2ce0-4057-87dc-e98f99229547 service nova] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:12.543225 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a41dbb-2ce0-4057-87dc-e98f99229547 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:12.544939 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-69a41dbb-2ce0-4057-87dc-e98f99229547 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:10:12.652533 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a41dbb-2ce0-4057-87dc-e98f99229547 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:10:12.654125 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a41dbb-2ce0-4057-87dc-e98f99229547 service nova] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:10:12.674445 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 696/1403] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:10:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:10:14.671405 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d037525f-2c48-49c8-85c3-628dc602e6a2 None None] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:14.672050 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d037525f-2c48-49c8-85c3-628dc602e6a2 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:14.672050 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d037525f-2c48-49c8-85c3-628dc602e6a2 None None] PATH_INFO: `/` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:14.673352 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 708/1404] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:10:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:10:14.679092 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834652e2-6430-43b1-a302-e7079ba25e98 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:14.679540 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834652e2-6430-43b1-a302-e7079ba25e98 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:14.679647 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834652e2-6430-43b1-a302-e7079ba25e98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:14.709546 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:10:14.756066 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-834652e2-6430-43b1-a302-e7079ba25e98 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:10:14.758062 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-834652e2-6430-43b1-a302-e7079ba25e98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:10:14.869459 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 697/1405] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:10:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:10:15.162742 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d037525f-2c48-49c8-85c3-628dc602e6a2 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:10:15.164424 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-d037525f-2c48-49c8-85c3-628dc602e6a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:10:15.207992 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:10:15.333378 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d037525f-2c48-49c8-85c3-628dc602e6a2 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:10:15.453520 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:10:15.459544 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dd5a77-d555-4348-b95a-820b4c6e548e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb060ff495bc4abb83ff88992fb7be09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:10:15.460250 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd5a77-d555-4348-b95a-820b4c6e548e service nova] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:15.460534 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd5a77-d555-4348-b95a-820b4c6e548e service nova] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:15.460804 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd5a77-d555-4348-b95a-820b4c6e548e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:15.462465 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-f1dd5a77-d555-4348-b95a-820b4c6e548e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:10:15.577603 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dd5a77-d555-4348-b95a-820b4c6e548e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:10:15.579330 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dd5a77-d555-4348-b95a-820b4c6e548e service nova] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:10:15.600003 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 709/1406] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:10:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:10:17.561124 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d6a395-82a5-40ca-b14c-21a822377db1 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:17.561703 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d6a395-82a5-40ca-b14c-21a822377db1 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:17.561703 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d6a395-82a5-40ca-b14c-21a822377db1 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:17.563024 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 698/1407] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:10:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:10:17.568436 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f2c7f2-e732-4b5d-8677-37b372075200 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:17.568939 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f2c7f2-e732-4b5d-8677-37b372075200 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:17.569048 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f2c7f2-e732-4b5d-8677-37b372075200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:17.654733 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-f4f2c7f2-e732-4b5d-8677-37b372075200 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:10:17.655996 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-f4f2c7f2-e732-4b5d-8677-37b372075200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:10:17.734205 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:10:17.778618 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 710/1408] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:10:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:10:18.074085 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d6a395-82a5-40ca-b14c-21a822377db1 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:10:18.075614 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-e1d6a395-82a5-40ca-b14c-21a822377db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:10:18.210402 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:10:18.275034 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d6a395-82a5-40ca-b14c-21a822377db1 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:10:18.433566 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1351b133-e4b9-4fa2-9a29-93bf6e9100ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb060ff495bc4abb83ff88992fb7be09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:10:18.434189 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1351b133-e4b9-4fa2-9a29-93bf6e9100ee service nova] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:18.434502 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1351b133-e4b9-4fa2-9a29-93bf6e9100ee service nova] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:18.434736 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1351b133-e4b9-4fa2-9a29-93bf6e9100ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:18.436544 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-1351b133-e4b9-4fa2-9a29-93bf6e9100ee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:10:18.518627 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:10:18.553031 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1351b133-e4b9-4fa2-9a29-93bf6e9100ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:10:18.554962 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1351b133-e4b9-4fa2-9a29-93bf6e9100ee service nova] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:10:18.577675 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 699/1409] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:10:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:10:27.776469 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=12 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:10:28.575303 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=17 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:10:34.214223 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead5068e-ee5e-4014-b743-03e04ad1453f None None] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:34.214803 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead5068e-ee5e-4014-b743-03e04ad1453f None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:34.214803 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead5068e-ee5e-4014-b743-03e04ad1453f None None] PATH_INFO: `/` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:34.216107 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 711/1410] 10.222.0.50 () {54 vars in 918 bytes} [Mon Sep 5 12:10:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 12:10:34.221163 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e58e9b-f4ac-4191-86b1-33c91dd51f43 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:34.221658 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e58e9b-f4ac-4191-86b1-33c91dd51f43 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:34.221765 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e58e9b-f4ac-4191-86b1-33c91dd51f43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:34.300993 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-82e58e9b-f4ac-4191-86b1-33c91dd51f43 None None] MFA Rules not processed for user `c5427d0752de4817b6aa25e28c2d9a30`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:10:34.302196 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-82e58e9b-f4ac-4191-86b1-33c91dd51f43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:10:34.414078 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 700/1411] 10.222.0.50 () {58 vars in 1015 bytes} [Mon Sep 5 12:10:34 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:10:34.429612 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5140a3f5-e775-40f0-b73a-956836f75eba None None] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:34.429906 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5140a3f5-e775-40f0-b73a-956836f75eba None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:34.430147 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5140a3f5-e775-40f0-b73a-956836f75eba None None] PATH_INFO: `/` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:34.431526 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 712/1412] 10.222.0.50 () {54 vars in 918 bytes} [Mon Sep 5 12:10:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 12:10:34.436997 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f0b451-6261-417b-8e0f-fe80d53b4daf None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:34.437341 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f0b451-6261-417b-8e0f-fe80d53b4daf None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:34.437653 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f0b451-6261-417b-8e0f-fe80d53b4daf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:34.511800 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:10:34.514578 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-e7f0b451-6261-417b-8e0f-fe80d53b4daf None None] MFA Rules not processed for user `cb060ff495bc4abb83ff88992fb7be09`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:10:34.516366 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-e7f0b451-6261-417b-8e0f-fe80d53b4daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:10:34.631564 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 701/1413] 10.222.0.50 () {58 vars in 1015 bytes} [Mon Sep 5 12:10:34 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:10:37.003934 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d08e36-727f-49fe-96d0-d4bf8c931f36 None None] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:37.004464 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d08e36-727f-49fe-96d0-d4bf8c931f36 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:37.004464 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d08e36-727f-49fe-96d0-d4bf8c931f36 None None] PATH_INFO: `/` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:37.005761 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 713/1414] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 5 12:10:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:10:37.011181 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4cd015-41c9-4048-a543-52fc565f645a None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:37.011812 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4cd015-41c9-4048-a543-52fc565f645a None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:37.011812 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4cd015-41c9-4048-a543-52fc565f645a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:37.079817 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-4e4cd015-41c9-4048-a543-52fc565f645a None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:10:37.081627 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-4e4cd015-41c9-4048-a543-52fc565f645a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:10:37.136855 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:10:37.179688 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 702/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 5 12:10:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:10:37.468915 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d08e36-727f-49fe-96d0-d4bf8c931f36 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:10:37.470625 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-12d08e36-727f-49fe-96d0-d4bf8c931f36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:10:37.623316 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d08e36-727f-49fe-96d0-d4bf8c931f36 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:10:37.698050 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:10:37.745480 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5a51ff-eecc-4deb-b750-75371758daad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb060ff495bc4abb83ff88992fb7be09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:10:37.746093 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5a51ff-eecc-4deb-b750-75371758daad service nova] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:37.746375 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5a51ff-eecc-4deb-b750-75371758daad service nova] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:37.746647 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5a51ff-eecc-4deb-b750-75371758daad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:37.748280 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-ba5a51ff-eecc-4deb-b750-75371758daad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:10:37.844387 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5a51ff-eecc-4deb-b750-75371758daad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:10:37.846687 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5a51ff-eecc-4deb-b750-75371758daad service nova] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:10:37.865877 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 714/1416] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:10:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:10:38.763718 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fcffbb-909e-4385-9f47-712cdc9de5fb None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:38.764278 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fcffbb-909e-4385-9f47-712cdc9de5fb None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:38.764278 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fcffbb-909e-4385-9f47-712cdc9de5fb None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:38.765706 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 703/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 5 12:10:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:10:38.771378 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a353623c-f80a-4228-8a4e-a3bfa6713a82 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:38.772090 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a353623c-f80a-4228-8a4e-a3bfa6713a82 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:38.772195 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a353623c-f80a-4228-8a4e-a3bfa6713a82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:38.847054 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-a353623c-f80a-4228-8a4e-a3bfa6713a82 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:10:38.848245 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-a353623c-f80a-4228-8a4e-a3bfa6713a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:10:38.875912 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:10:38.951233 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 715/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 5 12:10:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:10:39.101178 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fcffbb-909e-4385-9f47-712cdc9de5fb None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:10:39.102707 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-59fcffbb-909e-4385-9f47-712cdc9de5fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:10:39.265550 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fcffbb-909e-4385-9f47-712cdc9de5fb None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:10:39.308335 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:10:39.388927 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1882fc-4bc9-4795-bf5a-53baa092943c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb060ff495bc4abb83ff88992fb7be09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:10:39.389457 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1882fc-4bc9-4795-bf5a-53baa092943c service nova] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:39.389733 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1882fc-4bc9-4795-bf5a-53baa092943c service nova] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:39.390011 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1882fc-4bc9-4795-bf5a-53baa092943c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:39.391652 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-4f1882fc-4bc9-4795-bf5a-53baa092943c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:10:39.491378 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1882fc-4bc9-4795-bf5a-53baa092943c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:10:39.493033 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1882fc-4bc9-4795-bf5a-53baa092943c service nova] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:10:39.512219 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 704/1419] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:10:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:10:40.415308 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff3ec0f-1723-4e91-8531-8fa6fbdc707e None None] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:40.415888 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff3ec0f-1723-4e91-8531-8fa6fbdc707e None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:40.415888 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff3ec0f-1723-4e91-8531-8fa6fbdc707e None None] PATH_INFO: `/` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:40.417269 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 716/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 5 12:10:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:10:40.422369 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3d8782-cbdd-4666-8b6f-866377a6e5e8 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:40.422830 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3d8782-cbdd-4666-8b6f-866377a6e5e8 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:40.422937 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3d8782-cbdd-4666-8b6f-866377a6e5e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:40.479878 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:10:40.505310 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-dc3d8782-cbdd-4666-8b6f-866377a6e5e8 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:10:40.506577 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-dc3d8782-cbdd-4666-8b6f-866377a6e5e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:10:40.609515 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 705/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 5 12:10:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 12:10:40.763418 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff3ec0f-1723-4e91-8531-8fa6fbdc707e None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:10:40.765195 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-8ff3ec0f-1723-4e91-8531-8fa6fbdc707e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:10:40.922284 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff3ec0f-1723-4e91-8531-8fa6fbdc707e None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:10:40.937274 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:10:41.056644 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb309e1-2456-4cf9-b4e1-eb35445c91bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb060ff495bc4abb83ff88992fb7be09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:10:41.057203 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb309e1-2456-4cf9-b4e1-eb35445c91bb service nova] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:41.057484 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb309e1-2456-4cf9-b4e1-eb35445c91bb service nova] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:41.057756 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb309e1-2456-4cf9-b4e1-eb35445c91bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:41.059405 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-dfb309e1-2456-4cf9-b4e1-eb35445c91bb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:10:41.156719 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb309e1-2456-4cf9-b4e1-eb35445c91bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:10:41.158378 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb309e1-2456-4cf9-b4e1-eb35445c91bb service nova] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:10:41.179620 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 717/1422] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:10:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:10:42.071390 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47587cb-647d-4394-a54d-06da183fac87 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:42.072180 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47587cb-647d-4394-a54d-06da183fac87 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:42.072180 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47587cb-647d-4394-a54d-06da183fac87 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:42.073832 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 706/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 5 12:10:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 12:10:42.079538 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7867ef9-3a35-4e9d-b82e-bf77d42c5dbf None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:42.080072 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7867ef9-3a35-4e9d-b82e-bf77d42c5dbf None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:42.080181 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7867ef9-3a35-4e9d-b82e-bf77d42c5dbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:42.105086 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:10:42.173716 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-c7867ef9-3a35-4e9d-b82e-bf77d42c5dbf None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:10:42.174950 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-c7867ef9-3a35-4e9d-b82e-bf77d42c5dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:10:42.297505 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 718/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 5 12:10:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:10:42.462462 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47587cb-647d-4394-a54d-06da183fac87 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:10:42.463992 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-e47587cb-647d-4394-a54d-06da183fac87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:10:42.593388 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:10:42.639402 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47587cb-647d-4394-a54d-06da183fac87 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:10:42.794009 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a78634-02ad-41f1-91e8-3884193bad3e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb060ff495bc4abb83ff88992fb7be09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:10:42.794667 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a78634-02ad-41f1-91e8-3884193bad3e service nova] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:42.794982 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a78634-02ad-41f1-91e8-3884193bad3e service nova] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:42.795289 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a78634-02ad-41f1-91e8-3884193bad3e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:42.797139 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-94a78634-02ad-41f1-91e8-3884193bad3e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:10:42.883865 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:10:42.900127 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a78634-02ad-41f1-91e8-3884193bad3e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:10:42.901693 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a78634-02ad-41f1-91e8-3884193bad3e service nova] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:10:42.921847 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 707/1425] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:10:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 12:10:43.824756 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78747580-1409-4d6f-aa66-c8d0b951e246 None None] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:43.825649 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78747580-1409-4d6f-aa66-c8d0b951e246 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:43.825812 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78747580-1409-4d6f-aa66-c8d0b951e246 None None] PATH_INFO: `/` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:43.827392 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 719/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 5 12:10:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 12:10:43.833360 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ecae5f-facc-4ad7-a8ba-bc95cd8fbb5b None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:43.833971 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ecae5f-facc-4ad7-a8ba-bc95cd8fbb5b None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:43.834107 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ecae5f-facc-4ad7-a8ba-bc95cd8fbb5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:43.926507 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-32ecae5f-facc-4ad7-a8ba-bc95cd8fbb5b None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:10:43.927902 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-32ecae5f-facc-4ad7-a8ba-bc95cd8fbb5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:10:44.092948 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 708/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 5 12:10:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:10:44.318215 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78747580-1409-4d6f-aa66-c8d0b951e246 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:10:44.320883 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-78747580-1409-4d6f-aa66-c8d0b951e246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:10:44.459228 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:10:44.562325 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78747580-1409-4d6f-aa66-c8d0b951e246 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:10:44.694815 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b771474-0065-4ee9-bef9-5aa8b8a7f562 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb060ff495bc4abb83ff88992fb7be09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:10:44.695425 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b771474-0065-4ee9-bef9-5aa8b8a7f562 service nova] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:44.695707 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b771474-0065-4ee9-bef9-5aa8b8a7f562 service nova] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:44.695980 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b771474-0065-4ee9-bef9-5aa8b8a7f562 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:44.697655 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-3b771474-0065-4ee9-bef9-5aa8b8a7f562 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:10:44.747932 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:10:44.799897 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b771474-0065-4ee9-bef9-5aa8b8a7f562 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:10:44.801554 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b771474-0065-4ee9-bef9-5aa8b8a7f562 service nova] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:10:44.820739 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 720/1428] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:10:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:10:45.641426 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5039e96d-1590-4753-839d-c292261c7b0e None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:45.642293 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5039e96d-1590-4753-839d-c292261c7b0e None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:45.642293 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5039e96d-1590-4753-839d-c292261c7b0e None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:45.644362 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 709/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 5 12:10:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 05 12:10:45.650416 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6aad7f-38a2-43c1-8d60-a9c889aa8b74 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:45.651004 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6aad7f-38a2-43c1-8d60-a9c889aa8b74 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:45.651134 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6aad7f-38a2-43c1-8d60-a9c889aa8b74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:45.746032 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-ec6aad7f-38a2-43c1-8d60-a9c889aa8b74 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:10:45.747285 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-ec6aad7f-38a2-43c1-8d60-a9c889aa8b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:10:45.883234 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 721/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 5 12:10:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:10:46.035739 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5039e96d-1590-4753-839d-c292261c7b0e None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:10:46.037855 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-5039e96d-1590-4753-839d-c292261c7b0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:10:46.093728 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:10:46.210785 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5039e96d-1590-4753-839d-c292261c7b0e None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:10:46.349400 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e33247-3455-431e-bdce-a39544786301 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb060ff495bc4abb83ff88992fb7be09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:10:46.349945 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e33247-3455-431e-bdce-a39544786301 service nova] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:46.350244 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e33247-3455-431e-bdce-a39544786301 service nova] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:46.350510 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e33247-3455-431e-bdce-a39544786301 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:46.352297 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-30e33247-3455-431e-bdce-a39544786301 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:10:46.360688 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:10:46.456805 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e33247-3455-431e-bdce-a39544786301 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:10:46.458463 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e33247-3455-431e-bdce-a39544786301 service nova] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:10:46.477581 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 710/1431] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:10:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 12:10:47.313288 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07af3b8e-54b3-4865-af1b-3d18bf968c84 None None] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:47.313886 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07af3b8e-54b3-4865-af1b-3d18bf968c84 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:47.313886 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07af3b8e-54b3-4865-af1b-3d18bf968c84 None None] PATH_INFO: `/` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:47.315433 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 722/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 5 12:10:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:10:47.321635 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09de81df-c27f-44a2-8dac-caac5eb52d44 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:47.322523 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09de81df-c27f-44a2-8dac-caac5eb52d44 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:47.322523 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09de81df-c27f-44a2-8dac-caac5eb52d44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:47.416651 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-09de81df-c27f-44a2-8dac-caac5eb52d44 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:10:47.417924 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-09de81df-c27f-44a2-8dac-caac5eb52d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:10:47.494717 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:10:47.527090 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 711/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 5 12:10:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:10:47.679075 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07af3b8e-54b3-4865-af1b-3d18bf968c84 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:10:47.680829 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-07af3b8e-54b3-4865-af1b-3d18bf968c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:10:47.699469 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:10:47.858483 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07af3b8e-54b3-4865-af1b-3d18bf968c84 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:10:47.978640 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:10:48.004590 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8469d15e-6ec0-4a39-b96c-d64333cf5eaf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb060ff495bc4abb83ff88992fb7be09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:10:48.005225 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8469d15e-6ec0-4a39-b96c-d64333cf5eaf service nova] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:48.005529 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8469d15e-6ec0-4a39-b96c-d64333cf5eaf service nova] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:48.005770 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8469d15e-6ec0-4a39-b96c-d64333cf5eaf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:48.007365 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-8469d15e-6ec0-4a39-b96c-d64333cf5eaf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:10:48.099672 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8469d15e-6ec0-4a39-b96c-d64333cf5eaf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:10:48.101317 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8469d15e-6ec0-4a39-b96c-d64333cf5eaf service nova] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:10:48.119194 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 723/1434] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:10:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:10:48.965021 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c9efa9-efb2-4c0b-9c42-fa1aa2390680 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:48.965654 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c9efa9-efb2-4c0b-9c42-fa1aa2390680 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:48.965654 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c9efa9-efb2-4c0b-9c42-fa1aa2390680 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:48.966994 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 712/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 5 12:10:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:10:48.973112 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b62f83-bf8d-4a70-9336-0559052786cb None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:48.973627 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b62f83-bf8d-4a70-9336-0559052786cb None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:48.973627 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b62f83-bf8d-4a70-9336-0559052786cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:49.052737 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-c3b62f83-bf8d-4a70-9336-0559052786cb None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:10:49.053908 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-c3b62f83-bf8d-4a70-9336-0559052786cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:10:49.098080 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:10:49.163006 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 724/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 5 12:10:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:10:49.319804 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c9efa9-efb2-4c0b-9c42-fa1aa2390680 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:10:49.321315 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-84c9efa9-efb2-4c0b-9c42-fa1aa2390680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:10:49.491100 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c9efa9-efb2-4c0b-9c42-fa1aa2390680 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:10:49.549008 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:10:49.614955 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebaf7ce-d7bd-4a45-b764-7781901f3efc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb060ff495bc4abb83ff88992fb7be09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:10:49.615582 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebaf7ce-d7bd-4a45-b764-7781901f3efc service nova] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:49.615855 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebaf7ce-d7bd-4a45-b764-7781901f3efc service nova] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:49.616123 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebaf7ce-d7bd-4a45-b764-7781901f3efc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:49.617952 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-1ebaf7ce-d7bd-4a45-b764-7781901f3efc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:10:49.720983 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebaf7ce-d7bd-4a45-b764-7781901f3efc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:10:49.722606 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebaf7ce-d7bd-4a45-b764-7781901f3efc service nova] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:10:49.741026 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 713/1437] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:10:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:10:50.549942 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b411e0-6941-4ad7-a8c5-6a67fb4f8a11 None None] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:50.550496 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b411e0-6941-4ad7-a8c5-6a67fb4f8a11 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:50.550496 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b411e0-6941-4ad7-a8c5-6a67fb4f8a11 None None] PATH_INFO: `/` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:50.551820 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 725/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 5 12:10:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:10:50.556941 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e15b5e-2ff8-4ec7-bbe8-5167bad54306 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:50.557401 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e15b5e-2ff8-4ec7-bbe8-5167bad54306 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:50.557506 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e15b5e-2ff8-4ec7-bbe8-5167bad54306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:50.635409 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-e9e15b5e-2ff8-4ec7-bbe8-5167bad54306 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:10:50.636651 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-e9e15b5e-2ff8-4ec7-bbe8-5167bad54306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:10:50.638782 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:10:50.747358 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 714/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 5 12:10:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:10:50.898713 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b411e0-6941-4ad7-a8c5-6a67fb4f8a11 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:10:50.900392 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-f7b411e0-6941-4ad7-a8c5-6a67fb4f8a11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:10:51.050596 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b411e0-6941-4ad7-a8c5-6a67fb4f8a11 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:10:51.078991 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:10:51.173616 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e27440-d663-42c3-8d60-724e93c72c43 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb060ff495bc4abb83ff88992fb7be09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:10:51.174246 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e27440-d663-42c3-8d60-724e93c72c43 service nova] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:51.174530 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e27440-d663-42c3-8d60-724e93c72c43 service nova] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:51.174815 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e27440-d663-42c3-8d60-724e93c72c43 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:51.176446 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-f0e27440-d663-42c3-8d60-724e93c72c43 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:10:51.268198 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e27440-d663-42c3-8d60-724e93c72c43 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:10:51.269836 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e27440-d663-42c3-8d60-724e93c72c43 service nova] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:10:51.288649 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 726/1440] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:10:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:10:53.122468 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5134ae-3ea0-4dff-b11e-3d2809f2fcdf None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:53.123120 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5134ae-3ea0-4dff-b11e-3d2809f2fcdf None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:53.123120 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5134ae-3ea0-4dff-b11e-3d2809f2fcdf None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:53.124338 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 715/1441] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 5 12:10:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:10:53.130386 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c67cfe4-445c-464e-84f8-5ae922fb1b43 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:53.130877 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c67cfe4-445c-464e-84f8-5ae922fb1b43 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:53.131050 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c67cfe4-445c-464e-84f8-5ae922fb1b43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:53.175774 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:10:53.203009 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-6c67cfe4-445c-464e-84f8-5ae922fb1b43 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:10:53.204251 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-6c67cfe4-445c-464e-84f8-5ae922fb1b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:10:53.309581 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 727/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 5 12:10:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:10:53.592780 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5134ae-3ea0-4dff-b11e-3d2809f2fcdf None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:10:53.594406 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-1b5134ae-3ea0-4dff-b11e-3d2809f2fcdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:10:53.700980 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5134ae-3ea0-4dff-b11e-3d2809f2fcdf None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:10:53.735092 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:10:53.780817 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f92901c-250b-4691-9d64-7a93f196f5ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4994b4faa4ec4aa088f3dc32c9c5614d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:10:53.781476 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f92901c-250b-4691-9d64-7a93f196f5ba service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:53.781758 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f92901c-250b-4691-9d64-7a93f196f5ba service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:53.782030 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f92901c-250b-4691-9d64-7a93f196f5ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:53.784390 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-7f92901c-250b-4691-9d64-7a93f196f5ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:10:53.899376 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f92901c-250b-4691-9d64-7a93f196f5ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:10:53.900860 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f92901c-250b-4691-9d64-7a93f196f5ba service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:10:53.919652 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 716/1443] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:10:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:10:55.996550 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2d50bf-241b-46ac-8f8c-dd7f9866d48c None None] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:55.997205 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2d50bf-241b-46ac-8f8c-dd7f9866d48c None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:55.997205 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2d50bf-241b-46ac-8f8c-dd7f9866d48c None None] PATH_INFO: `/` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:55.998390 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 728/1444] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 5 12:10:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:10:56.004163 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830b29dd-0ae7-46c4-a724-bfa3b2723b80 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:56.004588 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830b29dd-0ae7-46c4-a724-bfa3b2723b80 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:56.004714 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830b29dd-0ae7-46c4-a724-bfa3b2723b80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:56.073083 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-830b29dd-0ae7-46c4-a724-bfa3b2723b80 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:10:56.074320 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-830b29dd-0ae7-46c4-a724-bfa3b2723b80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:10:56.087418 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:10:56.174662 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 717/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 5 12:10:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:10:56.459121 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2d50bf-241b-46ac-8f8c-dd7f9866d48c None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:10:56.460736 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-3e2d50bf-241b-46ac-8f8c-dd7f9866d48c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:10:56.565456 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2d50bf-241b-46ac-8f8c-dd7f9866d48c None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:10:56.578586 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:10:56.639488 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c7d1d3-60e0-4d3e-b9bf-81913b995900 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4994b4faa4ec4aa088f3dc32c9c5614d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:10:56.640117 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c7d1d3-60e0-4d3e-b9bf-81913b995900 service neutron] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:56.640395 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c7d1d3-60e0-4d3e-b9bf-81913b995900 service neutron] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:56.640666 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c7d1d3-60e0-4d3e-b9bf-81913b995900 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:56.642284 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-b3c7d1d3-60e0-4d3e-b9bf-81913b995900 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:10:56.750913 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c7d1d3-60e0-4d3e-b9bf-81913b995900 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:10:56.752310 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c7d1d3-60e0-4d3e-b9bf-81913b995900 service neutron] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:10:56.770751 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 729/1446] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:10:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:10:59.025576 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba62e71-364e-49a9-a5cd-aa5643c746b7 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:59.026156 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba62e71-364e-49a9-a5cd-aa5643c746b7 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:59.026156 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba62e71-364e-49a9-a5cd-aa5643c746b7 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:59.027476 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 718/1447] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 5 12:10:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:10:59.033185 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472f7854-7bf7-4b49-863f-44779d7b517a None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:59.033717 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472f7854-7bf7-4b49-863f-44779d7b517a None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:59.033717 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472f7854-7bf7-4b49-863f-44779d7b517a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:59.087783 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:10:59.109109 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-472f7854-7bf7-4b49-863f-44779d7b517a None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:10:59.110362 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-472f7854-7bf7-4b49-863f-44779d7b517a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:10:59.211984 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 730/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 5 12:10:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:10:59.496135 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba62e71-364e-49a9-a5cd-aa5643c746b7 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:10:59.497735 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-3ba62e71-364e-49a9-a5cd-aa5643c746b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:10:59.605655 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba62e71-364e-49a9-a5cd-aa5643c746b7 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:10:59.647860 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:10:59.683845 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a167f561-71d6-487e-b1e4-11a5554aae03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4994b4faa4ec4aa088f3dc32c9c5614d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:10:59.684441 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a167f561-71d6-487e-b1e4-11a5554aae03 service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:10:59.684719 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a167f561-71d6-487e-b1e4-11a5554aae03 service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:10:59.685015 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a167f561-71d6-487e-b1e4-11a5554aae03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:10:59.686640 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-a167f561-71d6-487e-b1e4-11a5554aae03 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:10:59.803489 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a167f561-71d6-487e-b1e4-11a5554aae03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:10:59.805045 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a167f561-71d6-487e-b1e4-11a5554aae03 service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:10:59.824832 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 719/1449] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:10:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:11:01.892011 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8b63f8-b9ad-4aaf-9837-e37a1bb2dbbf None None] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:01.892577 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8b63f8-b9ad-4aaf-9837-e37a1bb2dbbf None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:01.892675 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8b63f8-b9ad-4aaf-9837-e37a1bb2dbbf None None] PATH_INFO: `/` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:01.894126 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 731/1450] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 5 12:11:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:11:01.899808 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a379f8-e17e-4d02-b298-0730b28097e4 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:01.900296 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a379f8-e17e-4d02-b298-0730b28097e4 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:01.900412 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a379f8-e17e-4d02-b298-0730b28097e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:01.968035 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-e0a379f8-e17e-4d02-b298-0730b28097e4 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:11:01.969314 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-e0a379f8-e17e-4d02-b298-0730b28097e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:11:01.990941 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:02.069262 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 720/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 5 12:11:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:11:02.352603 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8b63f8-b9ad-4aaf-9837-e37a1bb2dbbf None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:02.354193 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-1b8b63f8-b9ad-4aaf-9837-e37a1bb2dbbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:11:02.466763 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8b63f8-b9ad-4aaf-9837-e37a1bb2dbbf None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:02.486844 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:02.541676 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b241e758-80fe-4842-a157-24c3e98c571e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4994b4faa4ec4aa088f3dc32c9c5614d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:02.542282 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b241e758-80fe-4842-a157-24c3e98c571e service neutron] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:02.542557 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b241e758-80fe-4842-a157-24c3e98c571e service neutron] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:02.542824 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b241e758-80fe-4842-a157-24c3e98c571e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:02.544445 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-b241e758-80fe-4842-a157-24c3e98c571e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:11:02.656530 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b241e758-80fe-4842-a157-24c3e98c571e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:02.658044 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b241e758-80fe-4842-a157-24c3e98c571e service neutron] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:02.676432 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 732/1452] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:11:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:11:04.698585 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b47878-8d1f-41af-b144-82ccb64b6181 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:04.699185 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b47878-8d1f-41af-b144-82ccb64b6181 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:04.699185 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b47878-8d1f-41af-b144-82ccb64b6181 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:04.700530 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 721/1453] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 5 12:11:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:11:04.706488 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddd3551-eed0-4272-99c9-457f41810b6f None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:04.706924 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddd3551-eed0-4272-99c9-457f41810b6f None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:04.707040 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddd3551-eed0-4272-99c9-457f41810b6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:04.773384 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:04.776334 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-eddd3551-eed0-4272-99c9-457f41810b6f None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:11:04.778179 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-eddd3551-eed0-4272-99c9-457f41810b6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:11:04.884976 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 733/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 5 12:11:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:11:05.170594 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b47878-8d1f-41af-b144-82ccb64b6181 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:05.172133 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-d5b47878-8d1f-41af-b144-82ccb64b6181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:11:05.280840 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b47878-8d1f-41af-b144-82ccb64b6181 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:05.331200 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:05.356753 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060156cd-2b45-45e5-9766-187398a7717b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4994b4faa4ec4aa088f3dc32c9c5614d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:05.357395 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060156cd-2b45-45e5-9766-187398a7717b service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:05.357685 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060156cd-2b45-45e5-9766-187398a7717b service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:05.357963 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060156cd-2b45-45e5-9766-187398a7717b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:05.359641 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-060156cd-2b45-45e5-9766-187398a7717b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:11:05.480335 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060156cd-2b45-45e5-9766-187398a7717b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:05.481827 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060156cd-2b45-45e5-9766-187398a7717b service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:05.502771 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 722/1455] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:11:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:11:07.495410 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf587545-f069-4e06-91a4-817a1bf9742e None None] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:07.496003 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf587545-f069-4e06-91a4-817a1bf9742e None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:07.496003 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf587545-f069-4e06-91a4-817a1bf9742e None None] PATH_INFO: `/` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:07.497352 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 734/1456] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 5 12:11:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:11:07.503512 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8b8837-a879-4a35-aade-938a89c47e78 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:07.503998 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8b8837-a879-4a35-aade-938a89c47e78 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:07.504130 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8b8837-a879-4a35-aade-938a89c47e78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:07.577560 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-3a8b8837-a879-4a35-aade-938a89c47e78 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:11:07.578805 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-3a8b8837-a879-4a35-aade-938a89c47e78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:11:07.615488 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:07.696950 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 723/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 5 12:11:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:11:07.988640 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf587545-f069-4e06-91a4-817a1bf9742e None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:07.990449 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-cf587545-f069-4e06-91a4-817a1bf9742e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:11:08.112190 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf587545-f069-4e06-91a4-817a1bf9742e None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:08.144544 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:08.193673 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7338a3b-0d1f-48c2-bfe1-f8380d446f6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4994b4faa4ec4aa088f3dc32c9c5614d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:08.194284 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7338a3b-0d1f-48c2-bfe1-f8380d446f6d service neutron] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:08.194559 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7338a3b-0d1f-48c2-bfe1-f8380d446f6d service neutron] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:08.194827 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7338a3b-0d1f-48c2-bfe1-f8380d446f6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:08.196455 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-b7338a3b-0d1f-48c2-bfe1-f8380d446f6d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:11:08.312243 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7338a3b-0d1f-48c2-bfe1-f8380d446f6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:08.313884 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7338a3b-0d1f-48c2-bfe1-f8380d446f6d service neutron] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:08.334441 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 735/1458] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:11:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:11:10.333963 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c386891-f506-47bf-9666-7f368ce51f3c None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:10.334576 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c386891-f506-47bf-9666-7f368ce51f3c None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:10.334576 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c386891-f506-47bf-9666-7f368ce51f3c None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:10.335881 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 724/1459] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 5 12:11:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:11:10.341199 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efab6688-aef7-4ba7-9ae2-95ca76c0c3e4 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:10.341648 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efab6688-aef7-4ba7-9ae2-95ca76c0c3e4 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:10.341758 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efab6688-aef7-4ba7-9ae2-95ca76c0c3e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:10.409979 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-efab6688-aef7-4ba7-9ae2-95ca76c0c3e4 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:11:10.411214 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-efab6688-aef7-4ba7-9ae2-95ca76c0c3e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:11:10.419710 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:10.511021 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 736/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 5 12:11:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:11:10.797392 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c386891-f506-47bf-9666-7f368ce51f3c None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:10.799300 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-7c386891-f506-47bf-9666-7f368ce51f3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:11:10.916137 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c386891-f506-47bf-9666-7f368ce51f3c None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:10.972956 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:10.991539 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbe9852-7760-4e03-bc6d-8d0c30eb1adb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4994b4faa4ec4aa088f3dc32c9c5614d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:10.992146 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbe9852-7760-4e03-bc6d-8d0c30eb1adb service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:10.992425 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbe9852-7760-4e03-bc6d-8d0c30eb1adb service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:10.992692 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbe9852-7760-4e03-bc6d-8d0c30eb1adb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:10.994344 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-4fbe9852-7760-4e03-bc6d-8d0c30eb1adb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:11:11.104916 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbe9852-7760-4e03-bc6d-8d0c30eb1adb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:11.106390 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbe9852-7760-4e03-bc6d-8d0c30eb1adb service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:11.125307 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 725/1461] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:11:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:11:13.075147 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec6b825-b2c9-43d4-b9f7-de209bf7d235 None None] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:13.075704 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec6b825-b2c9-43d4-b9f7-de209bf7d235 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:13.075704 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec6b825-b2c9-43d4-b9f7-de209bf7d235 None None] PATH_INFO: `/` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:13.076970 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 737/1462] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 5 12:11:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:11:13.083038 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7880241-7322-4b55-9740-d4c8d2ef5147 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:13.083431 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7880241-7322-4b55-9740-d4c8d2ef5147 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:13.083586 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7880241-7322-4b55-9740-d4c8d2ef5147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:13.150156 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-e7880241-7322-4b55-9740-d4c8d2ef5147 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:11:13.151405 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-e7880241-7322-4b55-9740-d4c8d2ef5147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:11:13.190619 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:13.250623 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 726/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 5 12:11:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:11:13.531978 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec6b825-b2c9-43d4-b9f7-de209bf7d235 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:13.533598 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-dec6b825-b2c9-43d4-b9f7-de209bf7d235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:11:13.643045 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec6b825-b2c9-43d4-b9f7-de209bf7d235 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:13.683952 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:13.721730 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33bf20d-9ed8-4d6d-bf04-3e43154d7e68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4994b4faa4ec4aa088f3dc32c9c5614d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:13.722337 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33bf20d-9ed8-4d6d-bf04-3e43154d7e68 service neutron] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:13.722613 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33bf20d-9ed8-4d6d-bf04-3e43154d7e68 service neutron] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:13.722880 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33bf20d-9ed8-4d6d-bf04-3e43154d7e68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:13.724506 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-f33bf20d-9ed8-4d6d-bf04-3e43154d7e68 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:11:13.846837 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33bf20d-9ed8-4d6d-bf04-3e43154d7e68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:13.848288 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33bf20d-9ed8-4d6d-bf04-3e43154d7e68 service neutron] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:13.867964 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 738/1464] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:11:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:11:15.834711 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a7fe4a-4de5-4da5-987f-fb26cf4d8021 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:15.835313 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a7fe4a-4de5-4da5-987f-fb26cf4d8021 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:15.835313 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a7fe4a-4de5-4da5-987f-fb26cf4d8021 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:15.836593 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 727/1465] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 5 12:11:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:11:15.841879 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331ae5d3-1856-4da2-8bae-6de9ed77bb8e None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:15.842303 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331ae5d3-1856-4da2-8bae-6de9ed77bb8e None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:15.842422 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331ae5d3-1856-4da2-8bae-6de9ed77bb8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:16.029294 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-331ae5d3-1856-4da2-8bae-6de9ed77bb8e None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:11:16.030439 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-331ae5d3-1856-4da2-8bae-6de9ed77bb8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:11:16.050153 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:16.131448 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 739/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 5 12:11:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:11:16.423745 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a7fe4a-4de5-4da5-987f-fb26cf4d8021 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:16.425421 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-46a7fe4a-4de5-4da5-987f-fb26cf4d8021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:11:16.535183 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a7fe4a-4de5-4da5-987f-fb26cf4d8021 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:16.603944 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:16.612190 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6facc9-b399-44c3-adf2-2f95cd6ca3d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4994b4faa4ec4aa088f3dc32c9c5614d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:16.612850 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6facc9-b399-44c3-adf2-2f95cd6ca3d3 service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:16.613195 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6facc9-b399-44c3-adf2-2f95cd6ca3d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:16.613507 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6facc9-b399-44c3-adf2-2f95cd6ca3d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:16.615164 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-4e6facc9-b399-44c3-adf2-2f95cd6ca3d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:11:16.725755 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6facc9-b399-44c3-adf2-2f95cd6ca3d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:16.727117 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6facc9-b399-44c3-adf2-2f95cd6ca3d3 service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:16.745471 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 728/1467] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:11:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:11:18.683942 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb4dfc0-83ca-4086-a9bc-52351fdf818a None None] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:18.684528 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb4dfc0-83ca-4086-a9bc-52351fdf818a None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:18.684528 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb4dfc0-83ca-4086-a9bc-52351fdf818a None None] PATH_INFO: `/` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:18.685890 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 740/1468] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 5 12:11:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:11:18.691830 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edf94f4-67ef-4872-aff2-b4d3358536bc None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:18.692298 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edf94f4-67ef-4872-aff2-b4d3358536bc None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:18.692435 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edf94f4-67ef-4872-aff2-b4d3358536bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:18.763002 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-1edf94f4-67ef-4872-aff2-b4d3358536bc None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:11:18.764262 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-1edf94f4-67ef-4872-aff2-b4d3358536bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:11:18.824634 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:18.880292 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 729/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 5 12:11:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:11:19.163791 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb4dfc0-83ca-4086-a9bc-52351fdf818a None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:19.165349 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-cfb4dfc0-83ca-4086-a9bc-52351fdf818a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:11:19.278798 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb4dfc0-83ca-4086-a9bc-52351fdf818a None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:19.327408 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:19.356721 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd263699-c38c-45fd-b0c1-cf6d203f0716 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4994b4faa4ec4aa088f3dc32c9c5614d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:19.357363 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd263699-c38c-45fd-b0c1-cf6d203f0716 service neutron] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:19.357639 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd263699-c38c-45fd-b0c1-cf6d203f0716 service neutron] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:19.357906 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd263699-c38c-45fd-b0c1-cf6d203f0716 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:19.359542 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-cd263699-c38c-45fd-b0c1-cf6d203f0716 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:11:19.477825 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd263699-c38c-45fd-b0c1-cf6d203f0716 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:19.479177 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd263699-c38c-45fd-b0c1-cf6d203f0716 service neutron] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:19.497110 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 741/1470] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:11:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:11:28.878288 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=22 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:29.494784 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=66 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:39.930373 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea64440-5cb6-43e6-8169-729f3509783c None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:39.930951 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea64440-5cb6-43e6-8169-729f3509783c None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:39.930951 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea64440-5cb6-43e6-8169-729f3509783c None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:39.932319 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 730/1471] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:11:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:11:39.939276 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3855413d-8a71-4bc7-a3f0-8a81385c1265 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:39.939963 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3855413d-8a71-4bc7-a3f0-8a81385c1265 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:39.939963 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3855413d-8a71-4bc7-a3f0-8a81385c1265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:40.014013 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-3855413d-8a71-4bc7-a3f0-8a81385c1265 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:11:40.015147 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-3855413d-8a71-4bc7-a3f0-8a81385c1265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:11:40.122861 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 742/1472] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:11:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 12:11:40.426583 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845140f3-8653-4137-b7f4-cc4405fc3641 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:40.426991 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845140f3-8653-4137-b7f4-cc4405fc3641 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:40.427371 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845140f3-8653-4137-b7f4-cc4405fc3641 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:40.428829 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 731/1473] 10.222.0.50 () {54 vars in 961 bytes} [Mon Sep 5 12:11:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:11:40.434312 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e532d7-d3ad-4545-929c-f1230e43e192 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:40.434597 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e532d7-d3ad-4545-929c-f1230e43e192 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:40.434993 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e532d7-d3ad-4545-929c-f1230e43e192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:40.515464 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-b3e532d7-d3ad-4545-929c-f1230e43e192 None None] MFA Rules not processed for user `b2b08e831af84a658b0f5b28ad03e4f7`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:11:40.516674 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-b3e532d7-d3ad-4545-929c-f1230e43e192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:11:40.538831 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:40.597968 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 743/1474] 10.222.0.50 () {58 vars in 1058 bytes} [Mon Sep 5 12:11:40 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:11:40.605613 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845140f3-8653-4137-b7f4-cc4405fc3641 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:40.607169 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-845140f3-8653-4137-b7f4-cc4405fc3641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:11:40.719947 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845140f3-8653-4137-b7f4-cc4405fc3641 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:40.809711 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4497594-25e0-418d-93c2-784fa6a7108c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b08e831af84a658b0f5b28ad03e4f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:40.810332 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4497594-25e0-418d-93c2-784fa6a7108c service glance] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:40.810604 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4497594-25e0-418d-93c2-784fa6a7108c service glance] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:40.810875 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4497594-25e0-418d-93c2-784fa6a7108c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:40.812625 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-a4497594-25e0-418d-93c2-784fa6a7108c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:11:40.874684 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:40.933081 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4497594-25e0-418d-93c2-784fa6a7108c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:40.934565 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4497594-25e0-418d-93c2-784fa6a7108c service glance] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:40.953879 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 732/1475] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:11:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 12:11:42.974588 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfae44f-af5d-42e8-b769-97f82b52b01b None None] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:42.975168 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfae44f-af5d-42e8-b769-97f82b52b01b None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:42.975168 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfae44f-af5d-42e8-b769-97f82b52b01b None None] PATH_INFO: `/` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:42.976600 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 744/1476] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:11:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:11:42.982705 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3581d0a2-c2ff-4fa6-bdda-5f1e2f7d80d7 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:42.983234 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3581d0a2-c2ff-4fa6-bdda-5f1e2f7d80d7 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:42.983325 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3581d0a2-c2ff-4fa6-bdda-5f1e2f7d80d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:43.052357 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-3581d0a2-c2ff-4fa6-bdda-5f1e2f7d80d7 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:11:43.053519 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-3581d0a2-c2ff-4fa6-bdda-5f1e2f7d80d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:11:43.161089 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 733/1477] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:11:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:11:43.441277 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfae44f-af5d-42e8-b769-97f82b52b01b None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:43.442984 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-bcfae44f-af5d-42e8-b769-97f82b52b01b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:11:43.590548 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfae44f-af5d-42e8-b769-97f82b52b01b None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:43.648567 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:43.696227 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431b823f-8595-43dc-8447-9768a05ee3b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:43.696736 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431b823f-8595-43dc-8447-9768a05ee3b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:43.697170 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431b823f-8595-43dc-8447-9768a05ee3b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:43.697443 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431b823f-8595-43dc-8447-9768a05ee3b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:43.698092 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431b823f-8595-43dc-8447-9768a05ee3b0 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:43.699847 dv-cinder-855189-1-smb devstack@keystone.service[81719]: WARNING py.warnings [None req-431b823f-8595-43dc-8447-9768a05ee3b0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 05 12:11:43.699847 dv-cinder-855189-1-smb devstack@keystone.service[81719]: warnings.warn(msg) Sep 05 12:11:43.699847 dv-cinder-855189-1-smb devstack@keystone.service[81719]: Sep 05 12:11:43.700997 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431b823f-8595-43dc-8447-9768a05ee3b0 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:43.721071 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 745/1478] 10.222.0.50 () {56 vars in 1108 bytes} [Mon Sep 5 12:11:43 2022] GET /identity/v3/projects => generated 2553 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:11:45.681418 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585d221f-8040-4bee-8e53-ae488af4d372 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:45.681998 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585d221f-8040-4bee-8e53-ae488af4d372 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:45.681998 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585d221f-8040-4bee-8e53-ae488af4d372 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:45.683332 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 734/1479] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:11:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:11:45.689143 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4299b7f8-3b10-41ad-bc43-e5ca566e822a None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:45.689660 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4299b7f8-3b10-41ad-bc43-e5ca566e822a None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:45.689825 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4299b7f8-3b10-41ad-bc43-e5ca566e822a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:45.758834 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-4299b7f8-3b10-41ad-bc43-e5ca566e822a None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:11:45.760082 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-4299b7f8-3b10-41ad-bc43-e5ca566e822a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:11:45.865947 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 746/1480] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:11:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:11:46.167816 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585d221f-8040-4bee-8e53-ae488af4d372 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:46.169582 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-585d221f-8040-4bee-8e53-ae488af4d372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:11:46.180246 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:46.364913 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585d221f-8040-4bee-8e53-ae488af4d372 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:46.463549 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:46.499910 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bd68ba-562a-4c4a-991d-c87c727236b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb060ff495bc4abb83ff88992fb7be09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:46.501099 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bd68ba-562a-4c4a-991d-c87c727236b5 service nova] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:46.501381 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bd68ba-562a-4c4a-991d-c87c727236b5 service nova] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:46.501658 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bd68ba-562a-4c4a-991d-c87c727236b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:46.503298 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-f7bd68ba-562a-4c4a-991d-c87c727236b5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:11:46.599881 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bd68ba-562a-4c4a-991d-c87c727236b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:46.601544 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bd68ba-562a-4c4a-991d-c87c727236b5 service nova] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:46.620977 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 735/1481] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:11:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:11:48.821549 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beebb288-c77d-4b92-84ea-61d8b5cae779 None None] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:48.822158 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beebb288-c77d-4b92-84ea-61d8b5cae779 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:48.822158 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beebb288-c77d-4b92-84ea-61d8b5cae779 None None] PATH_INFO: `/` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:48.823453 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 747/1482] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:11:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:11:48.830031 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ac3810-6edb-4a38-bb10-70e0802e523c None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:48.830890 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ac3810-6edb-4a38-bb10-70e0802e523c None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:48.830890 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ac3810-6edb-4a38-bb10-70e0802e523c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:48.903676 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-04ac3810-6edb-4a38-bb10-70e0802e523c None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:11:48.904942 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-04ac3810-6edb-4a38-bb10-70e0802e523c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:11:48.955411 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:49.009103 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 736/1483] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:11:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 12:11:49.314434 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beebb288-c77d-4b92-84ea-61d8b5cae779 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:49.315997 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-beebb288-c77d-4b92-84ea-61d8b5cae779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:11:49.346745 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:49.444694 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beebb288-c77d-4b92-84ea-61d8b5cae779 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:49.522989 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07476df-6bd8-48b2-b871-7f21fed5091c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4994b4faa4ec4aa088f3dc32c9c5614d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:49.523608 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07476df-6bd8-48b2-b871-7f21fed5091c service neutron] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:49.523886 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07476df-6bd8-48b2-b871-7f21fed5091c service neutron] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:49.524153 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07476df-6bd8-48b2-b871-7f21fed5091c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:49.525840 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-c07476df-6bd8-48b2-b871-7f21fed5091c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:11:49.610250 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:49.652064 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07476df-6bd8-48b2-b871-7f21fed5091c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:49.653580 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07476df-6bd8-48b2-b871-7f21fed5091c service neutron] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:49.675391 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 748/1484] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:11:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:11:51.692325 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50700ee4-e69d-45b8-9e24-0347aa4253fe None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:51.692880 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50700ee4-e69d-45b8-9e24-0347aa4253fe None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:51.692880 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50700ee4-e69d-45b8-9e24-0347aa4253fe None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:51.694262 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 737/1485] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:11:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:11:51.699970 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272cb74e-a5b6-464c-b154-1c9ae2c7c9a8 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:51.700569 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272cb74e-a5b6-464c-b154-1c9ae2c7c9a8 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:51.700569 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272cb74e-a5b6-464c-b154-1c9ae2c7c9a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:51.770560 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-272cb74e-a5b6-464c-b154-1c9ae2c7c9a8 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:11:51.771821 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-272cb74e-a5b6-464c-b154-1c9ae2c7c9a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:11:51.871288 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 749/1486] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:11:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 12:11:52.159112 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50700ee4-e69d-45b8-9e24-0347aa4253fe None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:52.160718 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-50700ee4-e69d-45b8-9e24-0347aa4253fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:11:52.276123 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50700ee4-e69d-45b8-9e24-0347aa4253fe None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:52.354759 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:52.356921 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55e58a6-3d6e-44dd-a5eb-2b8ede47f355 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4994b4faa4ec4aa088f3dc32c9c5614d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:52.357709 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55e58a6-3d6e-44dd-a5eb-2b8ede47f355 service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:52.358216 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55e58a6-3d6e-44dd-a5eb-2b8ede47f355 service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:52.358620 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55e58a6-3d6e-44dd-a5eb-2b8ede47f355 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:52.361143 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-b55e58a6-3d6e-44dd-a5eb-2b8ede47f355 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:11:52.612694 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55e58a6-3d6e-44dd-a5eb-2b8ede47f355 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:52.614190 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55e58a6-3d6e-44dd-a5eb-2b8ede47f355 service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:52.634793 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 738/1487] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:11:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:11:54.736098 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452388f6-7230-4909-90be-2a760984b270 None None] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:54.736721 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452388f6-7230-4909-90be-2a760984b270 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:54.736721 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452388f6-7230-4909-90be-2a760984b270 None None] PATH_INFO: `/` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:54.738011 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 750/1488] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:11:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:11:54.743547 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f23dd7e-f80f-4595-a18a-b78861b89bd0 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:54.744033 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f23dd7e-f80f-4595-a18a-b78861b89bd0 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:54.744140 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f23dd7e-f80f-4595-a18a-b78861b89bd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:54.819725 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-8f23dd7e-f80f-4595-a18a-b78861b89bd0 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:11:54.820998 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-8f23dd7e-f80f-4595-a18a-b78861b89bd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:11:54.877433 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:54.924242 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 739/1489] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:11:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:11:55.216240 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452388f6-7230-4909-90be-2a760984b270 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:55.217829 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-452388f6-7230-4909-90be-2a760984b270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:11:55.259645 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:55.333495 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452388f6-7230-4909-90be-2a760984b270 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:55.412830 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4908549-7b32-4cec-bf3e-181b47bab6a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4994b4faa4ec4aa088f3dc32c9c5614d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:55.413466 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4908549-7b32-4cec-bf3e-181b47bab6a5 service neutron] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:55.413743 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4908549-7b32-4cec-bf3e-181b47bab6a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:55.414023 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4908549-7b32-4cec-bf3e-181b47bab6a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:55.415616 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-b4908549-7b32-4cec-bf3e-181b47bab6a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:11:55.502842 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:55.534407 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4908549-7b32-4cec-bf3e-181b47bab6a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:55.535858 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4908549-7b32-4cec-bf3e-181b47bab6a5 service neutron] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:55.556029 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 751/1490] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:11:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:11:57.713056 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba47289-73a3-4160-aaa9-81c91c099454 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:57.713666 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba47289-73a3-4160-aaa9-81c91c099454 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:57.713666 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba47289-73a3-4160-aaa9-81c91c099454 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:57.714965 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 740/1491] 10.222.0.50 () {54 vars in 927 bytes} [Mon Sep 5 12:11:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:11:57.720321 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a47abbe-d7d5-4eaf-b707-3623fa2d2935 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:57.720785 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a47abbe-d7d5-4eaf-b707-3623fa2d2935 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:57.720886 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a47abbe-d7d5-4eaf-b707-3623fa2d2935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:57.796018 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-0a47abbe-d7d5-4eaf-b707-3623fa2d2935 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:11:57.797793 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-0a47abbe-d7d5-4eaf-b707-3623fa2d2935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:11:57.899006 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 752/1492] 10.222.0.50 () {58 vars in 1024 bytes} [Mon Sep 5 12:11:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:11:58.186252 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba47289-73a3-4160-aaa9-81c91c099454 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:11:58.187843 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-7ba47289-73a3-4160-aaa9-81c91c099454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:11:58.307927 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba47289-73a3-4160-aaa9-81c91c099454 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:11:58.393633 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c63a86-c0a3-4da5-acfb-d488f81b7626 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4994b4faa4ec4aa088f3dc32c9c5614d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:11:58.394238 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c63a86-c0a3-4da5-acfb-d488f81b7626 service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:11:58.394513 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c63a86-c0a3-4da5-acfb-d488f81b7626 service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:11:58.394778 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c63a86-c0a3-4da5-acfb-d488f81b7626 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:11:58.396646 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-56c63a86-c0a3-4da5-acfb-d488f81b7626 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:11:58.405597 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:11:58.514159 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c63a86-c0a3-4da5-acfb-d488f81b7626 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:11:58.516041 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c63a86-c0a3-4da5-acfb-d488f81b7626 service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:11:58.538052 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 741/1493] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:11:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:12:07.897224 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=82 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:12:08.535602 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=50 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:13:19.004624 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d38b9b5-22f2-4da2-bb25-de89d522ffa6 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:19.005277 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d38b9b5-22f2-4da2-bb25-de89d522ffa6 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:19.005277 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d38b9b5-22f2-4da2-bb25-de89d522ffa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:19.090702 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-5d38b9b5-22f2-4da2-bb25-de89d522ffa6 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:13:19.091885 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-5d38b9b5-22f2-4da2-bb25-de89d522ffa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:13:19.199234 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 753/1494] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:13:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:13:19.207690 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dff5971-52b4-42dd-becf-17c3c8340b6e None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:19.208226 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dff5971-52b4-42dd-becf-17c3c8340b6e None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:19.208226 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dff5971-52b4-42dd-becf-17c3c8340b6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:19.285968 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-8dff5971-52b4-42dd-becf-17c3c8340b6e None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:13:19.287194 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-8dff5971-52b4-42dd-becf-17c3c8340b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:13:19.394635 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 742/1495] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:13:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:13:19.399318 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d38b9b5-22f2-4da2-bb25-de89d522ffa6 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:13:19.400527 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-5d38b9b5-22f2-4da2-bb25-de89d522ffa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:13:19.411960 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d38b9b5-22f2-4da2-bb25-de89d522ffa6 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:13:19.475651 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:13:19.510237 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152cf841-3087-4a87-a7b2-730cead1903b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:13:19.510847 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152cf841-3087-4a87-a7b2-730cead1903b admin admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:19.511126 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152cf841-3087-4a87-a7b2-730cead1903b admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:19.511397 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152cf841-3087-4a87-a7b2-730cead1903b admin admin] PATH_INFO: `/v3/domains` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:19.512039 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152cf841-3087-4a87-a7b2-730cead1903b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:13:19.512341 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152cf841-3087-4a87-a7b2-730cead1903b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:13:19.513434 dv-cinder-855189-1-smb devstack@keystone.service[81719]: WARNING py.warnings [None req-152cf841-3087-4a87-a7b2-730cead1903b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 05 12:13:19.513434 dv-cinder-855189-1-smb devstack@keystone.service[81719]: warnings.warn(msg) Sep 05 12:13:19.513434 dv-cinder-855189-1-smb devstack@keystone.service[81719]: Sep 05 12:13:19.514328 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152cf841-3087-4a87-a7b2-730cead1903b admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:13:19.526054 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 754/1496] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Sep 5 12:13:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:13:19.534529 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dff5971-52b4-42dd-becf-17c3c8340b6e None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:13:19.543572 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dff5971-52b4-42dd-becf-17c3c8340b6e None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:13:19.605217 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:13:19.639511 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e44bd68-6924-4dc9-b0dd-11d412fd860a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:13:19.640116 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e44bd68-6924-4dc9-b0dd-11d412fd860a admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:19.640393 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e44bd68-6924-4dc9-b0dd-11d412fd860a admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:19.640663 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e44bd68-6924-4dc9-b0dd-11d412fd860a admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:19.641322 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e44bd68-6924-4dc9-b0dd-11d412fd860a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:13:19.643073 dv-cinder-855189-1-smb devstack@keystone.service[81720]: WARNING py.warnings [None req-5e44bd68-6924-4dc9-b0dd-11d412fd860a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 05 12:13:19.643073 dv-cinder-855189-1-smb devstack@keystone.service[81720]: warnings.warn(msg) Sep 05 12:13:19.643073 dv-cinder-855189-1-smb devstack@keystone.service[81720]: Sep 05 12:13:19.644510 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e44bd68-6924-4dc9-b0dd-11d412fd860a admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:13:19.699876 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 743/1497] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 5 12:13:19 2022] POST /identity/v3/projects => generated 379 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:13:19.704449 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152cf841-3087-4a87-a7b2-730cead1903b admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:13:19.706041 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-152cf841-3087-4a87-a7b2-730cead1903b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:13:19.740854 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152cf841-3087-4a87-a7b2-730cead1903b admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:13:19.837951 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0585f89a-1b0e-4496-81af-6810e1c3ee25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:13:19.838532 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0585f89a-1b0e-4496-81af-6810e1c3ee25 admin admin] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:19.838811 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0585f89a-1b0e-4496-81af-6810e1c3ee25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:19.839082 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0585f89a-1b0e-4496-81af-6810e1c3ee25 admin admin] PATH_INFO: `/v3/users` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:19.839718 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0585f89a-1b0e-4496-81af-6810e1c3ee25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:13:19.840727 dv-cinder-855189-1-smb devstack@keystone.service[81719]: WARNING py.warnings [None req-0585f89a-1b0e-4496-81af-6810e1c3ee25 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 05 12:13:19.840727 dv-cinder-855189-1-smb devstack@keystone.service[81719]: warnings.warn(msg) Sep 05 12:13:19.840727 dv-cinder-855189-1-smb devstack@keystone.service[81719]: Sep 05 12:13:19.842481 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0585f89a-1b0e-4496-81af-6810e1c3ee25 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:13:19.884027 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 755/1498] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 5 12:13:19 2022] POST /identity/v3/users => generated 290 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:13:19.888329 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e44bd68-6924-4dc9-b0dd-11d412fd860a admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:13:19.889886 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-5e44bd68-6924-4dc9-b0dd-11d412fd860a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:13:19.951468 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e44bd68-6924-4dc9-b0dd-11d412fd860a admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:13:20.037187 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:13:20.048303 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51789f6e-0085-4195-a79e-e0e78cc7e693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:13:20.048937 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51789f6e-0085-4195-a79e-e0e78cc7e693 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:20.049219 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51789f6e-0085-4195-a79e-e0e78cc7e693 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:20.049486 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51789f6e-0085-4195-a79e-e0e78cc7e693 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:20.050125 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51789f6e-0085-4195-a79e-e0e78cc7e693 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:13:20.051140 dv-cinder-855189-1-smb devstack@keystone.service[81720]: WARNING py.warnings [None req-51789f6e-0085-4195-a79e-e0e78cc7e693 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 05 12:13:20.051140 dv-cinder-855189-1-smb devstack@keystone.service[81720]: warnings.warn(msg) Sep 05 12:13:20.051140 dv-cinder-855189-1-smb devstack@keystone.service[81720]: Sep 05 12:13:20.052011 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51789f6e-0085-4195-a79e-e0e78cc7e693 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:13:20.064473 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 744/1499] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:13:19 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:13:20.068609 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0585f89a-1b0e-4496-81af-6810e1c3ee25 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:13:20.070190 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-0585f89a-1b0e-4496-81af-6810e1c3ee25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:13:20.082810 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0585f89a-1b0e-4496-81af-6810e1c3ee25 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:13:20.108352 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:13:20.182271 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d7ff4c-8e4d-428c-ae90-a5c23c8e7796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:13:20.182876 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d7ff4c-8e4d-428c-ae90-a5c23c8e7796 admin admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:20.183154 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d7ff4c-8e4d-428c-ae90-a5c23c8e7796 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:20.183425 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d7ff4c-8e4d-428c-ae90-a5c23c8e7796 admin admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:20.184065 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d7ff4c-8e4d-428c-ae90-a5c23c8e7796 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:13:20.185103 dv-cinder-855189-1-smb devstack@keystone.service[81719]: WARNING py.warnings [None req-26d7ff4c-8e4d-428c-ae90-a5c23c8e7796 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 05 12:13:20.185103 dv-cinder-855189-1-smb devstack@keystone.service[81719]: warnings.warn(msg) Sep 05 12:13:20.185103 dv-cinder-855189-1-smb devstack@keystone.service[81719]: Sep 05 12:13:20.185985 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d7ff4c-8e4d-428c-ae90-a5c23c8e7796 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:13:20.198238 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 756/1500] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:13:20 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:13:20.203121 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51789f6e-0085-4195-a79e-e0e78cc7e693 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:13:20.204464 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-51789f6e-0085-4195-a79e-e0e78cc7e693 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:13:20.240181 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51789f6e-0085-4195-a79e-e0e78cc7e693 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:13:20.334315 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70446b8b-86a0-4db6-868f-6ec366b14a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:13:20.334892 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70446b8b-86a0-4db6-868f-6ec366b14a8c admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:20.335168 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70446b8b-86a0-4db6-868f-6ec366b14a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:20.335437 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70446b8b-86a0-4db6-868f-6ec366b14a8c admin admin] PATH_INFO: `/v3/projects/13c116eb619a4059998c4255fa8f6cad/users/bee1528949c04008a2b5d8dde7309c86/roles/ed72181e1403401facb77dcf33644757` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:20.360188 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70446b8b-86a0-4db6-868f-6ec366b14a8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=13c116eb619a4059998c4255fa8f6cad, user_id=bee1528949c04008a2b5d8dde7309c86, role_id=ed72181e1403401facb77dcf33644757)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:13:20.360188 dv-cinder-855189-1-smb devstack@keystone.service[81720]: WARNING py.warnings [None req-70446b8b-86a0-4db6-868f-6ec366b14a8c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 05 12:13:20.360188 dv-cinder-855189-1-smb devstack@keystone.service[81720]: warnings.warn(msg) Sep 05 12:13:20.360188 dv-cinder-855189-1-smb devstack@keystone.service[81720]: Sep 05 12:13:20.361205 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70446b8b-86a0-4db6-868f-6ec366b14a8c admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:13:20.387644 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 745/1501] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 5 12:13:20 2022] PUT /identity/v3/projects/13c116eb619a4059998c4255fa8f6cad/users/bee1528949c04008a2b5d8dde7309c86/roles/ed72181e1403401facb77dcf33644757 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:13:20.400690 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c1500f-b98d-44de-a51c-e85041e59ccd None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:20.401002 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c1500f-b98d-44de-a51c-e85041e59ccd None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:20.401304 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c1500f-b98d-44de-a51c-e85041e59ccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:20.458401 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-62c1500f-b98d-44de-a51c-e85041e59ccd None None] MFA Rules not processed for user `bee1528949c04008a2b5d8dde7309c86`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:13:20.459548 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-62c1500f-b98d-44de-a51c-e85041e59ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:13:20.537380 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 757/1502] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:13:20 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:13:20.550657 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9f5c44-8ae0-4a19-9bb0-e52ee1a88a97 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:20.550942 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9f5c44-8ae0-4a19-9bb0-e52ee1a88a97 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:20.551220 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9f5c44-8ae0-4a19-9bb0-e52ee1a88a97 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:20.552565 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 746/1503] 10.222.0.50 () {54 vars in 964 bytes} [Mon Sep 5 12:13:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:13:20.557504 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914265a2-524f-4a7f-ae6b-ec74b4fa46b5 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:20.557787 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914265a2-524f-4a7f-ae6b-ec74b4fa46b5 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:20.558059 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914265a2-524f-4a7f-ae6b-ec74b4fa46b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:20.591968 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:13:20.638940 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-914265a2-524f-4a7f-ae6b-ec74b4fa46b5 None None] MFA Rules not processed for user `37633bbae0c2423c81ccd61ac3a17ccf`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:13:20.640141 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-914265a2-524f-4a7f-ae6b-ec74b4fa46b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:13:20.714788 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 758/1504] 10.222.0.50 () {58 vars in 1061 bytes} [Mon Sep 5 12:13:20 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:13:20.724475 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9f5c44-8ae0-4a19-9bb0-e52ee1a88a97 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:13:20.726067 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-9f9f5c44-8ae0-4a19-9bb0-e52ee1a88a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:13:20.778017 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:13:20.833968 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9f5c44-8ae0-4a19-9bb0-e52ee1a88a97 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:13:20.907048 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b39ace-fa08-4ffa-bb0e-174438fdd931 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37633bbae0c2423c81ccd61ac3a17ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:13:20.907638 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b39ace-fa08-4ffa-bb0e-174438fdd931 service cinder] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:20.907917 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b39ace-fa08-4ffa-bb0e-174438fdd931 service cinder] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:20.908193 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b39ace-fa08-4ffa-bb0e-174438fdd931 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:20.909833 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-c3b39ace-fa08-4ffa-bb0e-174438fdd931 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:13:21.009874 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b39ace-fa08-4ffa-bb0e-174438fdd931 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:13:21.011222 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b39ace-fa08-4ffa-bb0e-174438fdd931 service cinder] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:13:21.014664 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:13:21.030530 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 747/1505] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:13:20 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:13:21.077582 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa290f6f-4070-4e77-a3aa-7d218c1000b3 None None] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:21.078070 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa290f6f-4070-4e77-a3aa-7d218c1000b3 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:21.078168 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa290f6f-4070-4e77-a3aa-7d218c1000b3 None None] PATH_INFO: `/` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:21.079712 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 759/1506] 10.222.0.50 () {52 vars in 830 bytes} [Mon Sep 5 12:13:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:13:21.083449 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b39ace-fa08-4ffa-bb0e-174438fdd931 service cinder] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:13:21.084695 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-c3b39ace-fa08-4ffa-bb0e-174438fdd931 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:13:21.186230 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b39ace-fa08-4ffa-bb0e-174438fdd931 service cinder] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:13:21.278220 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c36e51e-418f-4db1-b2f1-575b9209a991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:13:21.279447 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c36e51e-418f-4db1-b2f1-575b9209a991 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:21.279557 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c36e51e-418f-4db1-b2f1-575b9209a991 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:21.279802 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c36e51e-418f-4db1-b2f1-575b9209a991 admin admin] PATH_INFO: `/v3/users/bee1528949c04008a2b5d8dde7309c86` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:21.292651 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c36e51e-418f-4db1-b2f1-575b9209a991 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bee1528949c04008a2b5d8dde7309c86)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:13:21.293721 dv-cinder-855189-1-smb devstack@keystone.service[81720]: WARNING py.warnings [None req-8c36e51e-418f-4db1-b2f1-575b9209a991 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 05 12:13:21.293721 dv-cinder-855189-1-smb devstack@keystone.service[81720]: warnings.warn(msg) Sep 05 12:13:21.293721 dv-cinder-855189-1-smb devstack@keystone.service[81720]: Sep 05 12:13:21.295502 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c36e51e-418f-4db1-b2f1-575b9209a991 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:13:21.305370 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:13:21.362187 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-8c36e51e-418f-4db1-b2f1-575b9209a991 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bee1528949c04008a2b5d8dde7309c86'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:13:21.362633 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-8c36e51e-418f-4db1-b2f1-575b9209a991 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bee1528949c04008a2b5d8dde7309c86'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:13:21.372418 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-8c36e51e-418f-4db1-b2f1-575b9209a991 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bee1528949c04008a2b5d8dde7309c86'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:13:21.372950 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-8c36e51e-418f-4db1-b2f1-575b9209a991 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bee1528949c04008a2b5d8dde7309c86'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:13:21.397064 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-8c36e51e-418f-4db1-b2f1-575b9209a991 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bee1528949c04008a2b5d8dde7309c86'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:13:21.415924 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 748/1507] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 5 12:13:21 2022] DELETE /identity/v3/users/bee1528949c04008a2b5d8dde7309c86 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:13:21.421092 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a4039-cb1d-4401-9537-ea6b6cc19888 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:21.421381 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a4039-cb1d-4401-9537-ea6b6cc19888 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:21.421655 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a4039-cb1d-4401-9537-ea6b6cc19888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:21.484925 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-286a4039-cb1d-4401-9537-ea6b6cc19888 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:13:21.486177 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-286a4039-cb1d-4401-9537-ea6b6cc19888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:13:21.562267 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:13:21.575932 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 760/1508] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:13:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:13:21.586033 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c36e51e-418f-4db1-b2f1-575b9209a991 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:13:21.587265 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-8c36e51e-418f-4db1-b2f1-575b9209a991 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:13:21.687442 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c36e51e-418f-4db1-b2f1-575b9209a991 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:13:21.744036 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:13:21.767333 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d8f17e-5bff-4e4e-b172-b6f4f0f31c84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4994b4faa4ec4aa088f3dc32c9c5614d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:13:21.767937 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d8f17e-5bff-4e4e-b172-b6f4f0f31c84 service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:21.768238 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d8f17e-5bff-4e4e-b172-b6f4f0f31c84 service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:21.768507 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d8f17e-5bff-4e4e-b172-b6f4f0f31c84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:21.770463 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-91d8f17e-5bff-4e4e-b172-b6f4f0f31c84 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:13:21.879900 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d8f17e-5bff-4e4e-b172-b6f4f0f31c84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:13:21.881369 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d8f17e-5bff-4e4e-b172-b6f4f0f31c84 service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:13:21.900111 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 749/1509] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:13:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:13:22.267914 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286a4039-cb1d-4401-9537-ea6b6cc19888 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:13:22.269512 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-286a4039-cb1d-4401-9537-ea6b6cc19888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:13:22.281336 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286a4039-cb1d-4401-9537-ea6b6cc19888 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:13:22.386539 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e874a6-c8e8-4497-bf26-17171a518a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:13:22.387167 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e874a6-c8e8-4497-bf26-17171a518a14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:13:22.387443 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e874a6-c8e8-4497-bf26-17171a518a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:13:22.387749 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e874a6-c8e8-4497-bf26-17171a518a14 admin admin] PATH_INFO: `/v3/projects/13c116eb619a4059998c4255fa8f6cad` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:13:22.398460 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e874a6-c8e8-4497-bf26-17171a518a14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13c116eb619a4059998c4255fa8f6cad)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:13:22.399408 dv-cinder-855189-1-smb devstack@keystone.service[81719]: WARNING py.warnings [None req-79e874a6-c8e8-4497-bf26-17171a518a14 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 05 12:13:22.399408 dv-cinder-855189-1-smb devstack@keystone.service[81719]: warnings.warn(msg) Sep 05 12:13:22.399408 dv-cinder-855189-1-smb devstack@keystone.service[81719]: Sep 05 12:13:22.400604 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e874a6-c8e8-4497-bf26-17171a518a14 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:13:22.462602 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-79e874a6-c8e8-4497-bf26-17171a518a14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13c116eb619a4059998c4255fa8f6cad', 'request_id': 'req-79e874a6-c8e8-4497-bf26-17171a518a14'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:13:22.473400 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-79e874a6-c8e8-4497-bf26-17171a518a14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13c116eb619a4059998c4255fa8f6cad', 'request_id': 'req-79e874a6-c8e8-4497-bf26-17171a518a14'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:13:22.480020 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-79e874a6-c8e8-4497-bf26-17171a518a14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13c116eb619a4059998c4255fa8f6cad', 'request_id': 'req-79e874a6-c8e8-4497-bf26-17171a518a14'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:13:22.512294 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-79e874a6-c8e8-4497-bf26-17171a518a14 admin admin] The token cache is being invalidate because project 13c116eb619a4059998c4255fa8f6cad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:13:22.512576 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-79e874a6-c8e8-4497-bf26-17171a518a14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:13:22.513075 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-79e874a6-c8e8-4497-bf26-17171a518a14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:13:22.514503 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 761/1510] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 5 12:13:22 2022] DELETE /identity/v3/projects/13c116eb619a4059998c4255fa8f6cad => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:13:31.897930 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=62 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:13:32.510087 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:14:59.378285 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb59d09e-5a2f-46d1-a366-575e9b3a96f5 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:14:59.378900 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb59d09e-5a2f-46d1-a366-575e9b3a96f5 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:14:59.378900 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb59d09e-5a2f-46d1-a366-575e9b3a96f5 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:14:59.380171 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 750/1511] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 5 12:14:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:14:59.385472 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d097ef-0a43-43b7-b1ef-91e07c0a6d8f None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:14:59.385917 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d097ef-0a43-43b7-b1ef-91e07c0a6d8f None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:14:59.386014 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d097ef-0a43-43b7-b1ef-91e07c0a6d8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:14:59.469679 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-c0d097ef-0a43-43b7-b1ef-91e07c0a6d8f None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:14:59.470947 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-c0d097ef-0a43-43b7-b1ef-91e07c0a6d8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:14:59.581392 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 762/1512] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 5 12:14:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:14:59.736532 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb59d09e-5a2f-46d1-a366-575e9b3a96f5 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:14:59.738833 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-bb59d09e-5a2f-46d1-a366-575e9b3a96f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:14:59.862584 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb59d09e-5a2f-46d1-a366-575e9b3a96f5 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:14:59.868391 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b786c8d-9015-4d60-858d-5ca19b83ed9a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb060ff495bc4abb83ff88992fb7be09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:14:59.869039 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b786c8d-9015-4d60-858d-5ca19b83ed9a service nova] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:14:59.869324 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b786c8d-9015-4d60-858d-5ca19b83ed9a service nova] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:14:59.869603 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b786c8d-9015-4d60-858d-5ca19b83ed9a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:14:59.878131 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b786c8d-9015-4d60-858d-5ca19b83ed9a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:14:59.879733 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b786c8d-9015-4d60-858d-5ca19b83ed9a service nova] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:14:59.889897 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 751/1513] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:14:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:15:00.730921 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52982a68-2fac-4b77-b7db-a052c99b10c6 None None] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:15:00.731466 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52982a68-2fac-4b77-b7db-a052c99b10c6 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:15:00.731466 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52982a68-2fac-4b77-b7db-a052c99b10c6 None None] PATH_INFO: `/` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:15:00.732729 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 763/1514] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 5 12:15:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:15:00.737642 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e998db3e-5db0-4bae-9c49-ea5fcaf2391a None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:15:00.738101 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e998db3e-5db0-4bae-9c49-ea5fcaf2391a None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:15:00.738252 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e998db3e-5db0-4bae-9c49-ea5fcaf2391a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:15:00.759280 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-e998db3e-5db0-4bae-9c49-ea5fcaf2391a None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:15:00.760510 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-e998db3e-5db0-4bae-9c49-ea5fcaf2391a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:15:00.768653 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 752/1515] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 5 12:15:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:15:00.921804 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52982a68-2fac-4b77-b7db-a052c99b10c6 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:15:00.938561 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52982a68-2fac-4b77-b7db-a052c99b10c6 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:15:00.943889 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83534f99-53d9-4170-925d-bbbc5b0a6c50 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb060ff495bc4abb83ff88992fb7be09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:15:00.944483 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83534f99-53d9-4170-925d-bbbc5b0a6c50 service nova] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:15:00.944760 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83534f99-53d9-4170-925d-bbbc5b0a6c50 service nova] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:15:00.945062 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83534f99-53d9-4170-925d-bbbc5b0a6c50 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:15:00.953148 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83534f99-53d9-4170-925d-bbbc5b0a6c50 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:15:00.954728 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83534f99-53d9-4170-925d-bbbc5b0a6c50 service nova] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:15:00.964011 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 764/1516] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:15:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:15:01.523835 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d9445c-3697-46a1-b16a-0dea519288b0 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:15:01.524129 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d9445c-3697-46a1-b16a-0dea519288b0 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:15:01.524424 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d9445c-3697-46a1-b16a-0dea519288b0 None None] PATH_INFO: `/v3` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:15:01.525886 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 753/1517] 10.222.0.26 () {54 vars in 925 bytes} [Mon Sep 5 12:15:01 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:15:01.532439 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ea5b97-44c0-481b-985d-48c81afad982 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:15:01.532721 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ea5b97-44c0-481b-985d-48c81afad982 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:15:01.533019 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ea5b97-44c0-481b-985d-48c81afad982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:15:01.592169 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-41ea5b97-44c0-481b-985d-48c81afad982 None None] MFA Rules not processed for user `c5427d0752de4817b6aa25e28c2d9a30`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:15:01.593398 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-41ea5b97-44c0-481b-985d-48c81afad982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:15:01.609746 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:15:01.663687 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 765/1518] 10.222.0.26 () {58 vars in 1015 bytes} [Mon Sep 5 12:15:01 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:15:05.473281 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17611878-c4f0-4ab2-a2db-c15ea826cd70 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:15:05.473793 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17611878-c4f0-4ab2-a2db-c15ea826cd70 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:15:05.473793 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17611878-c4f0-4ab2-a2db-c15ea826cd70 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:15:05.475133 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 754/1519] 10.222.0.50 () {54 vars in 961 bytes} [Mon Sep 5 12:15:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:15:05.480643 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa720736-eee7-4e63-9b88-10e320697242 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:15:05.481103 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa720736-eee7-4e63-9b88-10e320697242 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:15:05.481234 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa720736-eee7-4e63-9b88-10e320697242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:15:05.500552 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-fa720736-eee7-4e63-9b88-10e320697242 None None] MFA Rules not processed for user `c5427d0752de4817b6aa25e28c2d9a30`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:15:05.501831 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-fa720736-eee7-4e63-9b88-10e320697242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:15:05.510421 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 766/1520] 10.222.0.50 () {58 vars in 1058 bytes} [Mon Sep 5 12:15:05 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:15:05.518326 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17611878-c4f0-4ab2-a2db-c15ea826cd70 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:15:05.532109 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17611878-c4f0-4ab2-a2db-c15ea826cd70 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:15:05.537544 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c2f381-c0f2-4a78-baa5-9325a9cfddcb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5427d0752de4817b6aa25e28c2d9a30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:15:05.538394 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c2f381-c0f2-4a78-baa5-9325a9cfddcb service placement] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:15:05.538794 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c2f381-c0f2-4a78-baa5-9325a9cfddcb service placement] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:15:05.539067 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c2f381-c0f2-4a78-baa5-9325a9cfddcb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:15:05.548290 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c2f381-c0f2-4a78-baa5-9325a9cfddcb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:15:05.549918 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c2f381-c0f2-4a78-baa5-9325a9cfddcb service placement] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:15:05.559319 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 755/1521] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:15:05 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:15:12.332185 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7748d19f-3edb-463e-9235-ad2f214f4e83 None None] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:15:12.332724 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7748d19f-3edb-463e-9235-ad2f214f4e83 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:15:12.332724 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7748d19f-3edb-463e-9235-ad2f214f4e83 None None] PATH_INFO: `/` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:15:12.334169 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 767/1522] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 5 12:15:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:15:12.340148 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30db3264-3b30-4335-ad97-4043dc42d761 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:15:12.341126 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30db3264-3b30-4335-ad97-4043dc42d761 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:15:12.341432 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30db3264-3b30-4335-ad97-4043dc42d761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:15:12.364263 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-30db3264-3b30-4335-ad97-4043dc42d761 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:15:12.365548 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-30db3264-3b30-4335-ad97-4043dc42d761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:15:12.375371 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 756/1523] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 5 12:15:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:15:12.530309 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7748d19f-3edb-463e-9235-ad2f214f4e83 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:15:12.544624 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7748d19f-3edb-463e-9235-ad2f214f4e83 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:15:12.550067 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507dcf4b-35d2-4df6-a8d1-b9d03d27714c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb060ff495bc4abb83ff88992fb7be09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:15:12.550656 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507dcf4b-35d2-4df6-a8d1-b9d03d27714c service nova] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:15:12.550935 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507dcf4b-35d2-4df6-a8d1-b9d03d27714c service nova] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:15:12.551208 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507dcf4b-35d2-4df6-a8d1-b9d03d27714c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:15:12.559763 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507dcf4b-35d2-4df6-a8d1-b9d03d27714c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:15:12.561407 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507dcf4b-35d2-4df6-a8d1-b9d03d27714c service nova] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:15:12.571055 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 768/1524] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:15:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:15:13.399271 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c067c3c-c1c3-4e1b-babb-e192a5434cc3 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:15:13.399844 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c067c3c-c1c3-4e1b-babb-e192a5434cc3 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:15:13.399844 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c067c3c-c1c3-4e1b-babb-e192a5434cc3 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:15:13.401223 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 757/1525] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 5 12:15:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:15:13.406358 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d867425-38e1-4e13-a83f-408004a63cae None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:15:13.406879 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d867425-38e1-4e13-a83f-408004a63cae None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:15:13.406879 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d867425-38e1-4e13-a83f-408004a63cae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:15:13.427052 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-1d867425-38e1-4e13-a83f-408004a63cae None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:15:13.428277 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-1d867425-38e1-4e13-a83f-408004a63cae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:15:13.437263 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 769/1526] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 5 12:15:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:15:13.588371 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c067c3c-c1c3-4e1b-babb-e192a5434cc3 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:15:13.603612 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c067c3c-c1c3-4e1b-babb-e192a5434cc3 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:15:13.609793 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484dc7ea-bd9b-44ad-a57f-e13074b65166 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb060ff495bc4abb83ff88992fb7be09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:15:13.610395 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484dc7ea-bd9b-44ad-a57f-e13074b65166 service nova] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:15:13.610672 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484dc7ea-bd9b-44ad-a57f-e13074b65166 service nova] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:15:13.610945 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484dc7ea-bd9b-44ad-a57f-e13074b65166 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:15:13.619385 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484dc7ea-bd9b-44ad-a57f-e13074b65166 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:15:13.621035 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484dc7ea-bd9b-44ad-a57f-e13074b65166 service nova] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:15:13.630376 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 758/1527] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:15:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:15:17.585246 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad9cc9f-a977-4926-81c6-6bbd59115fda None None] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:15:17.585855 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad9cc9f-a977-4926-81c6-6bbd59115fda None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:15:17.585855 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad9cc9f-a977-4926-81c6-6bbd59115fda None None] PATH_INFO: `/` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:15:17.587168 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 770/1528] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 5 12:15:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:15:17.592361 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31da411a-bae6-4757-b51c-d381895adca1 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:15:17.592814 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31da411a-bae6-4757-b51c-d381895adca1 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:15:17.592948 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31da411a-bae6-4757-b51c-d381895adca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:15:17.612377 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-31da411a-bae6-4757-b51c-d381895adca1 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:15:17.613609 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-31da411a-bae6-4757-b51c-d381895adca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:15:17.621959 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 759/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 5 12:15:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:15:17.906405 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad9cc9f-a977-4926-81c6-6bbd59115fda None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:15:17.908148 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-bad9cc9f-a977-4926-81c6-6bbd59115fda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:15:17.992845 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad9cc9f-a977-4926-81c6-6bbd59115fda None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:15:17.997025 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8bb07c-fffe-42d1-a658-53262c63fc04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4994b4faa4ec4aa088f3dc32c9c5614d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:15:17.997629 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8bb07c-fffe-42d1-a658-53262c63fc04 service neutron] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:15:17.997906 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8bb07c-fffe-42d1-a658-53262c63fc04 service neutron] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:15:17.998178 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8bb07c-fffe-42d1-a658-53262c63fc04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:15:18.007475 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8bb07c-fffe-42d1-a658-53262c63fc04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:15:18.008973 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8bb07c-fffe-42d1-a658-53262c63fc04 service neutron] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:15:18.020012 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 771/1530] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:15:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:15:19.907003 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c062e5f-8caa-49bf-bb26-a09d60c4203e None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:15:19.907559 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c062e5f-8caa-49bf-bb26-a09d60c4203e None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:15:19.907559 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c062e5f-8caa-49bf-bb26-a09d60c4203e None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:15:19.908915 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 760/1531] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 5 12:15:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:15:19.914309 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eb21fb-fe08-4b99-bb3a-f949fa431b9d None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:15:19.914760 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eb21fb-fe08-4b99-bb3a-f949fa431b9d None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:15:19.914863 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eb21fb-fe08-4b99-bb3a-f949fa431b9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:15:19.935130 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-f3eb21fb-fe08-4b99-bb3a-f949fa431b9d None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:15:19.936335 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-f3eb21fb-fe08-4b99-bb3a-f949fa431b9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:15:19.944347 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 772/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 5 12:15:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:15:20.232298 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c062e5f-8caa-49bf-bb26-a09d60c4203e None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:15:20.234446 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-0c062e5f-8caa-49bf-bb26-a09d60c4203e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:15:20.248310 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c062e5f-8caa-49bf-bb26-a09d60c4203e None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:15:20.251946 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c191e59-1b16-41a8-9d19-3fd078d0bdec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4994b4faa4ec4aa088f3dc32c9c5614d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:15:20.252552 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c191e59-1b16-41a8-9d19-3fd078d0bdec service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:15:20.252827 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c191e59-1b16-41a8-9d19-3fd078d0bdec service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:15:20.253126 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c191e59-1b16-41a8-9d19-3fd078d0bdec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:15:20.262149 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c191e59-1b16-41a8-9d19-3fd078d0bdec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:15:20.263579 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c191e59-1b16-41a8-9d19-3fd078d0bdec service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:15:20.273131 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 761/1533] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:15:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:15:23.760424 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d01495-bc3e-47fb-b763-25f4c56bbfa6 None None] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:15:23.761202 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d01495-bc3e-47fb-b763-25f4c56bbfa6 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:15:23.761202 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d01495-bc3e-47fb-b763-25f4c56bbfa6 None None] PATH_INFO: `/` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:15:23.762395 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 773/1534] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 5 12:15:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:15:23.768028 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945c6881-782a-47fd-8971-9614ce006491 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:15:23.768473 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945c6881-782a-47fd-8971-9614ce006491 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:15:23.768573 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945c6881-782a-47fd-8971-9614ce006491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:15:23.776289 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=81 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:15:23.789887 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-945c6881-782a-47fd-8971-9614ce006491 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:15:23.791099 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-945c6881-782a-47fd-8971-9614ce006491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:15:23.799466 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 762/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 5 12:15:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:15:24.371019 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d01495-bc3e-47fb-b763-25f4c56bbfa6 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:15:24.372712 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-65d01495-bc3e-47fb-b763-25f4c56bbfa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:15:24.441231 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:15:24.454788 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d01495-bc3e-47fb-b763-25f4c56bbfa6 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:15:24.458403 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2df0bdf-83ab-4885-bf6b-e350ab2b55cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37633bbae0c2423c81ccd61ac3a17ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:15:24.459006 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2df0bdf-83ab-4885-bf6b-e350ab2b55cf service cinder] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:15:24.459283 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2df0bdf-83ab-4885-bf6b-e350ab2b55cf service cinder] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:15:24.459556 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2df0bdf-83ab-4885-bf6b-e350ab2b55cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:15:24.469259 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2df0bdf-83ab-4885-bf6b-e350ab2b55cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:15:24.470696 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2df0bdf-83ab-4885-bf6b-e350ab2b55cf service cinder] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:15:24.480948 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 774/1536] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:15:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:15:26.421714 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b011d17a-7605-4185-bf5d-62ad69de0c3e None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:15:26.422272 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b011d17a-7605-4185-bf5d-62ad69de0c3e None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:15:26.422272 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b011d17a-7605-4185-bf5d-62ad69de0c3e None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:15:26.423624 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 763/1537] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 5 12:15:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:15:26.428682 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56a14df-993b-449c-8cc2-fc257c8c3191 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:15:26.429138 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56a14df-993b-449c-8cc2-fc257c8c3191 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:15:26.429273 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56a14df-993b-449c-8cc2-fc257c8c3191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:15:26.449768 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-e56a14df-993b-449c-8cc2-fc257c8c3191 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:15:26.450960 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-e56a14df-993b-449c-8cc2-fc257c8c3191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:15:26.458737 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 775/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 5 12:15:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:15:27.005616 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b011d17a-7605-4185-bf5d-62ad69de0c3e None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:15:27.007290 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-b011d17a-7605-4185-bf5d-62ad69de0c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:15:27.020457 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b011d17a-7605-4185-bf5d-62ad69de0c3e None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:15:27.023909 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f097003-5e59-4271-8b79-d5cb865c6efb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37633bbae0c2423c81ccd61ac3a17ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:15:27.024500 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f097003-5e59-4271-8b79-d5cb865c6efb service cinder] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:15:27.024778 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f097003-5e59-4271-8b79-d5cb865c6efb service cinder] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:15:27.025096 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f097003-5e59-4271-8b79-d5cb865c6efb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:15:27.033918 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f097003-5e59-4271-8b79-d5cb865c6efb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:15:27.035344 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f097003-5e59-4271-8b79-d5cb865c6efb service cinder] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:15:27.045292 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 764/1539] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:15:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:15:36.444264 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=11 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:15:37.040656 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=8 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:16:53.884959 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904c0d04-a313-4c66-850d-a0ef8b4bc5b8 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:16:53.887129 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904c0d04-a313-4c66-850d-a0ef8b4bc5b8 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:16:53.887129 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904c0d04-a313-4c66-850d-a0ef8b4bc5b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:16:53.910857 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-904c0d04-a313-4c66-850d-a0ef8b4bc5b8 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:16:53.912885 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-904c0d04-a313-4c66-850d-a0ef8b4bc5b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:16:53.952859 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 776/1540] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:16:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:16:53.969891 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046203f7-4b76-46e2-ab11-a53ce32b49d1 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:16:53.970825 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046203f7-4b76-46e2-ab11-a53ce32b49d1 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:16:53.970825 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046203f7-4b76-46e2-ab11-a53ce32b49d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:16:53.999390 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-046203f7-4b76-46e2-ab11-a53ce32b49d1 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:16:54.000622 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-046203f7-4b76-46e2-ab11-a53ce32b49d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:16:54.005965 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d030ab5a-421d-41c6-bfcf-2783e3137185 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:16:54.006863 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d030ab5a-421d-41c6-bfcf-2783e3137185 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:16:54.007637 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d030ab5a-421d-41c6-bfcf-2783e3137185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:16:54.017459 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 765/1541] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:16:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:16:54.026137 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046203f7-4b76-46e2-ab11-a53ce32b49d1 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:16:54.044990 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046203f7-4b76-46e2-ab11-a53ce32b49d1 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:16:54.055182 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5986705b-eb24-4154-930b-364e8636ad22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:16:54.055834 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5986705b-eb24-4154-930b-364e8636ad22 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:16:54.056109 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5986705b-eb24-4154-930b-364e8636ad22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:16:54.056384 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5986705b-eb24-4154-930b-364e8636ad22 admin admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:16:54.057077 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5986705b-eb24-4154-930b-364e8636ad22 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:16:54.057380 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5986705b-eb24-4154-930b-364e8636ad22 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:16:54.058414 dv-cinder-855189-1-smb devstack@keystone.service[81720]: WARNING py.warnings [None req-5986705b-eb24-4154-930b-364e8636ad22 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 05 12:16:54.058414 dv-cinder-855189-1-smb devstack@keystone.service[81720]: warnings.warn(msg) Sep 05 12:16:54.058414 dv-cinder-855189-1-smb devstack@keystone.service[81720]: Sep 05 12:16:54.059346 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5986705b-eb24-4154-930b-364e8636ad22 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:16:54.088304 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-d030ab5a-421d-41c6-bfcf-2783e3137185 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:16:54.093760 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 766/1542] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Sep 5 12:16:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:16:54.095954 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92796471-961e-441d-977b-95461b5bd96f None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:16:54.096442 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92796471-961e-441d-977b-95461b5bd96f None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:16:54.103858 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-d030ab5a-421d-41c6-bfcf-2783e3137185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:16:54.105521 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92796471-961e-441d-977b-95461b5bd96f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:16:54.130260 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 777/1543] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:16:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:16:54.133937 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b365568-fe15-48bd-b362-6edba1f012f9 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:16:54.134271 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b365568-fe15-48bd-b362-6edba1f012f9 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:16:54.134623 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b365568-fe15-48bd-b362-6edba1f012f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:16:54.147058 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-92796471-961e-441d-977b-95461b5bd96f None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:16:54.148357 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-92796471-961e-441d-977b-95461b5bd96f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:16:54.157206 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 767/1544] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:16:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:16:54.157570 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-8b365568-fe15-48bd-b362-6edba1f012f9 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:16:54.158480 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc067e1-cf57-4a83-8e71-51f15a24a1f7 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:16:54.158769 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc067e1-cf57-4a83-8e71-51f15a24a1f7 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:16:54.158880 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-8b365568-fe15-48bd-b362-6edba1f012f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:16:54.159045 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc067e1-cf57-4a83-8e71-51f15a24a1f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:16:54.179841 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 778/1545] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:16:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:16:54.183841 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335fd31e-15cd-461c-90a1-aefcd0c2c1fd None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:16:54.183841 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335fd31e-15cd-461c-90a1-aefcd0c2c1fd None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:16:54.184134 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-acc067e1-cf57-4a83-8e71-51f15a24a1f7 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:16:54.184243 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335fd31e-15cd-461c-90a1-aefcd0c2c1fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:16:54.184327 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-acc067e1-cf57-4a83-8e71-51f15a24a1f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:16:54.192294 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 768/1546] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:16:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:16:54.193028 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc067e1-cf57-4a83-8e71-51f15a24a1f7 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:16:54.204984 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc067e1-cf57-4a83-8e71-51f15a24a1f7 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:16:54.205551 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-335fd31e-15cd-461c-90a1-aefcd0c2c1fd None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:16:54.207008 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-335fd31e-15cd-461c-90a1-aefcd0c2c1fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:16:54.209890 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08895b62-0b92-4cd4-8924-2f9ba8bfef44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:16:54.210507 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08895b62-0b92-4cd4-8924-2f9ba8bfef44 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:16:54.210788 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08895b62-0b92-4cd4-8924-2f9ba8bfef44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:16:54.211052 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08895b62-0b92-4cd4-8924-2f9ba8bfef44 admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:16:54.211691 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08895b62-0b92-4cd4-8924-2f9ba8bfef44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:16:54.213958 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08895b62-0b92-4cd4-8924-2f9ba8bfef44 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:16:54.223162 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 779/1547] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:16:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:16:54.223162 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ccf4c6-0869-487c-966b-3572b4e2f8b6 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:16:54.223162 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ccf4c6-0869-487c-966b-3572b4e2f8b6 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:16:54.223162 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ccf4c6-0869-487c-966b-3572b4e2f8b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:16:54.249975 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-57ccf4c6-0869-487c-966b-3572b4e2f8b6 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:16:54.251497 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-57ccf4c6-0869-487c-966b-3572b4e2f8b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:16:54.260459 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 780/1548] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:16:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:16:54.261904 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a999ff-ddfd-4e4c-9a81-9629f80f1cc1 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:16:54.262049 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a999ff-ddfd-4e4c-9a81-9629f80f1cc1 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:16:54.262359 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a999ff-ddfd-4e4c-9a81-9629f80f1cc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:16:54.272004 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 769/1549] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 5 12:16:54 2022] POST /identity/v3/projects => generated 385 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:16:54.276980 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f33c7c-95c7-4931-9d07-f16a47698679 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:16:54.277572 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f33c7c-95c7-4931-9d07-f16a47698679 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:16:54.278522 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f33c7c-95c7-4931-9d07-f16a47698679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:16:54.289383 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-e3a999ff-ddfd-4e4c-9a81-9629f80f1cc1 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:16:54.290768 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-e3a999ff-ddfd-4e4c-9a81-9629f80f1cc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:16:54.302622 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-33f33c7c-95c7-4931-9d07-f16a47698679 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:16:54.303772 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-33f33c7c-95c7-4931-9d07-f16a47698679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:16:54.357694 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 781/1550] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:16:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:16:54.359049 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98833fd1-c439-46d8-a559-b1575200197e None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:16:54.359340 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98833fd1-c439-46d8-a559-b1575200197e None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:16:54.359596 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98833fd1-c439-46d8-a559-b1575200197e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:16:54.377350 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 770/1551] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:16:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:16:54.378723 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6122eebf-7579-40b1-b2d3-c483899c2913 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:16:54.379004 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6122eebf-7579-40b1-b2d3-c483899c2913 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:16:54.379276 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6122eebf-7579-40b1-b2d3-c483899c2913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:16:54.384388 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-98833fd1-c439-46d8-a559-b1575200197e None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:16:54.385917 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-98833fd1-c439-46d8-a559-b1575200197e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:16:54.395545 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 782/1552] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:16:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:16:54.396882 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08904f1e-e9a9-405b-bae0-0f98f497e7b7 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:16:54.397194 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08904f1e-e9a9-405b-bae0-0f98f497e7b7 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:16:54.397466 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08904f1e-e9a9-405b-bae0-0f98f497e7b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:16:54.404495 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-6122eebf-7579-40b1-b2d3-c483899c2913 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:16:54.405764 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-6122eebf-7579-40b1-b2d3-c483899c2913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:16:54.414238 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 771/1553] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:16:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:16:54.415516 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32204da-5a6a-4bf2-ad21-f0e8cf4d0499 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:16:54.415804 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32204da-5a6a-4bf2-ad21-f0e8cf4d0499 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:16:54.416070 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32204da-5a6a-4bf2-ad21-f0e8cf4d0499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:16:54.421291 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-08904f1e-e9a9-405b-bae0-0f98f497e7b7 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:16:54.422430 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-08904f1e-e9a9-405b-bae0-0f98f497e7b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:16:54.435256 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 783/1554] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:16:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:16:54.436033 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-f32204da-5a6a-4bf2-ad21-f0e8cf4d0499 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:16:54.436326 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f445cbe-b844-4451-8fd8-be530ff3942d None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:16:54.436606 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f445cbe-b844-4451-8fd8-be530ff3942d None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:16:54.436921 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f445cbe-b844-4451-8fd8-be530ff3942d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:16:54.437288 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-f32204da-5a6a-4bf2-ad21-f0e8cf4d0499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:16:54.446458 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 772/1555] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:16:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:16:54.447360 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32204da-5a6a-4bf2-ad21-f0e8cf4d0499 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:16:54.457315 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32204da-5a6a-4bf2-ad21-f0e8cf4d0499 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:16:54.457918 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-4f445cbe-b844-4451-8fd8-be530ff3942d None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:16:54.459131 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-4f445cbe-b844-4451-8fd8-be530ff3942d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:16:54.462698 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd8cbd8-eba7-4e33-9659-7326f63c7679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:16:54.463321 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd8cbd8-eba7-4e33-9659-7326f63c7679 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:16:54.463627 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd8cbd8-eba7-4e33-9659-7326f63c7679 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:16:54.463881 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd8cbd8-eba7-4e33-9659-7326f63c7679 admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:16:54.464550 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd8cbd8-eba7-4e33-9659-7326f63c7679 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:16:54.466245 dv-cinder-855189-1-smb devstack@keystone.service[81720]: WARNING py.warnings [None req-afd8cbd8-eba7-4e33-9659-7326f63c7679 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 05 12:16:54.466245 dv-cinder-855189-1-smb devstack@keystone.service[81720]: warnings.warn(msg) Sep 05 12:16:54.466245 dv-cinder-855189-1-smb devstack@keystone.service[81720]: Sep 05 12:16:54.467454 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd8cbd8-eba7-4e33-9659-7326f63c7679 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:16:54.467650 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 784/1556] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:16:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:16:54.468750 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f445cbe-b844-4451-8fd8-be530ff3942d None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:16:54.478335 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f445cbe-b844-4451-8fd8-be530ff3942d None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:16:54.483277 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e9597b-caff-44c6-be7d-23c8638346a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:16:54.483892 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e9597b-caff-44c6-be7d-23c8638346a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:16:54.484173 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e9597b-caff-44c6-be7d-23c8638346a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:16:54.484449 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e9597b-caff-44c6-be7d-23c8638346a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:16:54.485161 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e9597b-caff-44c6-be7d-23c8638346a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:16:54.485464 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e9597b-caff-44c6-be7d-23c8638346a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:16:54.487068 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e9597b-caff-44c6-be7d-23c8638346a1 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:16:54.492928 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 773/1557] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 5 12:16:54 2022] POST /identity/v3/users => generated 293 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:16:54.492928 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd8cbd8-eba7-4e33-9659-7326f63c7679 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:16:54.500076 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 785/1558] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Sep 5 12:16:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:16:54.501198 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e9597b-caff-44c6-be7d-23c8638346a1 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:16:54.501343 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd8cbd8-eba7-4e33-9659-7326f63c7679 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:16:54.512777 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b34240-05f4-42f3-900a-e4575bce2ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:16:54.513532 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b34240-05f4-42f3-900a-e4575bce2ed5 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:16:54.513817 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b34240-05f4-42f3-900a-e4575bce2ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:16:54.514156 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b34240-05f4-42f3-900a-e4575bce2ed5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:16:54.514870 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b34240-05f4-42f3-900a-e4575bce2ed5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:16:54.515252 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b34240-05f4-42f3-900a-e4575bce2ed5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:16:54.517510 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b34240-05f4-42f3-900a-e4575bce2ed5 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:16:54.519949 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e9597b-caff-44c6-be7d-23c8638346a1 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:16:54.524830 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c275079-92f1-4ce5-859e-ae7eea58feff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:16:54.525490 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c275079-92f1-4ce5-859e-ae7eea58feff admin admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:16:54.525754 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c275079-92f1-4ce5-859e-ae7eea58feff admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:16:54.526030 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c275079-92f1-4ce5-859e-ae7eea58feff admin admin] PATH_INFO: `/v3/domains` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:16:54.526839 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c275079-92f1-4ce5-859e-ae7eea58feff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:16:54.527148 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c275079-92f1-4ce5-859e-ae7eea58feff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:16:54.529325 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c275079-92f1-4ce5-859e-ae7eea58feff admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:16:54.530701 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 774/1559] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Sep 5 12:16:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:16:54.531613 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b34240-05f4-42f3-900a-e4575bce2ed5 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:16:54.541185 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b34240-05f4-42f3-900a-e4575bce2ed5 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:16:54.546271 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c5e27e-0817-4825-8bcb-ffa48b1030f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:16:54.546889 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 786/1560] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Sep 5 12:16:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:16:54.547009 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c5e27e-0817-4825-8bcb-ffa48b1030f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:16:54.547230 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c5e27e-0817-4825-8bcb-ffa48b1030f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:16:54.547576 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c5e27e-0817-4825-8bcb-ffa48b1030f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:16:54.548070 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53d07bd-4be2-4974-9aad-a29640c68f59 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:16:54.548253 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c5e27e-0817-4825-8bcb-ffa48b1030f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:16:54.548374 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53d07bd-4be2-4974-9aad-a29640c68f59 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:16:54.548536 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c5e27e-0817-4825-8bcb-ffa48b1030f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:16:54.548642 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53d07bd-4be2-4974-9aad-a29640c68f59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:16:54.550151 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c5e27e-0817-4825-8bcb-ffa48b1030f3 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:16:54.568031 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 775/1561] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Sep 5 12:16:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:16:54.568404 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-a53d07bd-4be2-4974-9aad-a29640c68f59 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:16:54.569821 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c5e27e-0817-4825-8bcb-ffa48b1030f3 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:16:54.570901 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-a53d07bd-4be2-4974-9aad-a29640c68f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:16:54.579559 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 787/1562] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:16:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:16:54.580419 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53d07bd-4be2-4974-9aad-a29640c68f59 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:16:54.580546 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c5e27e-0817-4825-8bcb-ffa48b1030f3 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:16:54.585451 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c861b617-ebd4-42a2-8210-328fb62babaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:16:54.586061 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c861b617-ebd4-42a2-8210-328fb62babaa admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:16:54.586344 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c861b617-ebd4-42a2-8210-328fb62babaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:16:54.586621 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c861b617-ebd4-42a2-8210-328fb62babaa admin admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:16:54.587459 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c861b617-ebd4-42a2-8210-328fb62babaa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:16:54.587633 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c861b617-ebd4-42a2-8210-328fb62babaa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:16:54.589285 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c861b617-ebd4-42a2-8210-328fb62babaa admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:16:54.593991 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53d07bd-4be2-4974-9aad-a29640c68f59 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:16:54.598799 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b415dd6-2cc5-4302-b6f6-ef754da3de26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:16:54.599410 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b415dd6-2cc5-4302-b6f6-ef754da3de26 admin admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:16:54.599674 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b415dd6-2cc5-4302-b6f6-ef754da3de26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:16:54.599943 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b415dd6-2cc5-4302-b6f6-ef754da3de26 admin admin] PATH_INFO: `/v3/domains` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:16:54.600592 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b415dd6-2cc5-4302-b6f6-ef754da3de26 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:16:54.600918 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b415dd6-2cc5-4302-b6f6-ef754da3de26 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:16:54.602490 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 776/1563] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Sep 5 12:16:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:16:54.602632 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b415dd6-2cc5-4302-b6f6-ef754da3de26 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:16:54.604041 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c861b617-ebd4-42a2-8210-328fb62babaa admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:16:54.614240 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c861b617-ebd4-42a2-8210-328fb62babaa admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:16:54.618960 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a9e8f1-e4a1-4550-9e60-cb3171072d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:16:54.619552 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a9e8f1-e4a1-4550-9e60-cb3171072d2c admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:16:54.619832 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a9e8f1-e4a1-4550-9e60-cb3171072d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:16:54.620107 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a9e8f1-e4a1-4550-9e60-cb3171072d2c admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:16:54.627549 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 788/1564] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Sep 5 12:16:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:16:54.627747 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a9e8f1-e4a1-4550-9e60-cb3171072d2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:16:54.627853 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b415dd6-2cc5-4302-b6f6-ef754da3de26 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:16:54.627958 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a9e8f1-e4a1-4550-9e60-cb3171072d2c admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:16:54.633050 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 777/1565] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:16:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:16:54.633600 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b415dd6-2cc5-4302-b6f6-ef754da3de26 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:16:54.636667 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a9e8f1-e4a1-4550-9e60-cb3171072d2c admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:16:54.638969 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6986e5d7-3e4d-4ac7-a716-12f7ca2dd8d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:16:54.639575 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6986e5d7-3e4d-4ac7-a716-12f7ca2dd8d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:16:54.639851 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6986e5d7-3e4d-4ac7-a716-12f7ca2dd8d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:16:54.640168 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6986e5d7-3e4d-4ac7-a716-12f7ca2dd8d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:16:54.640749 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6986e5d7-3e4d-4ac7-a716-12f7ca2dd8d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:16:54.641796 dv-cinder-855189-1-smb devstack@keystone.service[81719]: WARNING py.warnings [None req-6986e5d7-3e4d-4ac7-a716-12f7ca2dd8d3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 05 12:16:54.641796 dv-cinder-855189-1-smb devstack@keystone.service[81719]: warnings.warn(msg) Sep 05 12:16:54.641796 dv-cinder-855189-1-smb devstack@keystone.service[81719]: Sep 05 12:16:54.643249 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6986e5d7-3e4d-4ac7-a716-12f7ca2dd8d3 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:16:54.647547 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a9e8f1-e4a1-4550-9e60-cb3171072d2c admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:16:54.652185 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f03c41-cb56-4a14-9309-0d01061569c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:16:54.652826 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f03c41-cb56-4a14-9309-0d01061569c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:16:54.653681 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f03c41-cb56-4a14-9309-0d01061569c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:16:54.653951 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f03c41-cb56-4a14-9309-0d01061569c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:16:54.654596 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f03c41-cb56-4a14-9309-0d01061569c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:16:54.656500 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f03c41-cb56-4a14-9309-0d01061569c6 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:16:54.673024 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:16:54.677989 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 789/1566] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 5 12:16:54 2022] POST /identity/v3/projects => generated 375 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:16:54.678990 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6986e5d7-3e4d-4ac7-a716-12f7ca2dd8d3 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:16:54.688268 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 778/1567] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 5 12:16:54 2022] POST /identity/v3/projects => generated 391 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:16:54.688915 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f03c41-cb56-4a14-9309-0d01061569c6 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:16:54.730066 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:16:54.752979 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6986e5d7-3e4d-4ac7-a716-12f7ca2dd8d3 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:16:54.757719 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f0f237-312e-4f47-80e0-bce3b2bbac2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:16:54.758339 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f0f237-312e-4f47-80e0-bce3b2bbac2b admin admin] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:16:54.758618 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f0f237-312e-4f47-80e0-bce3b2bbac2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:16:54.758887 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f0f237-312e-4f47-80e0-bce3b2bbac2b admin admin] PATH_INFO: `/v3/projects` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:16:54.759529 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f0f237-312e-4f47-80e0-bce3b2bbac2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:16:54.759780 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f03c41-cb56-4a14-9309-0d01061569c6 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:16:54.761556 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f0f237-312e-4f47-80e0-bce3b2bbac2b admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:16:54.765320 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fdcffe-aa1b-491c-98d8-3ba6dd010e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:16:54.765942 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fdcffe-aa1b-491c-98d8-3ba6dd010e39 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:16:54.766227 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fdcffe-aa1b-491c-98d8-3ba6dd010e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:16:54.766502 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fdcffe-aa1b-491c-98d8-3ba6dd010e39 admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:16:54.767397 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fdcffe-aa1b-491c-98d8-3ba6dd010e39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:16:54.769389 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fdcffe-aa1b-491c-98d8-3ba6dd010e39 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:16:54.798976 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 790/1568] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 5 12:16:54 2022] POST /identity/v3/projects => generated 365 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:16:54.800225 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f0f237-312e-4f47-80e0-bce3b2bbac2b admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:16:54.806550 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 779/1569] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 5 12:16:54 2022] POST /identity/v3/projects => generated 377 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:16:54.806550 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fdcffe-aa1b-491c-98d8-3ba6dd010e39 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:16:54.896259 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f0f237-312e-4f47-80e0-bce3b2bbac2b admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:16:54.903413 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faf49d4-3445-4ede-8ff6-e97f5e623c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:16:54.904378 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faf49d4-3445-4ede-8ff6-e97f5e623c33 admin admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:16:54.904802 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faf49d4-3445-4ede-8ff6-e97f5e623c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:16:54.905280 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faf49d4-3445-4ede-8ff6-e97f5e623c33 admin admin] PATH_INFO: `/v3/domains` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:16:54.906370 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faf49d4-3445-4ede-8ff6-e97f5e623c33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:16:54.906886 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faf49d4-3445-4ede-8ff6-e97f5e623c33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:16:54.908441 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fdcffe-aa1b-491c-98d8-3ba6dd010e39 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:16:54.909766 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faf49d4-3445-4ede-8ff6-e97f5e623c33 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:16:54.915335 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3c6911-2aa9-42f1-9725-0ab97250d941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:16:54.916281 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3c6911-2aa9-42f1-9725-0ab97250d941 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:16:54.916730 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3c6911-2aa9-42f1-9725-0ab97250d941 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:16:54.917215 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3c6911-2aa9-42f1-9725-0ab97250d941 admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:16:54.918278 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3c6911-2aa9-42f1-9725-0ab97250d941 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:16:54.921573 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3c6911-2aa9-42f1-9725-0ab97250d941 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:16:54.936500 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 791/1570] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Sep 5 12:16:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:16:54.936500 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faf49d4-3445-4ede-8ff6-e97f5e623c33 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:16:54.940370 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faf49d4-3445-4ede-8ff6-e97f5e623c33 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:16:54.944952 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64766226-f557-4515-9199-8379d964d73f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:16:54.945556 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64766226-f557-4515-9199-8379d964d73f admin admin] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:16:54.945834 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64766226-f557-4515-9199-8379d964d73f admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:16:54.946105 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64766226-f557-4515-9199-8379d964d73f admin admin] PATH_INFO: `/v3/projects` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:16:54.946739 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64766226-f557-4515-9199-8379d964d73f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:16:54.948654 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64766226-f557-4515-9199-8379d964d73f admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:16:54.965124 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 780/1571] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 5 12:16:54 2022] POST /identity/v3/projects => generated 385 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:16:54.966212 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3c6911-2aa9-42f1-9725-0ab97250d941 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:16:54.982165 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 792/1572] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 5 12:16:54 2022] POST /identity/v3/projects => generated 371 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:16:54.982165 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64766226-f557-4515-9199-8379d964d73f admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:16:55.034099 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3c6911-2aa9-42f1-9725-0ab97250d941 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:16:55.042059 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:16:55.046996 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64766226-f557-4515-9199-8379d964d73f admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:16:55.052034 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f2efdb-5cce-465a-9e7e-fdb909a29146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:16:55.052663 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f2efdb-5cce-465a-9e7e-fdb909a29146 admin admin] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:16:55.052976 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f2efdb-5cce-465a-9e7e-fdb909a29146 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:16:55.053249 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f2efdb-5cce-465a-9e7e-fdb909a29146 admin admin] PATH_INFO: `/v3/users` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:16:55.053886 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f2efdb-5cce-465a-9e7e-fdb909a29146 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:16:55.056058 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f2efdb-5cce-465a-9e7e-fdb909a29146 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:16:55.081764 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 793/1573] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 5 12:16:54 2022] POST /identity/v3/users => generated 288 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:16:55.081764 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f2efdb-5cce-465a-9e7e-fdb909a29146 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:16:55.089458 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f2efdb-5cce-465a-9e7e-fdb909a29146 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:16:55.094118 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f96cfd-cf32-47aa-814f-abdf2605fa57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:16:55.094315 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf27c79b-092d-4502-95e9-60892120a7e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:16:55.094870 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f96cfd-cf32-47aa-814f-abdf2605fa57 admin admin] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:16:55.095024 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf27c79b-092d-4502-95e9-60892120a7e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:16:55.095024 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf27c79b-092d-4502-95e9-60892120a7e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:16:55.095282 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f96cfd-cf32-47aa-814f-abdf2605fa57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:16:55.095372 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf27c79b-092d-4502-95e9-60892120a7e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:16:55.095504 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f96cfd-cf32-47aa-814f-abdf2605fa57 admin admin] PATH_INFO: `/v3/users` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:16:55.095928 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf27c79b-092d-4502-95e9-60892120a7e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:16:55.096121 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f96cfd-cf32-47aa-814f-abdf2605fa57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:16:55.097551 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf27c79b-092d-4502-95e9-60892120a7e6 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:16:55.098246 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f96cfd-cf32-47aa-814f-abdf2605fa57 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:16:55.108028 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 781/1574] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:16:54 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:16:55.108755 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf27c79b-092d-4502-95e9-60892120a7e6 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:16:55.120979 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf27c79b-092d-4502-95e9-60892120a7e6 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:16:55.127006 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 794/1575] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 5 12:16:55 2022] POST /identity/v3/users => generated 296 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:16:55.127006 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f96cfd-cf32-47aa-814f-abdf2605fa57 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:16:55.129311 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9f80c7-3bab-46c2-89ed-80a7207cb58f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:16:55.129921 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9f80c7-3bab-46c2-89ed-80a7207cb58f admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:16:55.130200 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9f80c7-3bab-46c2-89ed-80a7207cb58f admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:16:55.130471 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9f80c7-3bab-46c2-89ed-80a7207cb58f admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:16:55.131103 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9f80c7-3bab-46c2-89ed-80a7207cb58f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:16:55.133067 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9f80c7-3bab-46c2-89ed-80a7207cb58f admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:16:55.136811 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f96cfd-cf32-47aa-814f-abdf2605fa57 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:16:55.142913 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385c2460-abe1-409b-9723-e86a422c204d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:16:55.143610 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385c2460-abe1-409b-9723-e86a422c204d admin admin] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:16:55.143898 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385c2460-abe1-409b-9723-e86a422c204d admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:16:55.144177 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385c2460-abe1-409b-9723-e86a422c204d admin admin] PATH_INFO: `/v3/users` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:16:55.144813 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385c2460-abe1-409b-9723-e86a422c204d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:16:55.146954 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385c2460-abe1-409b-9723-e86a422c204d admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:16:55.156672 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:16:55.158220 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 782/1576] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 5 12:16:55 2022] POST /identity/v3/users => generated 283 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:16:55.159082 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9f80c7-3bab-46c2-89ed-80a7207cb58f admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:16:55.170451 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9f80c7-3bab-46c2-89ed-80a7207cb58f admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:16:55.176143 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad22ed7-9945-4c7f-bb57-3eff3349c7ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:16:55.176755 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad22ed7-9945-4c7f-bb57-3eff3349c7ec admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:16:55.177147 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad22ed7-9945-4c7f-bb57-3eff3349c7ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:16:55.177417 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad22ed7-9945-4c7f-bb57-3eff3349c7ec admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:16:55.178082 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad22ed7-9945-4c7f-bb57-3eff3349c7ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:16:55.178574 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 795/1577] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 5 12:16:55 2022] POST /identity/v3/users => generated 289 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:16:55.179380 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385c2460-abe1-409b-9723-e86a422c204d admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:16:55.180186 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad22ed7-9945-4c7f-bb57-3eff3349c7ec admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:16:55.190302 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385c2460-abe1-409b-9723-e86a422c204d admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:16:55.195453 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ce0593-0778-498a-aeda-b7ebbe45cfa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:16:55.196057 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ce0593-0778-498a-aeda-b7ebbe45cfa4 admin admin] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:16:55.196332 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ce0593-0778-498a-aeda-b7ebbe45cfa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:16:55.196599 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ce0593-0778-498a-aeda-b7ebbe45cfa4 admin admin] PATH_INFO: `/v3/users` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:16:55.197404 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ce0593-0778-498a-aeda-b7ebbe45cfa4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:16:55.199542 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ce0593-0778-498a-aeda-b7ebbe45cfa4 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:16:55.209121 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 783/1578] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 5 12:16:55 2022] POST /identity/v3/projects => generated 371 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:16:55.209940 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad22ed7-9945-4c7f-bb57-3eff3349c7ec admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:16:55.225051 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 796/1579] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 5 12:16:55 2022] POST /identity/v3/users => generated 293 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:16:55.225880 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ce0593-0778-498a-aeda-b7ebbe45cfa4 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:16:55.238856 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ce0593-0778-498a-aeda-b7ebbe45cfa4 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:16:55.272445 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad22ed7-9945-4c7f-bb57-3eff3349c7ec admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:16:55.277159 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751a7ac1-c2cd-4a13-9714-701b721ce9fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:16:55.277806 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751a7ac1-c2cd-4a13-9714-701b721ce9fa admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:16:55.278085 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751a7ac1-c2cd-4a13-9714-701b721ce9fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:16:55.278356 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751a7ac1-c2cd-4a13-9714-701b721ce9fa admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:16:55.278984 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751a7ac1-c2cd-4a13-9714-701b721ce9fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:16:55.281102 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751a7ac1-c2cd-4a13-9714-701b721ce9fa admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:16:55.297786 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca39859-47f2-4c96-a0f0-c70d74275d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:16:55.298505 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca39859-47f2-4c96-a0f0-c70d74275d35 admin admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:16:55.298851 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca39859-47f2-4c96-a0f0-c70d74275d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:16:55.299110 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca39859-47f2-4c96-a0f0-c70d74275d35 admin admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:16:55.299777 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca39859-47f2-4c96-a0f0-c70d74275d35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:16:55.301412 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca39859-47f2-4c96-a0f0-c70d74275d35 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:16:55.308714 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 784/1580] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 5 12:16:55 2022] POST /identity/v3/users => generated 286 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:16:55.310245 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751a7ac1-c2cd-4a13-9714-701b721ce9fa admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:16:55.315606 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 797/1581] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:16:55 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:16:55.315606 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca39859-47f2-4c96-a0f0-c70d74275d35 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:16:55.320303 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751a7ac1-c2cd-4a13-9714-701b721ce9fa admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:16:55.324972 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c33e4ee-acab-4b1d-b841-4b29e3f1752a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:16:55.325344 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca39859-47f2-4c96-a0f0-c70d74275d35 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:16:55.325629 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c33e4ee-acab-4b1d-b841-4b29e3f1752a admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:16:55.325909 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c33e4ee-acab-4b1d-b841-4b29e3f1752a admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:16:55.326180 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c33e4ee-acab-4b1d-b841-4b29e3f1752a admin admin] PATH_INFO: `/v3/projects/7903364dc1c64f56a504fee2db647055/users/b7dcead6e9584ab8949678016ed12335/roles/ed72181e1403401facb77dcf33644757` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:16:55.330091 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f217c9-5605-425c-9814-15b53f6e2edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:16:55.330691 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f217c9-5605-425c-9814-15b53f6e2edf admin admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:16:55.330975 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f217c9-5605-425c-9814-15b53f6e2edf admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:16:55.331245 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f217c9-5605-425c-9814-15b53f6e2edf admin admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:16:55.331885 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f217c9-5605-425c-9814-15b53f6e2edf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:16:55.333516 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f217c9-5605-425c-9814-15b53f6e2edf admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:16:55.343373 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c33e4ee-acab-4b1d-b841-4b29e3f1752a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7903364dc1c64f56a504fee2db647055, user_id=b7dcead6e9584ab8949678016ed12335, role_id=ed72181e1403401facb77dcf33644757)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:16:55.345141 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 798/1582] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:16:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:16:55.345982 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f217c9-5605-425c-9814-15b53f6e2edf admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:16:55.346185 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c33e4ee-acab-4b1d-b841-4b29e3f1752a admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:16:55.357487 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f217c9-5605-425c-9814-15b53f6e2edf admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:16:55.366741 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 785/1583] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 5 12:16:55 2022] PUT /identity/v3/projects/7903364dc1c64f56a504fee2db647055/users/b7dcead6e9584ab8949678016ed12335/roles/ed72181e1403401facb77dcf33644757 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:16:55.369861 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c33e4ee-acab-4b1d-b841-4b29e3f1752a admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:16:55.412386 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:16:55.430173 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aca38d-6002-4033-8ea7-3536bc3d7275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:16:55.431128 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aca38d-6002-4033-8ea7-3536bc3d7275 admin admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:16:55.431410 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aca38d-6002-4033-8ea7-3536bc3d7275 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:16:55.431708 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aca38d-6002-4033-8ea7-3536bc3d7275 admin admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:16:55.432373 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8aca38d-6002-4033-8ea7-3536bc3d7275 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:16:55.434704 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8aca38d-6002-4033-8ea7-3536bc3d7275 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:16:55.446135 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 799/1584] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:16:55 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:16:55.447002 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aca38d-6002-4033-8ea7-3536bc3d7275 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:16:55.454853 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c33e4ee-acab-4b1d-b841-4b29e3f1752a admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:16:55.457417 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aca38d-6002-4033-8ea7-3536bc3d7275 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:16:55.459680 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c987a07-fe32-4d75-b3fe-8633575c3cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:16:55.460314 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c987a07-fe32-4d75-b3fe-8633575c3cf6 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:16:55.460601 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c987a07-fe32-4d75-b3fe-8633575c3cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:16:55.460867 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c987a07-fe32-4d75-b3fe-8633575c3cf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:16:55.461542 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c987a07-fe32-4d75-b3fe-8633575c3cf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:16:55.462496 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a491684d-8b49-4f20-ae0d-3cad8986b4b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:16:55.463151 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a491684d-8b49-4f20-ae0d-3cad8986b4b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:16:55.463270 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c987a07-fe32-4d75-b3fe-8633575c3cf6 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:16:55.463456 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a491684d-8b49-4f20-ae0d-3cad8986b4b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:16:55.463796 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a491684d-8b49-4f20-ae0d-3cad8986b4b7 admin admin] PATH_INFO: `/v3/users` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:16:55.464393 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a491684d-8b49-4f20-ae0d-3cad8986b4b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:16:55.466385 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a491684d-8b49-4f20-ae0d-3cad8986b4b7 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:16:55.478243 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 786/1585] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:16:55 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:16:55.478243 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c987a07-fe32-4d75-b3fe-8633575c3cf6 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:16:55.488797 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c987a07-fe32-4d75-b3fe-8633575c3cf6 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:16:55.493633 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d492d82-e299-48ae-b811-036e16f6e613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:16:55.494240 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d492d82-e299-48ae-b811-036e16f6e613 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:16:55.494735 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d492d82-e299-48ae-b811-036e16f6e613 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:16:55.495010 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d492d82-e299-48ae-b811-036e16f6e613 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:16:55.495655 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d492d82-e299-48ae-b811-036e16f6e613 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:16:55.498104 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d492d82-e299-48ae-b811-036e16f6e613 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:16:55.500819 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 800/1586] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 5 12:16:55 2022] POST /identity/v3/users => generated 286 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:16:55.501682 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a491684d-8b49-4f20-ae0d-3cad8986b4b7 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:16:55.510081 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 787/1587] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:16:55 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:16:55.511221 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d492d82-e299-48ae-b811-036e16f6e613 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:16:55.511375 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a491684d-8b49-4f20-ae0d-3cad8986b4b7 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:16:55.516759 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50bc501-ca74-4429-bd66-4ed192e9e9d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:16:55.517664 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50bc501-ca74-4429-bd66-4ed192e9e9d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:16:55.517931 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50bc501-ca74-4429-bd66-4ed192e9e9d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:16:55.518202 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50bc501-ca74-4429-bd66-4ed192e9e9d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:16:55.518847 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50bc501-ca74-4429-bd66-4ed192e9e9d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:16:55.520452 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50bc501-ca74-4429-bd66-4ed192e9e9d1 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:16:55.521632 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d492d82-e299-48ae-b811-036e16f6e613 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:16:55.526209 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88daf99-bde9-4ff9-bd00-67b30ace3650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:16:55.526786 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88daf99-bde9-4ff9-bd00-67b30ace3650 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:16:55.527064 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88daf99-bde9-4ff9-bd00-67b30ace3650 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:16:55.527334 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88daf99-bde9-4ff9-bd00-67b30ace3650 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:16:55.528506 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88daf99-bde9-4ff9-bd00-67b30ace3650 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:16:55.530157 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88daf99-bde9-4ff9-bd00-67b30ace3650 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:16:55.531995 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 801/1588] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:16:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:16:55.532812 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50bc501-ca74-4429-bd66-4ed192e9e9d1 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:16:55.546508 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 788/1589] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:16:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:16:55.546749 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50bc501-ca74-4429-bd66-4ed192e9e9d1 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:16:55.546853 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bc7b6b-76b3-4db2-9e15-8a38d2fbf3e6 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:16:55.546853 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bc7b6b-76b3-4db2-9e15-8a38d2fbf3e6 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:16:55.546853 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bc7b6b-76b3-4db2-9e15-8a38d2fbf3e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:16:55.551336 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a35a223-ad62-4c9a-9475-f517bb42aa5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:16:55.551939 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a35a223-ad62-4c9a-9475-f517bb42aa5a admin admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:16:55.552221 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a35a223-ad62-4c9a-9475-f517bb42aa5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:16:55.552491 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a35a223-ad62-4c9a-9475-f517bb42aa5a admin admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:16:55.553192 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a35a223-ad62-4c9a-9475-f517bb42aa5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:16:55.554810 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a35a223-ad62-4c9a-9475-f517bb42aa5a admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:16:55.563723 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-b4bc7b6b-76b3-4db2-9e15-8a38d2fbf3e6 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:16:55.565011 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-b4bc7b6b-76b3-4db2-9e15-8a38d2fbf3e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:16:55.565250 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 802/1590] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:16:55 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:16:55.566050 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a35a223-ad62-4c9a-9475-f517bb42aa5a admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:16:55.572485 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 789/1591] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:16:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:16:55.573298 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bc7b6b-76b3-4db2-9e15-8a38d2fbf3e6 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:16:55.576808 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a35a223-ad62-4c9a-9475-f517bb42aa5a admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:16:55.582310 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9fe210-2bec-4b1a-a49c-3d77bb9f5350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:16:55.582701 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bc7b6b-76b3-4db2-9e15-8a38d2fbf3e6 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:16:55.582923 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9fe210-2bec-4b1a-a49c-3d77bb9f5350 admin admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:16:55.583189 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9fe210-2bec-4b1a-a49c-3d77bb9f5350 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:16:55.583459 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9fe210-2bec-4b1a-a49c-3d77bb9f5350 admin admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:16:55.584095 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9fe210-2bec-4b1a-a49c-3d77bb9f5350 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:16:55.585728 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9fe210-2bec-4b1a-a49c-3d77bb9f5350 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:16:55.587525 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762adad2-2300-4020-b885-83a46e2bdb5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:16:55.588154 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762adad2-2300-4020-b885-83a46e2bdb5c admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:16:55.588433 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762adad2-2300-4020-b885-83a46e2bdb5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:16:55.588710 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762adad2-2300-4020-b885-83a46e2bdb5c admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:16:55.589382 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762adad2-2300-4020-b885-83a46e2bdb5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:16:55.591859 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762adad2-2300-4020-b885-83a46e2bdb5c admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:16:55.600116 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 803/1592] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:16:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:16:55.600116 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9fe210-2bec-4b1a-a49c-3d77bb9f5350 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:16:55.605795 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:16:55.607223 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 790/1593] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:16:55 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:16:55.608633 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762adad2-2300-4020-b885-83a46e2bdb5c admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:16:55.610801 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9fe210-2bec-4b1a-a49c-3d77bb9f5350 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:16:55.617250 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaec86c-af09-4c2a-8217-dcedaad9121c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:16:55.617855 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaec86c-af09-4c2a-8217-dcedaad9121c admin admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:16:55.618129 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaec86c-af09-4c2a-8217-dcedaad9121c admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:16:55.618400 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaec86c-af09-4c2a-8217-dcedaad9121c admin admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:16:55.619035 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaec86c-af09-4c2a-8217-dcedaad9121c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:16:55.619145 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762adad2-2300-4020-b885-83a46e2bdb5c admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:16:55.620628 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaec86c-af09-4c2a-8217-dcedaad9121c admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:16:55.623942 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2569539b-47df-490f-b82c-1d9f80dc0aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:16:55.624536 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2569539b-47df-490f-b82c-1d9f80dc0aba admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:16:55.624820 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2569539b-47df-490f-b82c-1d9f80dc0aba admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:16:55.625128 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2569539b-47df-490f-b82c-1d9f80dc0aba admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:16:55.625768 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2569539b-47df-490f-b82c-1d9f80dc0aba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:16:55.627395 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2569539b-47df-490f-b82c-1d9f80dc0aba admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:16:55.631156 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 804/1594] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:16:55 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:16:55.631947 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaec86c-af09-4c2a-8217-dcedaad9121c admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:16:55.638097 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 791/1595] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:16:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:16:55.638829 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2569539b-47df-490f-b82c-1d9f80dc0aba admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:16:55.644431 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaec86c-af09-4c2a-8217-dcedaad9121c admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:16:55.648461 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2569539b-47df-490f-b82c-1d9f80dc0aba admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:16:55.648886 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239238d0-d2ca-4b41-8629-967d9cf598ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:16:55.649497 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239238d0-d2ca-4b41-8629-967d9cf598ae admin admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:16:55.649774 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239238d0-d2ca-4b41-8629-967d9cf598ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:16:55.650046 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239238d0-d2ca-4b41-8629-967d9cf598ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:16:55.650673 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239238d0-d2ca-4b41-8629-967d9cf598ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:16:55.652245 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239238d0-d2ca-4b41-8629-967d9cf598ae admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:16:55.653626 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a52906-42a2-46b2-b2e5-605560d43888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:16:55.654250 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a52906-42a2-46b2-b2e5-605560d43888 admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:16:55.654526 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a52906-42a2-46b2-b2e5-605560d43888 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:16:55.654829 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a52906-42a2-46b2-b2e5-605560d43888 admin admin] PATH_INFO: `/v3/projects/0f31cfec64f245eda4d6285532bea381/users/22dcc620730a4801b42c1752cb3a8c7a/roles/ed72181e1403401facb77dcf33644757` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:16:55.662974 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 805/1596] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:16:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:16:55.663694 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239238d0-d2ca-4b41-8629-967d9cf598ae admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:16:55.670331 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a52906-42a2-46b2-b2e5-605560d43888 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f31cfec64f245eda4d6285532bea381, user_id=22dcc620730a4801b42c1752cb3a8c7a, role_id=ed72181e1403401facb77dcf33644757)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:16:55.673001 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a52906-42a2-46b2-b2e5-605560d43888 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:16:55.673930 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239238d0-d2ca-4b41-8629-967d9cf598ae admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:16:55.678772 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc91e4c9-f2b8-49da-a668-147b067f4d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:16:55.679601 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc91e4c9-f2b8-49da-a668-147b067f4d15 admin admin] REQUEST_METHOD: `PUT` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:16:55.679945 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc91e4c9-f2b8-49da-a668-147b067f4d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:16:55.680217 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc91e4c9-f2b8-49da-a668-147b067f4d15 admin admin] PATH_INFO: `/v3/projects/f400bce0b7b948daa162431f575193fc/users/95c65245dd614ebb9b9ebf2fcc620cea/roles/ed72181e1403401facb77dcf33644757` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:16:55.687320 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 792/1597] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 5 12:16:55 2022] PUT /identity/v3/projects/0f31cfec64f245eda4d6285532bea381/users/22dcc620730a4801b42c1752cb3a8c7a/roles/ed72181e1403401facb77dcf33644757 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:16:55.688131 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a52906-42a2-46b2-b2e5-605560d43888 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:16:55.705240 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc91e4c9-f2b8-49da-a668-147b067f4d15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f400bce0b7b948daa162431f575193fc, user_id=95c65245dd614ebb9b9ebf2fcc620cea, role_id=ed72181e1403401facb77dcf33644757)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:16:55.706368 dv-cinder-855189-1-smb devstack@keystone.service[81719]: WARNING py.warnings [None req-bc91e4c9-f2b8-49da-a668-147b067f4d15 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 05 12:16:55.706368 dv-cinder-855189-1-smb devstack@keystone.service[81719]: warnings.warn(msg) Sep 05 12:16:55.706368 dv-cinder-855189-1-smb devstack@keystone.service[81719]: Sep 05 12:16:55.708311 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc91e4c9-f2b8-49da-a668-147b067f4d15 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:16:55.721194 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 806/1598] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 5 12:16:55 2022] PUT /identity/v3/projects/f400bce0b7b948daa162431f575193fc/users/95c65245dd614ebb9b9ebf2fcc620cea/roles/ed72181e1403401facb77dcf33644757 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:16:55.722089 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc91e4c9-f2b8-49da-a668-147b067f4d15 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:16:55.746529 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a52906-42a2-46b2-b2e5-605560d43888 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:16:55.783601 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc91e4c9-f2b8-49da-a668-147b067f4d15 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:16:55.788280 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb22d617-528d-475e-be90-1eac8dfbfd88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:16:55.788966 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb22d617-528d-475e-be90-1eac8dfbfd88 admin admin] REQUEST_METHOD: `PUT` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:16:55.789246 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb22d617-528d-475e-be90-1eac8dfbfd88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:16:55.789517 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb22d617-528d-475e-be90-1eac8dfbfd88 admin admin] PATH_INFO: `/v3/projects/1aa715929b1e42eea30e64d1ed48f905/users/e67ddf103f654458b4637a4bc9d2ccd5/roles/ed72181e1403401facb77dcf33644757` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:16:55.798942 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50463263-3247-462d-bfd0-c228f0f97a09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4994b4faa4ec4aa088f3dc32c9c5614d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:16:55.799559 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50463263-3247-462d-bfd0-c228f0f97a09 service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:16:55.799837 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50463263-3247-462d-bfd0-c228f0f97a09 service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:16:55.800113 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50463263-3247-462d-bfd0-c228f0f97a09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:16:55.804749 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb22d617-528d-475e-be90-1eac8dfbfd88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1aa715929b1e42eea30e64d1ed48f905, user_id=e67ddf103f654458b4637a4bc9d2ccd5, role_id=ed72181e1403401facb77dcf33644757)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:16:55.807417 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb22d617-528d-475e-be90-1eac8dfbfd88 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:16:55.809350 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50463263-3247-462d-bfd0-c228f0f97a09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:16:55.810809 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50463263-3247-462d-bfd0-c228f0f97a09 service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:16:55.820577 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 807/1599] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 5 12:16:55 2022] PUT /identity/v3/projects/1aa715929b1e42eea30e64d1ed48f905/users/e67ddf103f654458b4637a4bc9d2ccd5/roles/ed72181e1403401facb77dcf33644757 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:16:55.820739 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 793/1600] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:16:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:16:55.821407 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50463263-3247-462d-bfd0-c228f0f97a09 service neutron] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:16:55.830150 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb22d617-528d-475e-be90-1eac8dfbfd88 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:16:55.830975 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50463263-3247-462d-bfd0-c228f0f97a09 service neutron] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:16:55.842147 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:16:55.898849 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb22d617-528d-475e-be90-1eac8dfbfd88 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:16:55.905358 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52172d6d-d769-46c2-816f-45a878323cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:16:55.906117 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52172d6d-d769-46c2-816f-45a878323cc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:16:55.914707 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52172d6d-d769-46c2-816f-45a878323cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:16:55.914856 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391c2c19-d505-4194-ab98-1643c39268a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:16:55.915000 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52172d6d-d769-46c2-816f-45a878323cc8 admin admin] PATH_INFO: `/v3/projects/f0af920fa61f43ee9245081bf48c4623/users/1a65057dea094b77a0d13fda46b7d6ed/roles/ed72181e1403401facb77dcf33644757` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:16:55.915097 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391c2c19-d505-4194-ab98-1643c39268a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:16:55.915097 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391c2c19-d505-4194-ab98-1643c39268a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:16:55.915097 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391c2c19-d505-4194-ab98-1643c39268a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:16:55.915097 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391c2c19-d505-4194-ab98-1643c39268a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:16:55.915097 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391c2c19-d505-4194-ab98-1643c39268a5 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:16:55.922955 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 794/1601] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:16:55 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:16:55.925589 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52172d6d-d769-46c2-816f-45a878323cc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0af920fa61f43ee9245081bf48c4623, user_id=1a65057dea094b77a0d13fda46b7d6ed, role_id=ed72181e1403401facb77dcf33644757)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:16:55.928235 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391c2c19-d505-4194-ab98-1643c39268a5 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:16:55.929492 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52172d6d-d769-46c2-816f-45a878323cc8 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:16:55.940651 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391c2c19-d505-4194-ab98-1643c39268a5 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:16:55.944744 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 808/1602] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 5 12:16:55 2022] PUT /identity/v3/projects/f0af920fa61f43ee9245081bf48c4623/users/1a65057dea094b77a0d13fda46b7d6ed/roles/ed72181e1403401facb77dcf33644757 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:16:55.945426 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52172d6d-d769-46c2-816f-45a878323cc8 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:16:55.978270 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:16:56.013222 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d578d87-c607-4a55-a03a-b91c46f7f7cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:16:56.013890 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d578d87-c607-4a55-a03a-b91c46f7f7cd admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:16:56.014331 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d578d87-c607-4a55-a03a-b91c46f7f7cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:16:56.014664 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d578d87-c607-4a55-a03a-b91c46f7f7cd admin admin] PATH_INFO: `/v3/projects/608133f89e744849bc82b275320ca037/users/3d709333b17f42f9846b5a5781d52585/roles/ed72181e1403401facb77dcf33644757` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:16:56.020654 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52172d6d-d769-46c2-816f-45a878323cc8 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:16:56.025936 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd55b16-3216-4e6a-942c-3abb533dda90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:16:56.026647 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd55b16-3216-4e6a-942c-3abb533dda90 admin admin] REQUEST_METHOD: `PUT` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:16:56.026998 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd55b16-3216-4e6a-942c-3abb533dda90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:16:56.027272 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd55b16-3216-4e6a-942c-3abb533dda90 admin admin] PATH_INFO: `/v3/projects/4ffe18e829cc461a9fe786cb8bde8932/users/2e832e88020146438f581f98d4300d10/roles/ed72181e1403401facb77dcf33644757` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:16:56.033326 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d578d87-c607-4a55-a03a-b91c46f7f7cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=608133f89e744849bc82b275320ca037, user_id=3d709333b17f42f9846b5a5781d52585, role_id=ed72181e1403401facb77dcf33644757)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:16:56.036003 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d578d87-c607-4a55-a03a-b91c46f7f7cd admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:16:56.043847 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd55b16-3216-4e6a-942c-3abb533dda90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ffe18e829cc461a9fe786cb8bde8932, user_id=2e832e88020146438f581f98d4300d10, role_id=ed72181e1403401facb77dcf33644757)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:16:56.046606 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd55b16-3216-4e6a-942c-3abb533dda90 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:16:56.050588 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 795/1603] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 5 12:16:55 2022] PUT /identity/v3/projects/608133f89e744849bc82b275320ca037/users/3d709333b17f42f9846b5a5781d52585/roles/ed72181e1403401facb77dcf33644757 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:16:56.051944 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e9dd86-7564-420c-8b55-8bdab1fde225 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:16:56.052229 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e9dd86-7564-420c-8b55-8bdab1fde225 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:16:56.052498 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e9dd86-7564-420c-8b55-8bdab1fde225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:16:56.085049 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 809/1604] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 5 12:16:55 2022] PUT /identity/v3/projects/4ffe18e829cc461a9fe786cb8bde8932/users/2e832e88020146438f581f98d4300d10/roles/ed72181e1403401facb77dcf33644757 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:16:56.086616 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-e5e9dd86-7564-420c-8b55-8bdab1fde225 None None] MFA Rules not processed for user `22dcc620730a4801b42c1752cb3a8c7a`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:16:56.087031 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ec177e-dc60-45ff-9d09-3221d00c5b53 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:16:56.087321 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ec177e-dc60-45ff-9d09-3221d00c5b53 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:16:56.087630 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ec177e-dc60-45ff-9d09-3221d00c5b53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:16:56.087846 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-e5e9dd86-7564-420c-8b55-8bdab1fde225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:16:56.109251 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-33ec177e-dc60-45ff-9d09-3221d00c5b53 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:16:56.110474 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-33ec177e-dc60-45ff-9d09-3221d00c5b53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:16:56.160297 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 796/1605] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:16:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:16:56.161915 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee7b479-c4bc-4d15-8651-cc9b82043bd7 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:16:56.162437 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee7b479-c4bc-4d15-8651-cc9b82043bd7 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:16:56.163016 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee7b479-c4bc-4d15-8651-cc9b82043bd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:16:56.182826 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 810/1606] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:16:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:16:56.193097 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ec177e-dc60-45ff-9d09-3221d00c5b53 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:16:56.195211 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-1ee7b479-c4bc-4d15-8651-cc9b82043bd7 None None] MFA Rules not processed for user `e67ddf103f654458b4637a4bc9d2ccd5`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:16:56.196751 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-1ee7b479-c4bc-4d15-8651-cc9b82043bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:16:56.205715 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ec177e-dc60-45ff-9d09-3221d00c5b53 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:16:56.207761 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:16:56.213667 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0100207f-5f18-417a-868e-f07d72e8f9ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:16:56.214682 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0100207f-5f18-417a-868e-f07d72e8f9ba admin admin] REQUEST_METHOD: `PUT` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:16:56.215132 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0100207f-5f18-417a-868e-f07d72e8f9ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:16:56.216130 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0100207f-5f18-417a-868e-f07d72e8f9ba admin admin] PATH_INFO: `/v3/projects/ef0535923bcc49038ef9a6a0b8094ac2/users/c8f7e01d063e4a39ab4f51e353868898/roles/ed72181e1403401facb77dcf33644757` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:16:56.237889 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0100207f-5f18-417a-868e-f07d72e8f9ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef0535923bcc49038ef9a6a0b8094ac2, user_id=c8f7e01d063e4a39ab4f51e353868898, role_id=ed72181e1403401facb77dcf33644757)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:16:56.241411 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0100207f-5f18-417a-868e-f07d72e8f9ba admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:16:56.257595 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 811/1607] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 5 12:16:56 2022] PUT /identity/v3/projects/ef0535923bcc49038ef9a6a0b8094ac2/users/c8f7e01d063e4a39ab4f51e353868898/roles/ed72181e1403401facb77dcf33644757 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:16:56.264298 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8b80e8-d300-4c12-b19b-f15c9535f6f7 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:16:56.264578 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8b80e8-d300-4c12-b19b-f15c9535f6f7 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:16:56.264847 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8b80e8-d300-4c12-b19b-f15c9535f6f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:16:56.288518 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-ec8b80e8-d300-4c12-b19b-f15c9535f6f7 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:16:56.290274 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-ec8b80e8-d300-4c12-b19b-f15c9535f6f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:16:56.295304 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 797/1608] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:16:56 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:16:56.295304 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac13acf-ed9f-430a-adb7-177e53df5eec None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:16:56.295304 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac13acf-ed9f-430a-adb7-177e53df5eec None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:16:56.295304 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac13acf-ed9f-430a-adb7-177e53df5eec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:16:56.330829 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-5ac13acf-ed9f-430a-adb7-177e53df5eec None None] MFA Rules not processed for user `3d709333b17f42f9846b5a5781d52585`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:16:56.332338 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-5ac13acf-ed9f-430a-adb7-177e53df5eec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:16:56.370187 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 812/1609] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:16:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:16:56.375683 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8500012-cab6-4839-ac20-88df52431922 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:16:56.376031 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8500012-cab6-4839-ac20-88df52431922 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:16:56.376521 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8500012-cab6-4839-ac20-88df52431922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:16:56.414126 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-d8500012-cab6-4839-ac20-88df52431922 None None] MFA Rules not processed for user `2e832e88020146438f581f98d4300d10`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:16:56.415762 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-d8500012-cab6-4839-ac20-88df52431922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:16:56.427256 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 798/1610] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:16:56 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:16:56.427929 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac13acf-ed9f-430a-adb7-177e53df5eec None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:16:56.430123 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:16:56.447804 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac13acf-ed9f-430a-adb7-177e53df5eec None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:16:56.468632 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20042105-ab57-48cd-b456-4cec641a98b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:16:56.469433 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20042105-ab57-48cd-b456-4cec641a98b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:16:56.470374 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20042105-ab57-48cd-b456-4cec641a98b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:16:56.470374 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20042105-ab57-48cd-b456-4cec641a98b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:16:56.470627 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20042105-ab57-48cd-b456-4cec641a98b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:16:56.475557 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20042105-ab57-48cd-b456-4cec641a98b5 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:16:56.500090 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 813/1611] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:16:56 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:16:56.501346 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8500012-cab6-4839-ac20-88df52431922 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:16:56.519401 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 799/1612] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 5 12:16:56 2022] POST /identity/v3/projects => generated 375 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:16:56.520862 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd61fd8-58d9-40e3-9ab8-07416b604def None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:16:56.521199 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd61fd8-58d9-40e3-9ab8-07416b604def None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:16:56.521475 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd61fd8-58d9-40e3-9ab8-07416b604def None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:16:56.573909 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-6fd61fd8-58d9-40e3-9ab8-07416b604def None None] MFA Rules not processed for user `c8f7e01d063e4a39ab4f51e353868898`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:16:56.575699 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-6fd61fd8-58d9-40e3-9ab8-07416b604def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:16:56.596579 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8500012-cab6-4839-ac20-88df52431922 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:16:56.660436 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 800/1613] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:16:56 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:16:56.661622 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd61fd8-58d9-40e3-9ab8-07416b604def None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:16:56.666053 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b283f74-c4ae-42d8-a9cf-ff84082c887b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4994b4faa4ec4aa088f3dc32c9c5614d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:16:56.666493 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b283f74-c4ae-42d8-a9cf-ff84082c887b service neutron] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:16:56.666777 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b283f74-c4ae-42d8-a9cf-ff84082c887b service neutron] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:16:56.667101 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b283f74-c4ae-42d8-a9cf-ff84082c887b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:16:56.675629 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:16:56.730454 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd61fd8-58d9-40e3-9ab8-07416b604def None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:16:56.735704 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039698a3-cacd-4a77-984b-fdb63bd56e3b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37633bbae0c2423c81ccd61ac3a17ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:16:56.736421 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039698a3-cacd-4a77-984b-fdb63bd56e3b service cinder] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:16:56.736776 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039698a3-cacd-4a77-984b-fdb63bd56e3b service cinder] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:16:56.737085 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039698a3-cacd-4a77-984b-fdb63bd56e3b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:16:56.773779 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b283f74-c4ae-42d8-a9cf-ff84082c887b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:16:56.775814 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b283f74-c4ae-42d8-a9cf-ff84082c887b service neutron] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:16:56.805315 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 814/1614] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:16:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:16:56.806390 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b283f74-c4ae-42d8-a9cf-ff84082c887b service neutron] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:16:56.817750 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039698a3-cacd-4a77-984b-fdb63bd56e3b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:16:56.819347 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039698a3-cacd-4a77-984b-fdb63bd56e3b service cinder] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:16:56.823917 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b283f74-c4ae-42d8-a9cf-ff84082c887b service neutron] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:16:56.828375 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01e1d58-f3b9-4ad0-a3e2-b3469f52c2a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4994b4faa4ec4aa088f3dc32c9c5614d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:16:56.829578 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01e1d58-f3b9-4ad0-a3e2-b3469f52c2a3 service neutron] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:16:56.830144 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01e1d58-f3b9-4ad0-a3e2-b3469f52c2a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:16:56.830569 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01e1d58-f3b9-4ad0-a3e2-b3469f52c2a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:16:56.831988 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 801/1615] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:16:56 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:16:56.845279 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01e1d58-f3b9-4ad0-a3e2-b3469f52c2a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:16:56.846876 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b178d697-2ab8-491d-a89f-11ebefa7c1f9 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:16:56.847242 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01e1d58-f3b9-4ad0-a3e2-b3469f52c2a3 service neutron] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:16:56.847777 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b178d697-2ab8-491d-a89f-11ebefa7c1f9 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:16:56.849143 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b178d697-2ab8-491d-a89f-11ebefa7c1f9 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:16:56.850716 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 802/1616] 10.222.0.50 () {54 vars in 962 bytes} [Mon Sep 5 12:16:56 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:16:56.856966 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b178d697-2ab8-491d-a89f-11ebefa7c1f9 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:16:56.865757 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 815/1617] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:16:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:16:56.867745 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0129dfbd-2c88-4cc0-8b9b-e72425a679c8 None None] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:16:56.868214 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0129dfbd-2c88-4cc0-8b9b-e72425a679c8 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:16:56.868587 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0129dfbd-2c88-4cc0-8b9b-e72425a679c8 None None] PATH_INFO: `/` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:16:56.870302 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 816/1618] 10.222.0.50 () {54 vars in 962 bytes} [Mon Sep 5 12:16:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:16:56.872072 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0129dfbd-2c88-4cc0-8b9b-e72425a679c8 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:16:56.888830 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b178d697-2ab8-491d-a89f-11ebefa7c1f9 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:16:56.889469 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0129dfbd-2c88-4cc0-8b9b-e72425a679c8 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:16:56.894478 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ad2ba6-3fca-4b08-953a-65767f6776e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:16:56.895477 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937c5922-cfc5-48e8-94eb-c5e599b403b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:16:56.896104 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937c5922-cfc5-48e8-94eb-c5e599b403b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:16:56.896380 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937c5922-cfc5-48e8-94eb-c5e599b403b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:16:56.896505 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ad2ba6-3fca-4b08-953a-65767f6776e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:16:56.896647 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937c5922-cfc5-48e8-94eb-c5e599b403b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:16:56.896989 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ad2ba6-3fca-4b08-953a-65767f6776e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:16:56.897381 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937c5922-cfc5-48e8-94eb-c5e599b403b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:16:56.897513 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ad2ba6-3fca-4b08-953a-65767f6776e1 admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:16:56.898310 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ad2ba6-3fca-4b08-953a-65767f6776e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:16:56.899777 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937c5922-cfc5-48e8-94eb-c5e599b403b0 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:16:56.905181 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:16:56.908674 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ad2ba6-3fca-4b08-953a-65767f6776e1 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:16:56.952640 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 817/1619] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 5 12:16:56 2022] POST /identity/v3/projects => generated 373 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:16:56.956505 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 803/1620] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 5 12:16:56 2022] POST /identity/v3/users => generated 294 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:16:56.956967 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed2417f-e798-43bb-b83f-9d229c1f6cd1 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:16:56.958911 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed2417f-e798-43bb-b83f-9d229c1f6cd1 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:16:56.959347 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed2417f-e798-43bb-b83f-9d229c1f6cd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:16:56.960928 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7093976-57e2-4902-9660-d68f9ef1c288 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:16:56.961307 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7093976-57e2-4902-9660-d68f9ef1c288 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:16:56.961711 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7093976-57e2-4902-9660-d68f9ef1c288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:16:57.069798 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-7ed2417f-e798-43bb-b83f-9d229c1f6cd1 None None] MFA Rules not processed for user `cb060ff495bc4abb83ff88992fb7be09`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:16:57.071484 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-f7093976-57e2-4902-9660-d68f9ef1c288 None None] MFA Rules not processed for user `cb060ff495bc4abb83ff88992fb7be09`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:16:57.072619 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-7ed2417f-e798-43bb-b83f-9d229c1f6cd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:16:57.072880 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-f7093976-57e2-4902-9660-d68f9ef1c288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:16:57.180874 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 804/1621] 10.222.0.50 () {58 vars in 1059 bytes} [Mon Sep 5 12:16:56 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:16:57.181879 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7093976-57e2-4902-9660-d68f9ef1c288 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:16:57.221377 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:16:57.236424 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 818/1622] 10.222.0.50 () {58 vars in 1059 bytes} [Mon Sep 5 12:16:56 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:16:57.239737 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed2417f-e798-43bb-b83f-9d229c1f6cd1 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:16:57.292642 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7093976-57e2-4902-9660-d68f9ef1c288 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:16:57.300834 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92776f77-b435-4313-b5a1-5d4efeee7922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:16:57.302306 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92776f77-b435-4313-b5a1-5d4efeee7922 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:16:57.303156 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92776f77-b435-4313-b5a1-5d4efeee7922 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:16:57.303156 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92776f77-b435-4313-b5a1-5d4efeee7922 admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:16:57.306101 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92776f77-b435-4313-b5a1-5d4efeee7922 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:16:57.310119 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92776f77-b435-4313-b5a1-5d4efeee7922 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:16:57.360794 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 805/1623] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 5 12:16:57 2022] POST /identity/v3/users => generated 293 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:16:57.360794 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92776f77-b435-4313-b5a1-5d4efeee7922 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:16:57.397894 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed2417f-e798-43bb-b83f-9d229c1f6cd1 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:16:57.410286 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302605e1-29f2-4837-87c5-9277fb36f79a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:16:57.411650 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302605e1-29f2-4837-87c5-9277fb36f79a admin admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:16:57.415035 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302605e1-29f2-4837-87c5-9277fb36f79a admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:16:57.415442 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302605e1-29f2-4837-87c5-9277fb36f79a admin admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:16:57.416018 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302605e1-29f2-4837-87c5-9277fb36f79a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:16:57.417730 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302605e1-29f2-4837-87c5-9277fb36f79a admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:16:57.421817 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92776f77-b435-4313-b5a1-5d4efeee7922 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:16:57.439261 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415c56f1-5808-4cdb-8f2a-079b1fa7e7e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb060ff495bc4abb83ff88992fb7be09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:16:57.440143 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415c56f1-5808-4cdb-8f2a-079b1fa7e7e8 service nova] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:16:57.443197 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415c56f1-5808-4cdb-8f2a-079b1fa7e7e8 service nova] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:16:57.443197 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415c56f1-5808-4cdb-8f2a-079b1fa7e7e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:16:57.451491 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 819/1624] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:16:57 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:16:57.453613 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302605e1-29f2-4837-87c5-9277fb36f79a admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:16:57.489864 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302605e1-29f2-4837-87c5-9277fb36f79a admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:16:57.505542 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d521831e-a53d-4ff3-8583-b1938bf988fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb060ff495bc4abb83ff88992fb7be09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:16:57.506169 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d521831e-a53d-4ff3-8583-b1938bf988fc service nova] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:16:57.506589 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d521831e-a53d-4ff3-8583-b1938bf988fc service nova] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:16:57.506868 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d521831e-a53d-4ff3-8583-b1938bf988fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:16:57.564999 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415c56f1-5808-4cdb-8f2a-079b1fa7e7e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:16:57.567053 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415c56f1-5808-4cdb-8f2a-079b1fa7e7e8 service nova] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:16:57.607721 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 806/1625] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:16:57 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:16:57.612040 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415c56f1-5808-4cdb-8f2a-079b1fa7e7e8 service nova] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:16:57.650264 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415c56f1-5808-4cdb-8f2a-079b1fa7e7e8 service nova] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:16:57.650528 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d521831e-a53d-4ff3-8583-b1938bf988fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:16:57.652137 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d521831e-a53d-4ff3-8583-b1938bf988fc service nova] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:16:57.661532 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:16:57.668023 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75646b1c-6a1f-4ecf-8757-3402a48c6816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:16:57.670630 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75646b1c-6a1f-4ecf-8757-3402a48c6816 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:16:57.670835 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75646b1c-6a1f-4ecf-8757-3402a48c6816 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:16:57.671362 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75646b1c-6a1f-4ecf-8757-3402a48c6816 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:16:57.672132 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75646b1c-6a1f-4ecf-8757-3402a48c6816 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:16:57.673954 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75646b1c-6a1f-4ecf-8757-3402a48c6816 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:16:57.689021 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 820/1626] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:16:57 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:16:57.689889 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d521831e-a53d-4ff3-8583-b1938bf988fc service nova] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:16:57.700494 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 807/1627] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:16:57 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:16:57.707912 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75646b1c-6a1f-4ecf-8757-3402a48c6816 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:16:57.730120 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75646b1c-6a1f-4ecf-8757-3402a48c6816 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:16:57.746887 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0138bcdb-3902-409e-93ed-9147356fdfc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:16:57.748044 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0138bcdb-3902-409e-93ed-9147356fdfc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:16:57.748425 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0138bcdb-3902-409e-93ed-9147356fdfc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:16:57.748792 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0138bcdb-3902-409e-93ed-9147356fdfc1 admin admin] PATH_INFO: `/v3/projects/560909e8f9b949c49ecef71e80e191c5/users/cb577739597a4623a1ab732f0ca81448/roles/16e2ccc8bd1b497d8cee780c1c7df0d2` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:16:57.749457 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d521831e-a53d-4ff3-8583-b1938bf988fc service nova] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:16:57.794049 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a290cc5b-ec1b-449a-beb2-1016db059415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:16:57.796833 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a290cc5b-ec1b-449a-beb2-1016db059415 admin admin] REQUEST_METHOD: `PUT` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:16:57.797180 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a290cc5b-ec1b-449a-beb2-1016db059415 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:16:57.797671 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a290cc5b-ec1b-449a-beb2-1016db059415 admin admin] PATH_INFO: `/v3/projects/4cc691ee746a4913802bd95421fdd2a7/users/7ecd6e7a7a5c4d8c9497bf3ef9fc7f06/roles/16e2ccc8bd1b497d8cee780c1c7df0d2` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:16:57.798049 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0138bcdb-3902-409e-93ed-9147356fdfc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=560909e8f9b949c49ecef71e80e191c5, user_id=cb577739597a4623a1ab732f0ca81448, role_id=16e2ccc8bd1b497d8cee780c1c7df0d2)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:16:57.801658 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0138bcdb-3902-409e-93ed-9147356fdfc1 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:16:57.844664 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 808/1628] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 5 12:16:57 2022] PUT /identity/v3/projects/560909e8f9b949c49ecef71e80e191c5/users/cb577739597a4623a1ab732f0ca81448/roles/16e2ccc8bd1b497d8cee780c1c7df0d2 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:16:57.846500 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0138bcdb-3902-409e-93ed-9147356fdfc1 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:16:57.941928 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a290cc5b-ec1b-449a-beb2-1016db059415 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cc691ee746a4913802bd95421fdd2a7, user_id=7ecd6e7a7a5c4d8c9497bf3ef9fc7f06, role_id=16e2ccc8bd1b497d8cee780c1c7df0d2)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:16:57.947840 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a290cc5b-ec1b-449a-beb2-1016db059415 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:16:57.998831 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0138bcdb-3902-409e-93ed-9147356fdfc1 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:16:58.025453 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 821/1629] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 5 12:16:57 2022] PUT /identity/v3/projects/4cc691ee746a4913802bd95421fdd2a7/users/7ecd6e7a7a5c4d8c9497bf3ef9fc7f06/roles/16e2ccc8bd1b497d8cee780c1c7df0d2 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:16:58.027116 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a290cc5b-ec1b-449a-beb2-1016db059415 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:16:58.054397 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:16:58.181538 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94832a61-541d-4859-9395-2f4096456cc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:16:58.185816 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94832a61-541d-4859-9395-2f4096456cc6 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:16:58.186381 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94832a61-541d-4859-9395-2f4096456cc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:16:58.186867 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94832a61-541d-4859-9395-2f4096456cc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:16:58.188012 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94832a61-541d-4859-9395-2f4096456cc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:16:58.190955 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94832a61-541d-4859-9395-2f4096456cc6 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:16:58.230506 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 809/1630] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:16:57 2022] GET /identity/v3/roles => generated 1420 bytes in 383 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:16:58.244235 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05507f27-94eb-4fba-9ad0-95b12963562c None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:16:58.244235 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05507f27-94eb-4fba-9ad0-95b12963562c None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:16:58.244235 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05507f27-94eb-4fba-9ad0-95b12963562c None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:16:58.244235 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 810/1631] 10.222.0.50 () {54 vars in 912 bytes} [Mon Sep 5 12:16:58 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:16:58.249989 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05507f27-94eb-4fba-9ad0-95b12963562c None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:16:58.289946 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05507f27-94eb-4fba-9ad0-95b12963562c None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:16:58.305572 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a290cc5b-ec1b-449a-beb2-1016db059415 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:16:58.310740 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3230326-4a71-409b-82e9-1c395a990852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:16:58.311435 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3230326-4a71-409b-82e9-1c395a990852 admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:16:58.311718 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3230326-4a71-409b-82e9-1c395a990852 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:16:58.311994 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3230326-4a71-409b-82e9-1c395a990852 admin admin] PATH_INFO: `/v3/projects/560909e8f9b949c49ecef71e80e191c5/users/cb577739597a4623a1ab732f0ca81448/roles/16e2ccc8bd1b497d8cee780c1c7df0d2` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:16:58.322249 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3230326-4a71-409b-82e9-1c395a990852 admin admin] RBAC: Authorizing `identity:create_grant(project_id=560909e8f9b949c49ecef71e80e191c5, user_id=cb577739597a4623a1ab732f0ca81448, role_id=16e2ccc8bd1b497d8cee780c1c7df0d2)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:16:58.330468 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e210add-034b-477d-ad98-369869051a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:16:58.331132 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e210add-034b-477d-ad98-369869051a14 admin admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:16:58.331420 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e210add-034b-477d-ad98-369869051a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:16:58.331697 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e210add-034b-477d-ad98-369869051a14 admin admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:16:58.332365 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e210add-034b-477d-ad98-369869051a14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:16:58.334005 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e210add-034b-477d-ad98-369869051a14 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:16:58.335507 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3230326-4a71-409b-82e9-1c395a990852 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:16:58.389596 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 811/1632] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 5 12:16:58 2022] PUT /identity/v3/projects/560909e8f9b949c49ecef71e80e191c5/users/cb577739597a4623a1ab732f0ca81448/roles/16e2ccc8bd1b497d8cee780c1c7df0d2 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:16:58.389596 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614d2703-3064-49b8-be0e-1d65a39b98a8 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:16:58.389596 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614d2703-3064-49b8-be0e-1d65a39b98a8 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:16:58.389596 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614d2703-3064-49b8-be0e-1d65a39b98a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:16:58.390025 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 822/1633] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:16:58 2022] GET /identity/v3/roles => generated 1420 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:16:58.392306 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f041208-aa88-4743-abe3-be9dd142ed43 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:16:58.392306 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f041208-aa88-4743-abe3-be9dd142ed43 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:16:58.392306 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f041208-aa88-4743-abe3-be9dd142ed43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:16:58.439504 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-614d2703-3064-49b8-be0e-1d65a39b98a8 None None] MFA Rules not processed for user `cb060ff495bc4abb83ff88992fb7be09`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:16:58.440749 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-614d2703-3064-49b8-be0e-1d65a39b98a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:16:58.460166 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-4f041208-aa88-4743-abe3-be9dd142ed43 None None] MFA Rules not processed for user `cb577739597a4623a1ab732f0ca81448`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:16:58.461442 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-4f041208-aa88-4743-abe3-be9dd142ed43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:16:58.587256 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 823/1634] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:16:58 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 12:16:58.588514 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f041208-aa88-4743-abe3-be9dd142ed43 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:16:58.610785 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 812/1635] 10.222.0.50 () {58 vars in 1009 bytes} [Mon Sep 5 12:16:58 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:16:58.612417 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451982c2-3c66-4075-9145-5a420b86b55a None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:16:58.612704 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451982c2-3c66-4075-9145-5a420b86b55a None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:16:58.619141 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451982c2-3c66-4075-9145-5a420b86b55a None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:16:58.622041 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 813/1636] 10.222.0.50 () {54 vars in 912 bytes} [Mon Sep 5 12:16:58 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:16:58.630643 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451982c2-3c66-4075-9145-5a420b86b55a None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:16:58.703416 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:16:58.708943 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f041208-aa88-4743-abe3-be9dd142ed43 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:16:58.719969 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bfeff1-8152-41b2-8c83-78dabad7ae64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:16:58.720631 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bfeff1-8152-41b2-8c83-78dabad7ae64 admin admin] REQUEST_METHOD: `PUT` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:16:58.720941 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bfeff1-8152-41b2-8c83-78dabad7ae64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:16:58.721227 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bfeff1-8152-41b2-8c83-78dabad7ae64 admin admin] PATH_INFO: `/v3/projects/4cc691ee746a4913802bd95421fdd2a7/users/7ecd6e7a7a5c4d8c9497bf3ef9fc7f06/roles/16e2ccc8bd1b497d8cee780c1c7df0d2` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:16:58.732667 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bfeff1-8152-41b2-8c83-78dabad7ae64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cc691ee746a4913802bd95421fdd2a7, user_id=7ecd6e7a7a5c4d8c9497bf3ef9fc7f06, role_id=16e2ccc8bd1b497d8cee780c1c7df0d2)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:16:58.738794 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bfeff1-8152-41b2-8c83-78dabad7ae64 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:16:58.747793 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451982c2-3c66-4075-9145-5a420b86b55a None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:16:58.773218 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 824/1637] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 5 12:16:58 2022] PUT /identity/v3/projects/4cc691ee746a4913802bd95421fdd2a7/users/7ecd6e7a7a5c4d8c9497bf3ef9fc7f06/roles/16e2ccc8bd1b497d8cee780c1c7df0d2 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:16:58.773218 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fef057c-b354-4f4d-8854-4ae2db7e344f None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:16:58.773218 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fef057c-b354-4f4d-8854-4ae2db7e344f None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:16:58.773218 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fef057c-b354-4f4d-8854-4ae2db7e344f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:16:58.801279 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-9fef057c-b354-4f4d-8854-4ae2db7e344f None None] MFA Rules not processed for user `cb060ff495bc4abb83ff88992fb7be09`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:16:58.810775 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-9fef057c-b354-4f4d-8854-4ae2db7e344f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:16:58.824559 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2849d110-7dc5-4802-aab2-8b08a6149e7c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37633bbae0c2423c81ccd61ac3a17ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:16:58.825226 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2849d110-7dc5-4802-aab2-8b08a6149e7c service cinder] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:16:58.825508 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2849d110-7dc5-4802-aab2-8b08a6149e7c service cinder] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:16:58.825784 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2849d110-7dc5-4802-aab2-8b08a6149e7c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:16:58.835842 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:16:58.926407 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2849d110-7dc5-4802-aab2-8b08a6149e7c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:16:58.928158 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2849d110-7dc5-4802-aab2-8b08a6149e7c service cinder] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:16:58.933200 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 825/1638] 10.222.0.50 () {58 vars in 1009 bytes} [Mon Sep 5 12:16:58 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:16:58.934210 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fef057c-b354-4f4d-8854-4ae2db7e344f None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:16:58.948582 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 814/1639] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:16:58 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:16:58.950870 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaa29c4-db95-4312-b91f-831aad4c2ccb None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:16:58.951313 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaa29c4-db95-4312-b91f-831aad4c2ccb None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:16:58.951694 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaa29c4-db95-4312-b91f-831aad4c2ccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:16:58.971778 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fef057c-b354-4f4d-8854-4ae2db7e344f None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:16:58.982558 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f54b75-9e62-461c-9b1b-36258f3d1918 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37633bbae0c2423c81ccd61ac3a17ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:16:58.983283 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f54b75-9e62-461c-9b1b-36258f3d1918 service cinder] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:16:58.983627 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f54b75-9e62-461c-9b1b-36258f3d1918 service cinder] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:16:58.984053 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f54b75-9e62-461c-9b1b-36258f3d1918 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:16:58.997934 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-bcaa29c4-db95-4312-b91f-831aad4c2ccb None None] MFA Rules not processed for user `7ecd6e7a7a5c4d8c9497bf3ef9fc7f06`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:16:58.999659 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-bcaa29c4-db95-4312-b91f-831aad4c2ccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:16:59.011887 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f54b75-9e62-461c-9b1b-36258f3d1918 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:16:59.015782 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f54b75-9e62-461c-9b1b-36258f3d1918 service cinder] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:16:59.059445 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 826/1640] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:16:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:16:59.087278 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f54b75-9e62-461c-9b1b-36258f3d1918 service cinder] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:16:59.099084 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f54b75-9e62-461c-9b1b-36258f3d1918 service cinder] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:16:59.113860 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8854441c-f2d1-451c-ac78-bbe33a8c1de7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37633bbae0c2423c81ccd61ac3a17ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:16:59.114594 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8854441c-f2d1-451c-ac78-bbe33a8c1de7 service cinder] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:16:59.114887 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8854441c-f2d1-451c-ac78-bbe33a8c1de7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:16:59.115168 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8854441c-f2d1-451c-ac78-bbe33a8c1de7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:16:59.129165 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 815/1641] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:16:58 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:16:59.140597 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8854441c-f2d1-451c-ac78-bbe33a8c1de7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:16:59.142347 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8854441c-f2d1-451c-ac78-bbe33a8c1de7 service cinder] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:16:59.156090 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 827/1642] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:16:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:16:59.822424 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaa29c4-db95-4312-b91f-831aad4c2ccb None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:16:59.838078 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaa29c4-db95-4312-b91f-831aad4c2ccb None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:16:59.843260 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab31839-1112-4ca4-af6b-edddc1a8d811 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37633bbae0c2423c81ccd61ac3a17ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:16:59.843890 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab31839-1112-4ca4-af6b-edddc1a8d811 service cinder] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:16:59.844169 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab31839-1112-4ca4-af6b-edddc1a8d811 service cinder] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:16:59.844444 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab31839-1112-4ca4-af6b-edddc1a8d811 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:00.073911 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab31839-1112-4ca4-af6b-edddc1a8d811 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:00.073911 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab31839-1112-4ca4-af6b-edddc1a8d811 service cinder] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:00.110014 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 816/1643] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:16:59 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:17:02.317450 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8854441c-f2d1-451c-ac78-bbe33a8c1de7 service cinder] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:02.528940 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8854441c-f2d1-451c-ac78-bbe33a8c1de7 service cinder] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:02.540679 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078bc16d-15bb-45cc-854a-93e902b9aec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:02.542080 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078bc16d-15bb-45cc-854a-93e902b9aec3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:02.544326 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078bc16d-15bb-45cc-854a-93e902b9aec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:02.545035 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078bc16d-15bb-45cc-854a-93e902b9aec3 admin admin] PATH_INFO: `/v3/users/2e832e88020146438f581f98d4300d10` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:02.547618 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078bc16d-15bb-45cc-854a-93e902b9aec3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e832e88020146438f581f98d4300d10)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:02.550542 dv-cinder-855189-1-smb devstack@keystone.service[81719]: WARNING py.warnings [None req-078bc16d-15bb-45cc-854a-93e902b9aec3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 05 12:17:02.550542 dv-cinder-855189-1-smb devstack@keystone.service[81719]: warnings.warn(msg) Sep 05 12:17:02.550542 dv-cinder-855189-1-smb devstack@keystone.service[81719]: Sep 05 12:17:02.554676 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078bc16d-15bb-45cc-854a-93e902b9aec3 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:02.817937 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-078bc16d-15bb-45cc-854a-93e902b9aec3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e832e88020146438f581f98d4300d10'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:02.825451 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-078bc16d-15bb-45cc-854a-93e902b9aec3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e832e88020146438f581f98d4300d10'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:02.866155 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-078bc16d-15bb-45cc-854a-93e902b9aec3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e832e88020146438f581f98d4300d10'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:02.867301 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-078bc16d-15bb-45cc-854a-93e902b9aec3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e832e88020146438f581f98d4300d10'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:02.882678 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:02.892623 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab31839-1112-4ca4-af6b-edddc1a8d811 service cinder] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:02.911745 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab31839-1112-4ca4-af6b-edddc1a8d811 service cinder] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:02.923565 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-078bc16d-15bb-45cc-854a-93e902b9aec3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e832e88020146438f581f98d4300d10'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:02.941645 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f182201-eaab-474d-b0fb-2c127872b90f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:02.946107 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f182201-eaab-474d-b0fb-2c127872b90f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:02.946669 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f182201-eaab-474d-b0fb-2c127872b90f admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:02.947124 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f182201-eaab-474d-b0fb-2c127872b90f admin admin] PATH_INFO: `/v3/users/c8f7e01d063e4a39ab4f51e353868898` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:02.952789 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f182201-eaab-474d-b0fb-2c127872b90f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8f7e01d063e4a39ab4f51e353868898)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:02.954954 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f182201-eaab-474d-b0fb-2c127872b90f admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:02.989136 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 828/1644] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 5 12:17:02 2022] DELETE /identity/v3/users/2e832e88020146438f581f98d4300d10 => generated 0 bytes in 672 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:17:02.993777 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb15c76f-f1f6-4b38-b548-22b089152283 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:02.994441 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb15c76f-f1f6-4b38-b548-22b089152283 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:02.994850 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb15c76f-f1f6-4b38-b548-22b089152283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:03.016617 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:03.067716 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-1f182201-eaab-474d-b0fb-2c127872b90f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8f7e01d063e4a39ab4f51e353868898'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:03.073354 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-1f182201-eaab-474d-b0fb-2c127872b90f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8f7e01d063e4a39ab4f51e353868898'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:03.088797 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-fb15c76f-f1f6-4b38-b548-22b089152283 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:17:03.089542 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-fb15c76f-f1f6-4b38-b548-22b089152283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:03.094241 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-1f182201-eaab-474d-b0fb-2c127872b90f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8f7e01d063e4a39ab4f51e353868898'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:03.095058 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-1f182201-eaab-474d-b0fb-2c127872b90f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8f7e01d063e4a39ab4f51e353868898'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:03.141855 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-1f182201-eaab-474d-b0fb-2c127872b90f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8f7e01d063e4a39ab4f51e353868898'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:03.193011 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 817/1645] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 5 12:17:02 2022] DELETE /identity/v3/users/c8f7e01d063e4a39ab4f51e353868898 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:17:03.194744 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c7bc37-9357-4c80-aaeb-3a26faa60609 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:03.195106 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c7bc37-9357-4c80-aaeb-3a26faa60609 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:03.195455 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c7bc37-9357-4c80-aaeb-3a26faa60609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:03.258252 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-44c7bc37-9357-4c80-aaeb-3a26faa60609 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:17:03.271841 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-44c7bc37-9357-4c80-aaeb-3a26faa60609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:03.276557 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 829/1646] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:17:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:17:03.296263 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb15c76f-f1f6-4b38-b548-22b089152283 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:03.298431 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-fb15c76f-f1f6-4b38-b548-22b089152283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:03.444233 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb15c76f-f1f6-4b38-b548-22b089152283 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:03.462640 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 818/1647] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:17:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:17:03.478269 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c7bc37-9357-4c80-aaeb-3a26faa60609 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:03.574064 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c5a442-7d16-4769-8c5a-1d6eb8cb8f71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4994b4faa4ec4aa088f3dc32c9c5614d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:03.574903 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c5a442-7d16-4769-8c5a-1d6eb8cb8f71 service neutron] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:03.575194 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c5a442-7d16-4769-8c5a-1d6eb8cb8f71 service neutron] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:03.575471 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c5a442-7d16-4769-8c5a-1d6eb8cb8f71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:03.601500 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c5a442-7d16-4769-8c5a-1d6eb8cb8f71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:03.604235 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c5a442-7d16-4769-8c5a-1d6eb8cb8f71 service neutron] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:03.632407 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 830/1648] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:17:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 12:17:03.634739 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c5a442-7d16-4769-8c5a-1d6eb8cb8f71 service neutron] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:03.637857 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-32c5a442-7d16-4769-8c5a-1d6eb8cb8f71 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:03.639236 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c7bc37-9357-4c80-aaeb-3a26faa60609 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:03.648302 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228b9fab-b1d6-47c1-bbb4-8df69fd86573 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4994b4faa4ec4aa088f3dc32c9c5614d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:03.648977 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228b9fab-b1d6-47c1-bbb4-8df69fd86573 service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:03.649768 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228b9fab-b1d6-47c1-bbb4-8df69fd86573 service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:03.649768 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228b9fab-b1d6-47c1-bbb4-8df69fd86573 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:03.689799 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228b9fab-b1d6-47c1-bbb4-8df69fd86573 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:03.691205 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228b9fab-b1d6-47c1-bbb4-8df69fd86573 service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:03.716172 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 819/1649] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:17:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:17:03.738129 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:03.816957 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c5a442-7d16-4769-8c5a-1d6eb8cb8f71 service neutron] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:03.826423 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c83e9cf-8446-4a04-8e92-f50290076579 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37633bbae0c2423c81ccd61ac3a17ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:03.827180 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c83e9cf-8446-4a04-8e92-f50290076579 service cinder] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:03.827417 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c83e9cf-8446-4a04-8e92-f50290076579 service cinder] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:03.827724 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c83e9cf-8446-4a04-8e92-f50290076579 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:03.830418 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-9c83e9cf-8446-4a04-8e92-f50290076579 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:03.990704 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c83e9cf-8446-4a04-8e92-f50290076579 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:03.992336 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c83e9cf-8446-4a04-8e92-f50290076579 service cinder] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:04.017812 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 831/1650] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:17:03 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:17:04.366456 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228b9fab-b1d6-47c1-bbb4-8df69fd86573 service neutron] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:04.368370 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-228b9fab-b1d6-47c1-bbb4-8df69fd86573 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:04.400289 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228b9fab-b1d6-47c1-bbb4-8df69fd86573 service neutron] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:04.415079 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6030fa-7171-45ef-816b-1f43156128b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:04.415797 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6030fa-7171-45ef-816b-1f43156128b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:04.416026 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6030fa-7171-45ef-816b-1f43156128b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:04.416305 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6030fa-7171-45ef-816b-1f43156128b0 admin admin] PATH_INFO: `/v3/projects/4ffe18e829cc461a9fe786cb8bde8932` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:04.417794 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6030fa-7171-45ef-816b-1f43156128b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ffe18e829cc461a9fe786cb8bde8932)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:04.425781 dv-cinder-855189-1-smb devstack@keystone.service[81720]: WARNING py.warnings [None req-df6030fa-7171-45ef-816b-1f43156128b0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 05 12:17:04.425781 dv-cinder-855189-1-smb devstack@keystone.service[81720]: warnings.warn(msg) Sep 05 12:17:04.425781 dv-cinder-855189-1-smb devstack@keystone.service[81720]: Sep 05 12:17:04.426994 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6030fa-7171-45ef-816b-1f43156128b0 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:04.534223 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:04.578533 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-df6030fa-7171-45ef-816b-1f43156128b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ffe18e829cc461a9fe786cb8bde8932', 'request_id': 'req-df6030fa-7171-45ef-816b-1f43156128b0'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:04.589297 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-df6030fa-7171-45ef-816b-1f43156128b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ffe18e829cc461a9fe786cb8bde8932', 'request_id': 'req-df6030fa-7171-45ef-816b-1f43156128b0'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:04.618862 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-df6030fa-7171-45ef-816b-1f43156128b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ffe18e829cc461a9fe786cb8bde8932', 'request_id': 'req-df6030fa-7171-45ef-816b-1f43156128b0'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:04.632596 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-df6030fa-7171-45ef-816b-1f43156128b0 admin admin] The token cache is being invalidate because project 4ffe18e829cc461a9fe786cb8bde8932 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:17:04.632907 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-df6030fa-7171-45ef-816b-1f43156128b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:04.633674 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-df6030fa-7171-45ef-816b-1f43156128b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:04.639783 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 820/1651] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 5 12:17:04 2022] DELETE /identity/v3/projects/4ffe18e829cc461a9fe786cb8bde8932 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:17:04.641248 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db207d7d-8444-46bc-9968-4fffc3b2b823 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:04.641740 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db207d7d-8444-46bc-9968-4fffc3b2b823 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:04.641829 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db207d7d-8444-46bc-9968-4fffc3b2b823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:04.688408 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-db207d7d-8444-46bc-9968-4fffc3b2b823 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:17:04.696763 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-db207d7d-8444-46bc-9968-4fffc3b2b823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:04.721629 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6030fa-7171-45ef-816b-1f43156128b0 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:04.729052 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-df6030fa-7171-45ef-816b-1f43156128b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:04.866889 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 832/1652] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:17:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:17:04.878493 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6030fa-7171-45ef-816b-1f43156128b0 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:04.878756 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964aa7ca-f5c1-4d13-95a3-cfc4065aa19d None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:04.879270 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964aa7ca-f5c1-4d13-95a3-cfc4065aa19d None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:04.883105 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964aa7ca-f5c1-4d13-95a3-cfc4065aa19d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:04.896587 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dbe70d-c587-4439-8421-fe4056329893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:04.897349 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dbe70d-c587-4439-8421-fe4056329893 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:04.897838 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dbe70d-c587-4439-8421-fe4056329893 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:04.898123 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dbe70d-c587-4439-8421-fe4056329893 admin admin] PATH_INFO: `/v3/projects/ef0535923bcc49038ef9a6a0b8094ac2` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:04.901757 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dbe70d-c587-4439-8421-fe4056329893 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef0535923bcc49038ef9a6a0b8094ac2)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:04.903993 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dbe70d-c587-4439-8421-fe4056329893 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:04.970790 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-964aa7ca-f5c1-4d13-95a3-cfc4065aa19d None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:17:04.973600 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-964aa7ca-f5c1-4d13-95a3-cfc4065aa19d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:05.001922 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 833/1653] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:17:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:17:05.003697 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964aa7ca-f5c1-4d13-95a3-cfc4065aa19d None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:05.027529 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964aa7ca-f5c1-4d13-95a3-cfc4065aa19d None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:05.042101 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-49dbe70d-c587-4439-8421-fe4056329893 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef0535923bcc49038ef9a6a0b8094ac2', 'request_id': 'req-49dbe70d-c587-4439-8421-fe4056329893'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:05.061875 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-49dbe70d-c587-4439-8421-fe4056329893 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef0535923bcc49038ef9a6a0b8094ac2', 'request_id': 'req-49dbe70d-c587-4439-8421-fe4056329893'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:05.070276 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-49dbe70d-c587-4439-8421-fe4056329893 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef0535923bcc49038ef9a6a0b8094ac2', 'request_id': 'req-49dbe70d-c587-4439-8421-fe4056329893'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:05.129468 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-49dbe70d-c587-4439-8421-fe4056329893 admin admin] The token cache is being invalidate because project ef0535923bcc49038ef9a6a0b8094ac2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:17:05.129468 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-49dbe70d-c587-4439-8421-fe4056329893 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:05.132206 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-49dbe70d-c587-4439-8421-fe4056329893 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:05.138987 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 821/1654] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 5 12:17:04 2022] DELETE /identity/v3/projects/ef0535923bcc49038ef9a6a0b8094ac2 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:17:05.143022 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dbe70d-c587-4439-8421-fe4056329893 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:05.149887 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-49dbe70d-c587-4439-8421-fe4056329893 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:05.256619 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38172f0-6ff5-47af-b1c3-aba902496839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:05.266715 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38172f0-6ff5-47af-b1c3-aba902496839 admin admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:05.267421 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38172f0-6ff5-47af-b1c3-aba902496839 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:05.268414 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38172f0-6ff5-47af-b1c3-aba902496839 admin admin] PATH_INFO: `/v3/domains` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:05.269433 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38172f0-6ff5-47af-b1c3-aba902496839 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:17:05.279116 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38172f0-6ff5-47af-b1c3-aba902496839 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:05.279116 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38172f0-6ff5-47af-b1c3-aba902496839 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:05.328192 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 834/1655] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Sep 5 12:17:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:17:05.336305 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38172f0-6ff5-47af-b1c3-aba902496839 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:05.340703 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-e38172f0-6ff5-47af-b1c3-aba902496839 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:05.373940 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:05.385657 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38172f0-6ff5-47af-b1c3-aba902496839 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:05.390119 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dbe70d-c587-4439-8421-fe4056329893 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:05.399624 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a205fc2c-f76f-4bbe-ad28-13f9ae6ba8f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:05.400502 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a205fc2c-f76f-4bbe-ad28-13f9ae6ba8f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:05.401030 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a205fc2c-f76f-4bbe-ad28-13f9ae6ba8f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:05.401482 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a205fc2c-f76f-4bbe-ad28-13f9ae6ba8f7 admin admin] PATH_INFO: `/v3/users/cb577739597a4623a1ab732f0ca81448` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:05.403418 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a205fc2c-f76f-4bbe-ad28-13f9ae6ba8f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb577739597a4623a1ab732f0ca81448)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:05.405615 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a205fc2c-f76f-4bbe-ad28-13f9ae6ba8f7 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:05.409991 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2591037e-641d-48b9-b232-51d18d94168c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:05.410641 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2591037e-641d-48b9-b232-51d18d94168c admin admin] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:05.410931 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2591037e-641d-48b9-b232-51d18d94168c admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:05.411211 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2591037e-641d-48b9-b232-51d18d94168c admin admin] PATH_INFO: `/v3/projects` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:05.411863 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2591037e-641d-48b9-b232-51d18d94168c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:05.421156 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2591037e-641d-48b9-b232-51d18d94168c admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:05.467154 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:05.502992 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 835/1656] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 5 12:17:05 2022] POST /identity/v3/projects => generated 373 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:17:05.503864 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2591037e-641d-48b9-b232-51d18d94168c admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:05.515670 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-2591037e-641d-48b9-b232-51d18d94168c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:05.517730 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-a205fc2c-f76f-4bbe-ad28-13f9ae6ba8f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb577739597a4623a1ab732f0ca81448'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:05.518867 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-a205fc2c-f76f-4bbe-ad28-13f9ae6ba8f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb577739597a4623a1ab732f0ca81448'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:05.537178 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-a205fc2c-f76f-4bbe-ad28-13f9ae6ba8f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb577739597a4623a1ab732f0ca81448'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:05.538197 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-a205fc2c-f76f-4bbe-ad28-13f9ae6ba8f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb577739597a4623a1ab732f0ca81448'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:05.567619 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-a205fc2c-f76f-4bbe-ad28-13f9ae6ba8f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb577739597a4623a1ab732f0ca81448'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:05.613101 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 822/1657] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 5 12:17:05 2022] DELETE /identity/v3/users/cb577739597a4623a1ab732f0ca81448 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:17:05.614095 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a205fc2c-f76f-4bbe-ad28-13f9ae6ba8f7 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:05.615543 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-a205fc2c-f76f-4bbe-ad28-13f9ae6ba8f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:05.672033 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2591037e-641d-48b9-b232-51d18d94168c admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:05.746046 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b015182-8534-49ee-9f34-bd20ec21b163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:05.746614 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b015182-8534-49ee-9f34-bd20ec21b163 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:05.746890 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b015182-8534-49ee-9f34-bd20ec21b163 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:05.747168 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b015182-8534-49ee-9f34-bd20ec21b163 admin admin] PATH_INFO: `/v3/users/3d709333b17f42f9846b5a5781d52585` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:05.760490 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b015182-8534-49ee-9f34-bd20ec21b163 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d709333b17f42f9846b5a5781d52585)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:05.764029 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b015182-8534-49ee-9f34-bd20ec21b163 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:05.786162 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a205fc2c-f76f-4bbe-ad28-13f9ae6ba8f7 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:05.807067 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beae566d-5dcf-4fe0-96ea-3895ce71e23c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:05.808688 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beae566d-5dcf-4fe0-96ea-3895ce71e23c admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:05.809715 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beae566d-5dcf-4fe0-96ea-3895ce71e23c admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:05.809715 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beae566d-5dcf-4fe0-96ea-3895ce71e23c admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:05.810044 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beae566d-5dcf-4fe0-96ea-3895ce71e23c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:05.812389 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beae566d-5dcf-4fe0-96ea-3895ce71e23c admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:05.870854 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 823/1658] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 5 12:17:05 2022] POST /identity/v3/users => generated 287 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:17:05.872607 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beae566d-5dcf-4fe0-96ea-3895ce71e23c admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:05.896867 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beae566d-5dcf-4fe0-96ea-3895ce71e23c admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:05.898605 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-1b015182-8534-49ee-9f34-bd20ec21b163 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d709333b17f42f9846b5a5781d52585'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:05.899409 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-1b015182-8534-49ee-9f34-bd20ec21b163 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d709333b17f42f9846b5a5781d52585'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:05.913153 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d4a086-732b-410e-bcfb-6073b9651a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:05.913905 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d4a086-732b-410e-bcfb-6073b9651a55 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:05.914256 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d4a086-732b-410e-bcfb-6073b9651a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:05.914531 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d4a086-732b-410e-bcfb-6073b9651a55 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:05.915345 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d4a086-732b-410e-bcfb-6073b9651a55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:05.917086 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d4a086-732b-410e-bcfb-6073b9651a55 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:05.920414 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-1b015182-8534-49ee-9f34-bd20ec21b163 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d709333b17f42f9846b5a5781d52585'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:05.921097 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-1b015182-8534-49ee-9f34-bd20ec21b163 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d709333b17f42f9846b5a5781d52585'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:05.951612 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 824/1659] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:17:05 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:17:05.951817 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-1b015182-8534-49ee-9f34-bd20ec21b163 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d709333b17f42f9846b5a5781d52585'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:05.954802 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d4a086-732b-410e-bcfb-6073b9651a55 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:05.959480 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-49d4a086-732b-410e-bcfb-6073b9651a55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:05.985675 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 836/1660] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 5 12:17:05 2022] DELETE /identity/v3/users/3d709333b17f42f9846b5a5781d52585 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:17:05.990136 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83caaf67-3886-4080-9c90-2b37b88b9a82 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:05.990426 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83caaf67-3886-4080-9c90-2b37b88b9a82 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:05.993087 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d4a086-732b-410e-bcfb-6073b9651a55 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:05.994057 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83caaf67-3886-4080-9c90-2b37b88b9a82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:06.050534 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-83caaf67-3886-4080-9c90-2b37b88b9a82 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:17:06.051784 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-83caaf67-3886-4080-9c90-2b37b88b9a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:06.076851 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:06.170319 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:06.200290 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8307523-bc21-458e-bc1d-0ac1113060c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:06.200951 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8307523-bc21-458e-bc1d-0ac1113060c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:06.207427 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8307523-bc21-458e-bc1d-0ac1113060c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:06.207735 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8307523-bc21-458e-bc1d-0ac1113060c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:06.208583 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8307523-bc21-458e-bc1d-0ac1113060c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:06.213868 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8307523-bc21-458e-bc1d-0ac1113060c3 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:06.247569 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 825/1661] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:17:05 2022] GET /identity/v3/roles => generated 1420 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:17:06.249318 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8307523-bc21-458e-bc1d-0ac1113060c3 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:06.275908 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 837/1662] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:17:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 12:17:06.283019 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8307523-bc21-458e-bc1d-0ac1113060c3 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:06.287602 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83caaf67-3886-4080-9c90-2b37b88b9a82 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:06.288002 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-83caaf67-3886-4080-9c90-2b37b88b9a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:06.295328 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832ada89-d929-44be-8f66-dc31974c5f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:06.296018 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832ada89-d929-44be-8f66-dc31974c5f8c admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:06.296300 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832ada89-d929-44be-8f66-dc31974c5f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:06.296572 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832ada89-d929-44be-8f66-dc31974c5f8c admin admin] PATH_INFO: `/v3/projects/cba4736624104e45a6b2c30401e1bfcc/users/26f53f2937584e7d805fd6533fd027e1/roles/ed72181e1403401facb77dcf33644757` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:06.361919 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832ada89-d929-44be-8f66-dc31974c5f8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=cba4736624104e45a6b2c30401e1bfcc, user_id=26f53f2937584e7d805fd6533fd027e1, role_id=ed72181e1403401facb77dcf33644757)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:06.368662 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832ada89-d929-44be-8f66-dc31974c5f8c admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:06.413253 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 826/1663] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 5 12:17:06 2022] PUT /identity/v3/projects/cba4736624104e45a6b2c30401e1bfcc/users/26f53f2937584e7d805fd6533fd027e1/roles/ed72181e1403401facb77dcf33644757 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:17:06.413253 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832ada89-d929-44be-8f66-dc31974c5f8c admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:06.413253 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-832ada89-d929-44be-8f66-dc31974c5f8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:06.476092 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83caaf67-3886-4080-9c90-2b37b88b9a82 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:06.521234 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832ada89-d929-44be-8f66-dc31974c5f8c admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:06.534233 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b10d9c-112a-47b3-a736-6a9fffff715c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:06.534933 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b10d9c-112a-47b3-a736-6a9fffff715c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:06.535996 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b10d9c-112a-47b3-a736-6a9fffff715c admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:06.536114 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b10d9c-112a-47b3-a736-6a9fffff715c admin admin] PATH_INFO: `/v3/projects/560909e8f9b949c49ecef71e80e191c5` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:06.539953 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b10d9c-112a-47b3-a736-6a9fffff715c admin admin] RBAC: Authorizing `identity:delete_project(project_id=560909e8f9b949c49ecef71e80e191c5)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:06.544934 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b10d9c-112a-47b3-a736-6a9fffff715c admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:06.638481 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d72aa31-d013-460d-84bd-a52b88481ec1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4994b4faa4ec4aa088f3dc32c9c5614d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:06.639154 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d72aa31-d013-460d-84bd-a52b88481ec1 service neutron] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:06.639431 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d72aa31-d013-460d-84bd-a52b88481ec1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:06.639730 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d72aa31-d013-460d-84bd-a52b88481ec1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:06.665246 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d72aa31-d013-460d-84bd-a52b88481ec1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:06.667557 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d72aa31-d013-460d-84bd-a52b88481ec1 service neutron] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:06.688293 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 838/1664] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:17:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 12:17:06.690613 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d835d161-a60d-4175-bf54-a379f6a9b3b4 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:06.691050 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d835d161-a60d-4175-bf54-a379f6a9b3b4 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:06.691522 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d835d161-a60d-4175-bf54-a379f6a9b3b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:06.713977 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-d0b10d9c-112a-47b3-a736-6a9fffff715c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '560909e8f9b949c49ecef71e80e191c5', 'request_id': 'req-d0b10d9c-112a-47b3-a736-6a9fffff715c'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:06.733428 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-d0b10d9c-112a-47b3-a736-6a9fffff715c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '560909e8f9b949c49ecef71e80e191c5', 'request_id': 'req-d0b10d9c-112a-47b3-a736-6a9fffff715c'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:06.746141 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-d0b10d9c-112a-47b3-a736-6a9fffff715c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '560909e8f9b949c49ecef71e80e191c5', 'request_id': 'req-d0b10d9c-112a-47b3-a736-6a9fffff715c'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:06.816955 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-d835d161-a60d-4175-bf54-a379f6a9b3b4 None None] MFA Rules not processed for user `26f53f2937584e7d805fd6533fd027e1`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:17:06.817831 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-d0b10d9c-112a-47b3-a736-6a9fffff715c admin admin] The token cache is being invalidate because project 560909e8f9b949c49ecef71e80e191c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:17:06.820602 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-d0b10d9c-112a-47b3-a736-6a9fffff715c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:06.827286 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-d0b10d9c-112a-47b3-a736-6a9fffff715c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:06.827720 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-d835d161-a60d-4175-bf54-a379f6a9b3b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:06.834147 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 827/1665] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 5 12:17:06 2022] DELETE /identity/v3/projects/560909e8f9b949c49ecef71e80e191c5 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:17:06.856428 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2754de77-68b3-440f-99c2-12251a8db5d9 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:06.856834 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2754de77-68b3-440f-99c2-12251a8db5d9 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:06.857774 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2754de77-68b3-440f-99c2-12251a8db5d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:06.948223 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-2754de77-68b3-440f-99c2-12251a8db5d9 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:17:06.950341 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-2754de77-68b3-440f-99c2-12251a8db5d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:07.062198 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 839/1666] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:17:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 372 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:17:07.075462 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d835d161-a60d-4175-bf54-a379f6a9b3b4 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:07.077666 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-d835d161-a60d-4175-bf54-a379f6a9b3b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:07.115791 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:07.116155 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:07.146451 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 828/1667] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:17:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:17:07.162565 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3472faf4-40e4-48ba-88ab-944d7ed0733f None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:07.163152 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3472faf4-40e4-48ba-88ab-944d7ed0733f None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:07.163566 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3472faf4-40e4-48ba-88ab-944d7ed0733f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:07.222095 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-3472faf4-40e4-48ba-88ab-944d7ed0733f None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:17:07.229572 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-3472faf4-40e4-48ba-88ab-944d7ed0733f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:07.267258 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 829/1668] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:17:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:17:07.271361 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3472faf4-40e4-48ba-88ab-944d7ed0733f None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:07.286703 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d835d161-a60d-4175-bf54-a379f6a9b3b4 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:07.303259 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3472faf4-40e4-48ba-88ab-944d7ed0733f None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:07.305762 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f9639e-28a7-485e-8e41-31057d5c92e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb060ff495bc4abb83ff88992fb7be09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:07.306594 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f9639e-28a7-485e-8e41-31057d5c92e8 service nova] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:07.306883 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f9639e-28a7-485e-8e41-31057d5c92e8 service nova] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:07.307159 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f9639e-28a7-485e-8e41-31057d5c92e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:07.318054 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e56967-8df0-4649-836f-23a7244050e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:07.318694 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e56967-8df0-4649-836f-23a7244050e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:07.318972 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e56967-8df0-4649-836f-23a7244050e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:07.320144 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e56967-8df0-4649-836f-23a7244050e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:07.320144 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e56967-8df0-4649-836f-23a7244050e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:17:07.320323 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e56967-8df0-4649-836f-23a7244050e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:07.322619 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e56967-8df0-4649-836f-23a7244050e4 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:07.328785 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f9639e-28a7-485e-8e41-31057d5c92e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:07.331145 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f9639e-28a7-485e-8e41-31057d5c92e8 service nova] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:07.350836 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 840/1669] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:17:07 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:17:07.379711 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 830/1670] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Sep 5 12:17:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:17:07.385261 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f9639e-28a7-485e-8e41-31057d5c92e8 service nova] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:07.412467 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f9639e-28a7-485e-8e41-31057d5c92e8 service nova] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:07.430528 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a526766a-5e16-4e76-885d-78c8be6ab945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:07.430528 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a526766a-5e16-4e76-885d-78c8be6ab945 admin admin] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:07.430528 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a526766a-5e16-4e76-885d-78c8be6ab945 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:07.430528 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a526766a-5e16-4e76-885d-78c8be6ab945 admin admin] PATH_INFO: `/v3/projects` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:07.431157 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a526766a-5e16-4e76-885d-78c8be6ab945 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:07.431237 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a526766a-5e16-4e76-885d-78c8be6ab945 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:07.531030 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e56967-8df0-4649-836f-23a7244050e4 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:07.533802 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-60e56967-8df0-4649-836f-23a7244050e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:07.538131 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 841/1671] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 5 12:17:07 2022] POST /identity/v3/projects => generated 385 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:17:07.544873 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a526766a-5e16-4e76-885d-78c8be6ab945 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:07.611465 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e56967-8df0-4649-836f-23a7244050e4 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:07.702332 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a526766a-5e16-4e76-885d-78c8be6ab945 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:07.714722 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1544f0-1680-44f1-a1ab-fddf206b3113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:07.715411 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1544f0-1680-44f1-a1ab-fddf206b3113 admin admin] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:07.715714 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1544f0-1680-44f1-a1ab-fddf206b3113 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:07.715978 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1544f0-1680-44f1-a1ab-fddf206b3113 admin admin] PATH_INFO: `/v3/users` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:07.716720 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1544f0-1680-44f1-a1ab-fddf206b3113 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:07.718603 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1544f0-1680-44f1-a1ab-fddf206b3113 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:07.806840 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 842/1672] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 5 12:17:07 2022] POST /identity/v3/users => generated 293 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 12:17:07.810967 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1544f0-1680-44f1-a1ab-fddf206b3113 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:07.813433 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-ee1544f0-1680-44f1-a1ab-fddf206b3113 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:07.887522 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1544f0-1680-44f1-a1ab-fddf206b3113 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:07.898636 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7c8076-7ea6-4fcf-b477-32453ae84be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:07.899355 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7c8076-7ea6-4fcf-b477-32453ae84be1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:07.899573 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7c8076-7ea6-4fcf-b477-32453ae84be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:07.899868 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7c8076-7ea6-4fcf-b477-32453ae84be1 admin admin] PATH_INFO: `/v3/projects/608133f89e744849bc82b275320ca037` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:07.902024 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93db8fa-d5e9-4ebc-b621-e617908abbb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:07.905854 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93db8fa-d5e9-4ebc-b621-e617908abbb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:07.906179 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93db8fa-d5e9-4ebc-b621-e617908abbb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:07.906475 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93db8fa-d5e9-4ebc-b621-e617908abbb6 admin admin] PATH_INFO: `/v3/users/26f53f2937584e7d805fd6533fd027e1` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:07.907910 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7c8076-7ea6-4fcf-b477-32453ae84be1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=608133f89e744849bc82b275320ca037)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:07.910088 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7c8076-7ea6-4fcf-b477-32453ae84be1 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:07.912745 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93db8fa-d5e9-4ebc-b621-e617908abbb6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26f53f2937584e7d805fd6533fd027e1)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:07.935058 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93db8fa-d5e9-4ebc-b621-e617908abbb6 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:08.051957 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-1b7c8076-7ea6-4fcf-b477-32453ae84be1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '608133f89e744849bc82b275320ca037', 'request_id': 'req-1b7c8076-7ea6-4fcf-b477-32453ae84be1'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:08.086854 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-d93db8fa-d5e9-4ebc-b621-e617908abbb6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26f53f2937584e7d805fd6533fd027e1'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:08.088975 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-1b7c8076-7ea6-4fcf-b477-32453ae84be1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '608133f89e744849bc82b275320ca037', 'request_id': 'req-1b7c8076-7ea6-4fcf-b477-32453ae84be1'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:08.093168 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-d93db8fa-d5e9-4ebc-b621-e617908abbb6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26f53f2937584e7d805fd6533fd027e1'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:08.110444 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=87,keystone:INSERT=5,keystone:DELETE=8 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:08.130215 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-1b7c8076-7ea6-4fcf-b477-32453ae84be1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '608133f89e744849bc82b275320ca037', 'request_id': 'req-1b7c8076-7ea6-4fcf-b477-32453ae84be1'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:08.134313 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-d93db8fa-d5e9-4ebc-b621-e617908abbb6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26f53f2937584e7d805fd6533fd027e1'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:08.135440 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-d93db8fa-d5e9-4ebc-b621-e617908abbb6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26f53f2937584e7d805fd6533fd027e1'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:08.162324 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-1b7c8076-7ea6-4fcf-b477-32453ae84be1 admin admin] The token cache is being invalidate because project 608133f89e744849bc82b275320ca037 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:17:08.162623 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-1b7c8076-7ea6-4fcf-b477-32453ae84be1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:08.163585 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-1b7c8076-7ea6-4fcf-b477-32453ae84be1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:08.166025 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 831/1673] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 5 12:17:07 2022] DELETE /identity/v3/projects/608133f89e744849bc82b275320ca037 => generated 0 bytes in 636 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:17:08.166821 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7c8076-7ea6-4fcf-b477-32453ae84be1 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:08.175887 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-1b7c8076-7ea6-4fcf-b477-32453ae84be1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:08.181087 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-d93db8fa-d5e9-4ebc-b621-e617908abbb6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26f53f2937584e7d805fd6533fd027e1'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:08.210909 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 843/1674] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 5 12:17:07 2022] DELETE /identity/v3/users/26f53f2937584e7d805fd6533fd027e1 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:17:08.220480 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f75318-4250-427a-b976-e9a94a9c6add None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:08.221109 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f75318-4250-427a-b976-e9a94a9c6add None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:08.221598 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f75318-4250-427a-b976-e9a94a9c6add None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:08.263765 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-e9f75318-4250-427a-b976-e9a94a9c6add None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:17:08.265319 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-e9f75318-4250-427a-b976-e9a94a9c6add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:08.306846 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7c8076-7ea6-4fcf-b477-32453ae84be1 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:08.345164 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:08.396365 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 844/1675] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:17:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:17:08.402705 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36f79ae-3301-4925-8e10-898bbaef7444 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:08.402992 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36f79ae-3301-4925-8e10-898bbaef7444 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:08.403266 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36f79ae-3301-4925-8e10-898bbaef7444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:08.432105 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-b36f79ae-3301-4925-8e10-898bbaef7444 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:17:08.433454 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-b36f79ae-3301-4925-8e10-898bbaef7444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:08.444156 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 845/1676] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:17:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:17:08.445662 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff17f7f-586c-4d73-b95d-9a08e8e71330 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:08.446163 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff17f7f-586c-4d73-b95d-9a08e8e71330 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:08.446444 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff17f7f-586c-4d73-b95d-9a08e8e71330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:08.453025 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25c303f-6dd3-4f1c-bf0d-895f805b907d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:08.453835 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25c303f-6dd3-4f1c-bf0d-895f805b907d admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:08.454388 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25c303f-6dd3-4f1c-bf0d-895f805b907d admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:08.454804 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25c303f-6dd3-4f1c-bf0d-895f805b907d admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:08.455538 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25c303f-6dd3-4f1c-bf0d-895f805b907d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:08.462311 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25c303f-6dd3-4f1c-bf0d-895f805b907d admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:08.480956 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 832/1677] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:17:08 2022] GET /identity/v3/roles => generated 1420 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:17:08.485567 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25c303f-6dd3-4f1c-bf0d-895f805b907d admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:08.487734 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-b25c303f-6dd3-4f1c-bf0d-895f805b907d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:08.488026 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-8ff17f7f-586c-4d73-b95d-9a08e8e71330 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:17:08.489299 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-8ff17f7f-586c-4d73-b95d-9a08e8e71330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:08.510641 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 846/1678] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:17:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:17:08.515791 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff17f7f-586c-4d73-b95d-9a08e8e71330 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:08.541546 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff17f7f-586c-4d73-b95d-9a08e8e71330 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:08.553698 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5776a5a-a98b-4eec-982c-c72c4097502f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:08.554335 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5776a5a-a98b-4eec-982c-c72c4097502f admin admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:08.554614 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5776a5a-a98b-4eec-982c-c72c4097502f admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:08.554935 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5776a5a-a98b-4eec-982c-c72c4097502f admin admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:08.555562 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5776a5a-a98b-4eec-982c-c72c4097502f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:08.557242 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5776a5a-a98b-4eec-982c-c72c4097502f admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:08.582223 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25c303f-6dd3-4f1c-bf0d-895f805b907d admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:08.582769 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 847/1679] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:17:08 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:17:08.585825 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5776a5a-a98b-4eec-982c-c72c4097502f admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:08.596603 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee2e8f6-ec71-4db2-b5e3-761082a035ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4994b4faa4ec4aa088f3dc32c9c5614d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:08.597287 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee2e8f6-ec71-4db2-b5e3-761082a035ff service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:08.597570 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee2e8f6-ec71-4db2-b5e3-761082a035ff service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:08.598247 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee2e8f6-ec71-4db2-b5e3-761082a035ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:08.618139 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee2e8f6-ec71-4db2-b5e3-761082a035ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:08.618338 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5776a5a-a98b-4eec-982c-c72c4097502f admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:08.619753 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee2e8f6-ec71-4db2-b5e3-761082a035ff service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:08.634063 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 833/1680] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:17:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:17:08.634158 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1050dc59-256a-4ff0-8f26-c28a62b2708b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:08.638230 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1050dc59-256a-4ff0-8f26-c28a62b2708b admin admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:08.638876 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee2e8f6-ec71-4db2-b5e3-761082a035ff service neutron] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:08.646585 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee2e8f6-ec71-4db2-b5e3-761082a035ff service neutron] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:08.648881 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1050dc59-256a-4ff0-8f26-c28a62b2708b admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:08.650788 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1050dc59-256a-4ff0-8f26-c28a62b2708b admin admin] PATH_INFO: `/v3/domains` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:08.651712 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1050dc59-256a-4ff0-8f26-c28a62b2708b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:17:08.652152 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1050dc59-256a-4ff0-8f26-c28a62b2708b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:08.653364 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6dd2dc-c015-459e-9943-5a693a800ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:08.654284 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1050dc59-256a-4ff0-8f26-c28a62b2708b admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:08.654398 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6dd2dc-c015-459e-9943-5a693a800ee7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:08.654618 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6dd2dc-c015-459e-9943-5a693a800ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:08.654935 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6dd2dc-c015-459e-9943-5a693a800ee7 admin admin] PATH_INFO: `/v3/projects/80f177f3dd6346e1ac6c4cf7dcb9458c/users/e144609094ae4e1085e19415319f6ff9/roles/ed72181e1403401facb77dcf33644757` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:08.675299 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6dd2dc-c015-459e-9943-5a693a800ee7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80f177f3dd6346e1ac6c4cf7dcb9458c, user_id=e144609094ae4e1085e19415319f6ff9, role_id=ed72181e1403401facb77dcf33644757)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:08.678106 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6dd2dc-c015-459e-9943-5a693a800ee7 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:08.695972 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 848/1681] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Sep 5 12:17:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:17:08.697215 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1050dc59-256a-4ff0-8f26-c28a62b2708b admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:08.698462 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 834/1682] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 5 12:17:08 2022] PUT /identity/v3/projects/80f177f3dd6346e1ac6c4cf7dcb9458c/users/e144609094ae4e1085e19415319f6ff9/roles/ed72181e1403401facb77dcf33644757 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:17:08.708635 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1050dc59-256a-4ff0-8f26-c28a62b2708b admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:08.712153 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac11c788-593e-4f15-b55a-83f95b007c25 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:08.712756 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac11c788-593e-4f15-b55a-83f95b007c25 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:08.713882 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac11c788-593e-4f15-b55a-83f95b007c25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:08.785113 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-ac11c788-593e-4f15-b55a-83f95b007c25 None None] MFA Rules not processed for user `e144609094ae4e1085e19415319f6ff9`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:17:08.786561 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-ac11c788-593e-4f15-b55a-83f95b007c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:08.814325 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286c800e-e60d-4c09-b7a8-d42a53e33465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:08.814966 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286c800e-e60d-4c09-b7a8-d42a53e33465 admin admin] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:08.815601 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286c800e-e60d-4c09-b7a8-d42a53e33465 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:08.815886 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286c800e-e60d-4c09-b7a8-d42a53e33465 admin admin] PATH_INFO: `/v3/projects` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:08.816559 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286c800e-e60d-4c09-b7a8-d42a53e33465 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:08.819319 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286c800e-e60d-4c09-b7a8-d42a53e33465 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:08.859346 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 849/1683] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 5 12:17:08 2022] POST /identity/v3/projects => generated 381 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:17:08.861064 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286c800e-e60d-4c09-b7a8-d42a53e33465 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:08.888744 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:08.958784 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286c800e-e60d-4c09-b7a8-d42a53e33465 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:08.967324 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c700ce5-a330-4408-beb2-fcb4c0138244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:08.969711 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c700ce5-a330-4408-beb2-fcb4c0138244 admin admin] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:08.969996 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c700ce5-a330-4408-beb2-fcb4c0138244 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:08.970270 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c700ce5-a330-4408-beb2-fcb4c0138244 admin admin] PATH_INFO: `/v3/users` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:08.972569 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c700ce5-a330-4408-beb2-fcb4c0138244 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:08.981704 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c700ce5-a330-4408-beb2-fcb4c0138244 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:08.999924 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 835/1684] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:17:08 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:17:09.013668 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac11c788-593e-4f15-b55a-83f95b007c25 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:09.036176 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 850/1685] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 5 12:17:08 2022] POST /identity/v3/users => generated 291 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 12:17:09.037595 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c700ce5-a330-4408-beb2-fcb4c0138244 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:09.064279 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c700ce5-a330-4408-beb2-fcb4c0138244 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:09.067922 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac11c788-593e-4f15-b55a-83f95b007c25 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:09.078701 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceef0f2-cc23-48fa-9bc9-6b5e620b4509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:09.080136 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485f62ba-6a6e-4f00-a0de-ade1ef7936be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:09.080957 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485f62ba-6a6e-4f00-a0de-ade1ef7936be admin admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:09.081242 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485f62ba-6a6e-4f00-a0de-ade1ef7936be admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:09.081514 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485f62ba-6a6e-4f00-a0de-ade1ef7936be admin admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:09.081675 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceef0f2-cc23-48fa-9bc9-6b5e620b4509 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:09.082183 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485f62ba-6a6e-4f00-a0de-ade1ef7936be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:09.082610 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceef0f2-cc23-48fa-9bc9-6b5e620b4509 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:09.083018 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceef0f2-cc23-48fa-9bc9-6b5e620b4509 admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:09.085634 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485f62ba-6a6e-4f00-a0de-ade1ef7936be admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:09.086416 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ceef0f2-cc23-48fa-9bc9-6b5e620b4509 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:09.092827 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ceef0f2-cc23-48fa-9bc9-6b5e620b4509 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:09.130148 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 851/1686] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:17:09 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:17:09.138077 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485f62ba-6a6e-4f00-a0de-ade1ef7936be admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:09.155548 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:09.165178 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485f62ba-6a6e-4f00-a0de-ade1ef7936be admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:09.171507 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 836/1687] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 5 12:17:09 2022] POST /identity/v3/projects => generated 387 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 12:17:09.173282 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceef0f2-cc23-48fa-9bc9-6b5e620b4509 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:09.382249 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcde4d6-870d-4569-a2b2-cdc0c473f0e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:09.383134 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcde4d6-870d-4569-a2b2-cdc0c473f0e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:09.384415 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcde4d6-870d-4569-a2b2-cdc0c473f0e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:09.389993 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcde4d6-870d-4569-a2b2-cdc0c473f0e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:09.391858 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcde4d6-870d-4569-a2b2-cdc0c473f0e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:09.400705 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcde4d6-870d-4569-a2b2-cdc0c473f0e3 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:09.427237 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceef0f2-cc23-48fa-9bc9-6b5e620b4509 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:09.445685 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 852/1688] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:17:09 2022] GET /identity/v3/roles => generated 1420 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:17:09.460790 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcde4d6-870d-4569-a2b2-cdc0c473f0e3 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:09.471191 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-0bcde4d6-870d-4569-a2b2-cdc0c473f0e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:09.488989 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a661efe5-1527-43cc-9100-84bc56a1b64a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:09.488989 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a661efe5-1527-43cc-9100-84bc56a1b64a admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:09.495586 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a661efe5-1527-43cc-9100-84bc56a1b64a admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:09.496468 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a661efe5-1527-43cc-9100-84bc56a1b64a admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:09.499830 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a661efe5-1527-43cc-9100-84bc56a1b64a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:09.514141 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a661efe5-1527-43cc-9100-84bc56a1b64a admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:09.519599 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcde4d6-870d-4569-a2b2-cdc0c473f0e3 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:09.540598 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b631f25a-8906-4268-af8a-e6e96a430616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:09.541310 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b631f25a-8906-4268-af8a-e6e96a430616 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:09.543920 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b631f25a-8906-4268-af8a-e6e96a430616 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:09.544574 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b631f25a-8906-4268-af8a-e6e96a430616 admin admin] PATH_INFO: `/v3/projects/cba4736624104e45a6b2c30401e1bfcc` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:09.548416 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b631f25a-8906-4268-af8a-e6e96a430616 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cba4736624104e45a6b2c30401e1bfcc)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:09.555796 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b631f25a-8906-4268-af8a-e6e96a430616 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:09.613814 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 837/1689] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 5 12:17:09 2022] POST /identity/v3/users => generated 294 bytes in 441 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:17:09.614962 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a661efe5-1527-43cc-9100-84bc56a1b64a admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:09.665881 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a661efe5-1527-43cc-9100-84bc56a1b64a admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:09.678393 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0f6f8f-7b85-40de-892a-d5454f40ee55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:09.680501 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0f6f8f-7b85-40de-892a-d5454f40ee55 admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:09.680855 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0f6f8f-7b85-40de-892a-d5454f40ee55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:09.681157 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0f6f8f-7b85-40de-892a-d5454f40ee55 admin admin] PATH_INFO: `/v3/projects/3b2a8eee0c7b4f6fbb9bac836ba309d6/users/fadd03599d1440829d62638bd66c4c56/roles/ed72181e1403401facb77dcf33644757` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:09.706821 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-b631f25a-8906-4268-af8a-e6e96a430616 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cba4736624104e45a6b2c30401e1bfcc', 'request_id': 'req-b631f25a-8906-4268-af8a-e6e96a430616'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:09.721002 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0f6f8f-7b85-40de-892a-d5454f40ee55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b2a8eee0c7b4f6fbb9bac836ba309d6, user_id=fadd03599d1440829d62638bd66c4c56, role_id=ed72181e1403401facb77dcf33644757)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:09.722853 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-b631f25a-8906-4268-af8a-e6e96a430616 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cba4736624104e45a6b2c30401e1bfcc', 'request_id': 'req-b631f25a-8906-4268-af8a-e6e96a430616'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:09.739783 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0f6f8f-7b85-40de-892a-d5454f40ee55 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:09.741683 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-b631f25a-8906-4268-af8a-e6e96a430616 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cba4736624104e45a6b2c30401e1bfcc', 'request_id': 'req-b631f25a-8906-4268-af8a-e6e96a430616'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:09.778941 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 838/1690] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 5 12:17:09 2022] PUT /identity/v3/projects/3b2a8eee0c7b4f6fbb9bac836ba309d6/users/fadd03599d1440829d62638bd66c4c56/roles/ed72181e1403401facb77dcf33644757 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:17:09.779965 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0f6f8f-7b85-40de-892a-d5454f40ee55 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:09.788467 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-b631f25a-8906-4268-af8a-e6e96a430616 admin admin] The token cache is being invalidate because project cba4736624104e45a6b2c30401e1bfcc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:17:09.789283 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-b631f25a-8906-4268-af8a-e6e96a430616 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:09.790609 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-b631f25a-8906-4268-af8a-e6e96a430616 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:09.796783 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 853/1691] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 5 12:17:09 2022] DELETE /identity/v3/projects/cba4736624104e45a6b2c30401e1bfcc => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:17:09.796783 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c3b986-2baa-4d54-afbb-918d4517087b None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:09.796783 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c3b986-2baa-4d54-afbb-918d4517087b None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:09.796783 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c3b986-2baa-4d54-afbb-918d4517087b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:09.861010 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-d9c3b986-2baa-4d54-afbb-918d4517087b None None] MFA Rules not processed for user `fadd03599d1440829d62638bd66c4c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:17:09.863268 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-d9c3b986-2baa-4d54-afbb-918d4517087b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:09.870274 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:09.909440 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0f6f8f-7b85-40de-892a-d5454f40ee55 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:09.915806 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d3f7f5-a835-4651-bc87-4e919b327a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:09.916437 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d3f7f5-a835-4651-bc87-4e919b327a1a admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:09.916725 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d3f7f5-a835-4651-bc87-4e919b327a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:09.917040 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d3f7f5-a835-4651-bc87-4e919b327a1a admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:09.917698 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d3f7f5-a835-4651-bc87-4e919b327a1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:09.919522 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d3f7f5-a835-4651-bc87-4e919b327a1a admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:09.933237 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 839/1692] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:17:09 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:17:09.937249 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dace74-f78b-4786-91cf-720ff76976f9 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:09.937249 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dace74-f78b-4786-91cf-720ff76976f9 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:09.937249 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dace74-f78b-4786-91cf-720ff76976f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:09.965817 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-e2dace74-f78b-4786-91cf-720ff76976f9 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:17:09.967551 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-e2dace74-f78b-4786-91cf-720ff76976f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:09.985184 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 840/1693] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:17:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:17:09.985184 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dace74-f78b-4786-91cf-720ff76976f9 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:09.993281 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-e2dace74-f78b-4786-91cf-720ff76976f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:10.011614 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dace74-f78b-4786-91cf-720ff76976f9 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:10.018399 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d65fa47-ac73-4c80-971d-909b3700d221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:10.019221 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d65fa47-ac73-4c80-971d-909b3700d221 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:10.019962 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d65fa47-ac73-4c80-971d-909b3700d221 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:10.020331 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d65fa47-ac73-4c80-971d-909b3700d221 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:10.021032 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d65fa47-ac73-4c80-971d-909b3700d221 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:10.024528 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d65fa47-ac73-4c80-971d-909b3700d221 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:10.025194 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 854/1694] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:17:09 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:17:10.026760 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03b7acb-6c80-4f80-b904-60d3db6fcd5a None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:10.029732 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03b7acb-6c80-4f80-b904-60d3db6fcd5a None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:10.030374 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03b7acb-6c80-4f80-b904-60d3db6fcd5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:10.045618 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 841/1695] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:17:09 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:17:10.045618 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d65fa47-ac73-4c80-971d-909b3700d221 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:10.045618 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-8d65fa47-ac73-4c80-971d-909b3700d221 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:10.063146 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d65fa47-ac73-4c80-971d-909b3700d221 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:10.069896 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc121361-09c8-48f2-9790-5aaac514ff1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:10.071060 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc121361-09c8-48f2-9790-5aaac514ff1a admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:10.071652 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc121361-09c8-48f2-9790-5aaac514ff1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:10.071975 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc121361-09c8-48f2-9790-5aaac514ff1a admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:10.072642 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc121361-09c8-48f2-9790-5aaac514ff1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:10.075493 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc121361-09c8-48f2-9790-5aaac514ff1a admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:10.085730 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-a03b7acb-6c80-4f80-b904-60d3db6fcd5a None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:17:10.089008 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-a03b7acb-6c80-4f80-b904-60d3db6fcd5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:10.113009 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 842/1696] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 5 12:17:10 2022] POST /identity/v3/projects => generated 379 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:17:10.116984 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc121361-09c8-48f2-9790-5aaac514ff1a admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:10.117162 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 855/1697] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:17:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:17:10.117162 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03b7acb-6c80-4f80-b904-60d3db6fcd5a None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:10.139393 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03b7acb-6c80-4f80-b904-60d3db6fcd5a None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:10.145097 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:10.228957 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc121361-09c8-48f2-9790-5aaac514ff1a admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:10.235255 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b5ca56-8252-470f-9589-071a1bba11ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:10.236919 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b5ca56-8252-470f-9589-071a1bba11ac admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:10.237565 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b5ca56-8252-470f-9589-071a1bba11ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:10.237963 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b5ca56-8252-470f-9589-071a1bba11ac admin admin] PATH_INFO: `/v3/projects/535f6fe53c054b11b1e26a3d1305a5e6/users/9e375da27053437985e138a377d399d2/roles/ed72181e1403401facb77dcf33644757` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:10.264851 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b5ca56-8252-470f-9589-071a1bba11ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=535f6fe53c054b11b1e26a3d1305a5e6, user_id=9e375da27053437985e138a377d399d2, role_id=ed72181e1403401facb77dcf33644757)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:10.272055 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b5ca56-8252-470f-9589-071a1bba11ac admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:10.292401 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c24f4e-4236-475d-804a-adb76a19326e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:10.293951 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c24f4e-4236-475d-804a-adb76a19326e admin admin] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:10.294445 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c24f4e-4236-475d-804a-adb76a19326e admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:10.294892 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c24f4e-4236-475d-804a-adb76a19326e admin admin] PATH_INFO: `/v3/users` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:10.296108 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c24f4e-4236-475d-804a-adb76a19326e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:10.299619 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c24f4e-4236-475d-804a-adb76a19326e admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:10.300863 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 843/1698] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 5 12:17:10 2022] PUT /identity/v3/projects/535f6fe53c054b11b1e26a3d1305a5e6/users/9e375da27053437985e138a377d399d2/roles/ed72181e1403401facb77dcf33644757 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:17:10.303933 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b5ca56-8252-470f-9589-071a1bba11ac admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:10.365392 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 856/1699] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 5 12:17:10 2022] POST /identity/v3/users => generated 296 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:17:10.366390 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce192a4-a53f-4572-a8c5-520cc51ac129 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:10.366686 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce192a4-a53f-4572-a8c5-520cc51ac129 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:10.366964 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce192a4-a53f-4572-a8c5-520cc51ac129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:10.423685 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-8ce192a4-a53f-4572-a8c5-520cc51ac129 None None] MFA Rules not processed for user `9e375da27053437985e138a377d399d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:17:10.427012 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-8ce192a4-a53f-4572-a8c5-520cc51ac129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:10.443791 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b5ca56-8252-470f-9589-071a1bba11ac admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:10.450449 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f9da60-3c16-4629-ae32-19192acc92c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:10.451416 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f9da60-3c16-4629-ae32-19192acc92c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:10.451922 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f9da60-3c16-4629-ae32-19192acc92c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:10.453465 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f9da60-3c16-4629-ae32-19192acc92c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:10.454934 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f9da60-3c16-4629-ae32-19192acc92c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:17:10.455699 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f9da60-3c16-4629-ae32-19192acc92c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:10.458811 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f9da60-3c16-4629-ae32-19192acc92c4 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:10.477059 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 844/1700] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Sep 5 12:17:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:17:10.478594 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f9da60-3c16-4629-ae32-19192acc92c4 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:10.497576 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f9da60-3c16-4629-ae32-19192acc92c4 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:10.507463 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935d585b-ac5a-4540-9256-7e6be82a1772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:10.508826 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935d585b-ac5a-4540-9256-7e6be82a1772 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:10.509541 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935d585b-ac5a-4540-9256-7e6be82a1772 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:10.510054 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935d585b-ac5a-4540-9256-7e6be82a1772 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:10.510918 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935d585b-ac5a-4540-9256-7e6be82a1772 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:10.512810 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935d585b-ac5a-4540-9256-7e6be82a1772 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:10.528159 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 845/1701] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:17:10 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:17:10.539192 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935d585b-ac5a-4540-9256-7e6be82a1772 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:10.555256 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935d585b-ac5a-4540-9256-7e6be82a1772 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:10.561598 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a09a87e-9184-4ca3-8f70-5a7dc02551d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:10.567478 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a09a87e-9184-4ca3-8f70-5a7dc02551d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:10.583215 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a09a87e-9184-4ca3-8f70-5a7dc02551d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:10.583712 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a09a87e-9184-4ca3-8f70-5a7dc02551d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:10.584067 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 857/1702] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:17:10 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:17:10.585984 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce192a4-a53f-4572-a8c5-520cc51ac129 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:10.586696 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a09a87e-9184-4ca3-8f70-5a7dc02551d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:10.592015 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a09a87e-9184-4ca3-8f70-5a7dc02551d1 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:10.612833 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce192a4-a53f-4572-a8c5-520cc51ac129 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:10.625585 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498f2acf-2243-463c-9272-3a1a1cfa6531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:10.626411 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498f2acf-2243-463c-9272-3a1a1cfa6531 admin admin] REQUEST_METHOD: `PUT` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:10.626808 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498f2acf-2243-463c-9272-3a1a1cfa6531 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:10.626974 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498f2acf-2243-463c-9272-3a1a1cfa6531 admin admin] PATH_INFO: `/v3/projects/7a5b49631e964e17b75dc043fbc69148/users/8da643c162f5405da5e9640761498e2e/roles/16e2ccc8bd1b497d8cee780c1c7df0d2` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:10.671464 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498f2acf-2243-463c-9272-3a1a1cfa6531 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a5b49631e964e17b75dc043fbc69148, user_id=8da643c162f5405da5e9640761498e2e, role_id=16e2ccc8bd1b497d8cee780c1c7df0d2)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:10.674535 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498f2acf-2243-463c-9272-3a1a1cfa6531 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:10.680885 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:10.697812 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 846/1703] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 5 12:17:10 2022] POST /identity/v3/projects => generated 365 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:17:10.703356 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 858/1704] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 5 12:17:10 2022] PUT /identity/v3/projects/7a5b49631e964e17b75dc043fbc69148/users/8da643c162f5405da5e9640761498e2e/roles/16e2ccc8bd1b497d8cee780c1c7df0d2 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:17:10.704217 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc417bd5-6f1c-4911-af92-0a0deb9779a0 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:10.705244 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc417bd5-6f1c-4911-af92-0a0deb9779a0 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:10.705528 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc417bd5-6f1c-4911-af92-0a0deb9779a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:10.708861 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498f2acf-2243-463c-9272-3a1a1cfa6531 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:10.807548 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-dc417bd5-6f1c-4911-af92-0a0deb9779a0 None None] MFA Rules not processed for user `95c65245dd614ebb9b9ebf2fcc620cea`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:17:10.816687 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-dc417bd5-6f1c-4911-af92-0a0deb9779a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:10.950707 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498f2acf-2243-463c-9272-3a1a1cfa6531 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:10.956174 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93ac309-7e8d-4fb5-9d56-e77d2be987cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:10.963979 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93ac309-7e8d-4fb5-9d56-e77d2be987cc admin admin] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:10.964348 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93ac309-7e8d-4fb5-9d56-e77d2be987cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:10.964629 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93ac309-7e8d-4fb5-9d56-e77d2be987cc admin admin] PATH_INFO: `/v3/projects` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:10.966111 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93ac309-7e8d-4fb5-9d56-e77d2be987cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:10.968275 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93ac309-7e8d-4fb5-9d56-e77d2be987cc admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:11.026693 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 859/1705] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 5 12:17:10 2022] POST /identity/v3/projects => generated 385 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:17:11.028857 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93ac309-7e8d-4fb5-9d56-e77d2be987cc admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:11.092803 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:11.141159 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 847/1706] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:17:10 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 441 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:17:11.141159 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc417bd5-6f1c-4911-af92-0a0deb9779a0 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:11.161242 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc417bd5-6f1c-4911-af92-0a0deb9779a0 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:11.175916 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93ac309-7e8d-4fb5-9d56-e77d2be987cc admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:11.188927 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db85c076-807d-48e4-9a8f-5948eeeb0284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:11.188927 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db85c076-807d-48e4-9a8f-5948eeeb0284 admin admin] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:11.188927 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db85c076-807d-48e4-9a8f-5948eeeb0284 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:11.188927 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db85c076-807d-48e4-9a8f-5948eeeb0284 admin admin] PATH_INFO: `/v3/users` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:11.189357 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db85c076-807d-48e4-9a8f-5948eeeb0284 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:11.189357 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db85c076-807d-48e4-9a8f-5948eeeb0284 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:11.240111 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 860/1707] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 5 12:17:11 2022] POST /identity/v3/users => generated 283 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:17:11.240111 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db85c076-807d-48e4-9a8f-5948eeeb0284 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:11.240864 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-db85c076-807d-48e4-9a8f-5948eeeb0284 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:11.259719 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db85c076-807d-48e4-9a8f-5948eeeb0284 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:11.275172 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098cbbbb-38b1-4201-b000-432647927314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:11.276676 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098cbbbb-38b1-4201-b000-432647927314 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:11.278098 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892a1ab6-95d6-40f7-83e3-3ff8a313b63f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:11.278724 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892a1ab6-95d6-40f7-83e3-3ff8a313b63f admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:11.279406 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892a1ab6-95d6-40f7-83e3-3ff8a313b63f admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:11.279406 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892a1ab6-95d6-40f7-83e3-3ff8a313b63f admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:11.279962 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892a1ab6-95d6-40f7-83e3-3ff8a313b63f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:11.281662 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892a1ab6-95d6-40f7-83e3-3ff8a313b63f admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:11.290419 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098cbbbb-38b1-4201-b000-432647927314 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:11.290959 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098cbbbb-38b1-4201-b000-432647927314 admin admin] PATH_INFO: `/v3/users/e67ddf103f654458b4637a4bc9d2ccd5` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:11.292853 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098cbbbb-38b1-4201-b000-432647927314 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e67ddf103f654458b4637a4bc9d2ccd5)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:11.295435 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098cbbbb-38b1-4201-b000-432647927314 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:11.304126 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 848/1708] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:17:11 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:17:11.305810 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892a1ab6-95d6-40f7-83e3-3ff8a313b63f admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:11.330706 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892a1ab6-95d6-40f7-83e3-3ff8a313b63f admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:11.337656 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9138b98d-a728-4c1b-b41d-407d1592ff5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:11.338577 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9138b98d-a728-4c1b-b41d-407d1592ff5b admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:11.342760 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9138b98d-a728-4c1b-b41d-407d1592ff5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:11.343797 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9138b98d-a728-4c1b-b41d-407d1592ff5b admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:11.344981 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9138b98d-a728-4c1b-b41d-407d1592ff5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:11.348712 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9138b98d-a728-4c1b-b41d-407d1592ff5b admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:11.397245 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-098cbbbb-38b1-4201-b000-432647927314 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e67ddf103f654458b4637a4bc9d2ccd5'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:11.398101 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-098cbbbb-38b1-4201-b000-432647927314 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e67ddf103f654458b4637a4bc9d2ccd5'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:11.408910 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 849/1709] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 5 12:17:11 2022] POST /identity/v3/users => generated 299 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:17:11.408910 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abef818-8ce7-4c0d-93c4-55812a76fab9 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:11.408910 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abef818-8ce7-4c0d-93c4-55812a76fab9 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:11.409262 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abef818-8ce7-4c0d-93c4-55812a76fab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:11.409907 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-098cbbbb-38b1-4201-b000-432647927314 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e67ddf103f654458b4637a4bc9d2ccd5'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:11.410650 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-098cbbbb-38b1-4201-b000-432647927314 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e67ddf103f654458b4637a4bc9d2ccd5'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:11.420982 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:INSERT=6,keystone:SELECT=85,keystone:DELETE=9 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:11.434870 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-2abef818-8ce7-4c0d-93c4-55812a76fab9 None None] MFA Rules not processed for user `95c65245dd614ebb9b9ebf2fcc620cea`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:17:11.436368 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-2abef818-8ce7-4c0d-93c4-55812a76fab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:11.437379 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-098cbbbb-38b1-4201-b000-432647927314 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e67ddf103f654458b4637a4bc9d2ccd5'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:11.458555 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 861/1710] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 5 12:17:11 2022] DELETE /identity/v3/users/e67ddf103f654458b4637a4bc9d2ccd5 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:17:11.459491 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098cbbbb-38b1-4201-b000-432647927314 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:11.462584 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-098cbbbb-38b1-4201-b000-432647927314 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:11.556665 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 850/1711] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:17:11 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:17:11.557565 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abef818-8ce7-4c0d-93c4-55812a76fab9 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:11.559791 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-2abef818-8ce7-4c0d-93c4-55812a76fab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:11.598467 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abef818-8ce7-4c0d-93c4-55812a76fab9 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:11.601580 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098cbbbb-38b1-4201-b000-432647927314 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:11.607749 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299bc939-e6e3-4d42-b4f8-45e9fb34190d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:11.608384 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299bc939-e6e3-4d42-b4f8-45e9fb34190d admin admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:11.608670 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299bc939-e6e3-4d42-b4f8-45e9fb34190d admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:11.609441 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299bc939-e6e3-4d42-b4f8-45e9fb34190d admin admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:11.610112 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299bc939-e6e3-4d42-b4f8-45e9fb34190d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:11.612422 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299bc939-e6e3-4d42-b4f8-45e9fb34190d admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:11.615408 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d08162-19b3-4184-a312-34f2266068cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:11.616091 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d08162-19b3-4184-a312-34f2266068cc admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:11.616372 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d08162-19b3-4184-a312-34f2266068cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:11.616648 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d08162-19b3-4184-a312-34f2266068cc admin admin] PATH_INFO: `/v3/projects/7a5b49631e964e17b75dc043fbc69148/users/8da643c162f5405da5e9640761498e2e/roles/16e2ccc8bd1b497d8cee780c1c7df0d2` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:11.622610 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d08162-19b3-4184-a312-34f2266068cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a5b49631e964e17b75dc043fbc69148, user_id=8da643c162f5405da5e9640761498e2e, role_id=16e2ccc8bd1b497d8cee780c1c7df0d2)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:11.625412 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d08162-19b3-4184-a312-34f2266068cc admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:11.638907 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 862/1712] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:17:11 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:17:11.638907 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299bc939-e6e3-4d42-b4f8-45e9fb34190d admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:11.645946 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-299bc939-e6e3-4d42-b4f8-45e9fb34190d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:11.655047 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 851/1713] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 5 12:17:11 2022] PUT /identity/v3/projects/7a5b49631e964e17b75dc043fbc69148/users/8da643c162f5405da5e9640761498e2e/roles/16e2ccc8bd1b497d8cee780c1c7df0d2 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:17:11.657562 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d13e17-7faa-4e59-bdc9-6c99136cf77c None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:11.658010 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d13e17-7faa-4e59-bdc9-6c99136cf77c None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:11.659301 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d13e17-7faa-4e59-bdc9-6c99136cf77c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:11.685892 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299bc939-e6e3-4d42-b4f8-45e9fb34190d admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:11.715184 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-41d13e17-7faa-4e59-bdc9-6c99136cf77c None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:17:11.718837 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-41d13e17-7faa-4e59-bdc9-6c99136cf77c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:11.823093 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9ce0d8-ec97-4a69-ae82-85994f16cd3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:11.823722 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9ce0d8-ec97-4a69-ae82-85994f16cd3e admin admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:11.824006 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9ce0d8-ec97-4a69-ae82-85994f16cd3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:11.824319 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9ce0d8-ec97-4a69-ae82-85994f16cd3e admin admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:11.825056 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9ce0d8-ec97-4a69-ae82-85994f16cd3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:11.826682 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9ce0d8-ec97-4a69-ae82-85994f16cd3e admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:11.849846 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 863/1714] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:17:11 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:17:11.851289 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9ce0d8-ec97-4a69-ae82-85994f16cd3e admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:11.857780 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-3e9ce0d8-ec97-4a69-ae82-85994f16cd3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:11.861356 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 852/1715] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:17:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:17:11.862249 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d13e17-7faa-4e59-bdc9-6c99136cf77c None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:11.883423 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:11.893337 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d13e17-7faa-4e59-bdc9-6c99136cf77c None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:11.909503 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bbb45c-2f9e-4c6f-8f65-008f04c7f3a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:11.910149 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bbb45c-2f9e-4c6f-8f65-008f04c7f3a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:11.910430 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bbb45c-2f9e-4c6f-8f65-008f04c7f3a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:11.910719 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bbb45c-2f9e-4c6f-8f65-008f04c7f3a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:11.911626 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bbb45c-2f9e-4c6f-8f65-008f04c7f3a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:11.913281 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bbb45c-2f9e-4c6f-8f65-008f04c7f3a5 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:11.940396 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 853/1716] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:17:11 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:17:11.943058 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07dea70-d929-4584-8491-8279461f84a0 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:11.943561 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07dea70-d929-4584-8491-8279461f84a0 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:11.943845 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07dea70-d929-4584-8491-8279461f84a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:12.003363 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-d07dea70-d929-4584-8491-8279461f84a0 None None] MFA Rules not processed for user `8da643c162f5405da5e9640761498e2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:17:12.007695 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-d07dea70-d929-4584-8491-8279461f84a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:12.036577 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9ce0d8-ec97-4a69-ae82-85994f16cd3e admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:12.044758 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df19433d-886b-42dd-8f71-7ef02cdd9be0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb060ff495bc4abb83ff88992fb7be09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:12.045490 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df19433d-886b-42dd-8f71-7ef02cdd9be0 service nova] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:12.045773 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df19433d-886b-42dd-8f71-7ef02cdd9be0 service nova] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:12.046049 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df19433d-886b-42dd-8f71-7ef02cdd9be0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:12.049977 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-df19433d-886b-42dd-8f71-7ef02cdd9be0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:12.066141 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:12.128625 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df19433d-886b-42dd-8f71-7ef02cdd9be0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:12.135492 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df19433d-886b-42dd-8f71-7ef02cdd9be0 service nova] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:12.144673 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 854/1717] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:17:11 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:17:12.146168 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07dea70-d929-4584-8491-8279461f84a0 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:12.148718 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 864/1718] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:17:11 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:17:12.150409 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df19433d-886b-42dd-8f71-7ef02cdd9be0 service nova] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:12.151932 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-df19433d-886b-42dd-8f71-7ef02cdd9be0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:12.204103 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07dea70-d929-4584-8491-8279461f84a0 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:12.221613 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aefa630-bc52-44c7-a661-addca10e96e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:12.222590 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aefa630-bc52-44c7-a661-addca10e96e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:12.223072 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aefa630-bc52-44c7-a661-addca10e96e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:12.223508 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aefa630-bc52-44c7-a661-addca10e96e7 admin admin] PATH_INFO: `/v3/projects/c24cdac749144d899fccd95e0065018f/users/351a9b7e130d423db1982e956faf0964/roles/16e2ccc8bd1b497d8cee780c1c7df0d2` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:12.254420 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aefa630-bc52-44c7-a661-addca10e96e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c24cdac749144d899fccd95e0065018f, user_id=351a9b7e130d423db1982e956faf0964, role_id=16e2ccc8bd1b497d8cee780c1c7df0d2)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:12.258370 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aefa630-bc52-44c7-a661-addca10e96e7 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:12.283687 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 855/1719] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 5 12:17:12 2022] PUT /identity/v3/projects/c24cdac749144d899fccd95e0065018f/users/351a9b7e130d423db1982e956faf0964/roles/16e2ccc8bd1b497d8cee780c1c7df0d2 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:17:12.285277 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aefa630-bc52-44c7-a661-addca10e96e7 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:12.324411 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df19433d-886b-42dd-8f71-7ef02cdd9be0 service nova] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:12.394843 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aefa630-bc52-44c7-a661-addca10e96e7 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:12.406567 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970b421d-d606-46dd-9747-22f39080bdbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:12.407335 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970b421d-d606-46dd-9747-22f39080bdbe admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:12.408474 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970b421d-d606-46dd-9747-22f39080bdbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:12.408806 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970b421d-d606-46dd-9747-22f39080bdbe admin admin] PATH_INFO: `/v3/projects/a2fc35a2a7a0445891dfe9808eb57fbf/users/e8cc084e721a47ed89d907c31c6e5522/roles/ed72181e1403401facb77dcf33644757` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:12.431880 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970b421d-d606-46dd-9747-22f39080bdbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2fc35a2a7a0445891dfe9808eb57fbf, user_id=e8cc084e721a47ed89d907c31c6e5522, role_id=ed72181e1403401facb77dcf33644757)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:12.435525 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970b421d-d606-46dd-9747-22f39080bdbe admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:12.472242 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 856/1720] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 5 12:17:12 2022] PUT /identity/v3/projects/a2fc35a2a7a0445891dfe9808eb57fbf/users/e8cc084e721a47ed89d907c31c6e5522/roles/ed72181e1403401facb77dcf33644757 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:17:12.473990 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970b421d-d606-46dd-9747-22f39080bdbe admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:12.475868 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-970b421d-d606-46dd-9747-22f39080bdbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:12.490029 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7346da2-08c0-4b13-bb31-73cdffe14412 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4994b4faa4ec4aa088f3dc32c9c5614d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:12.491152 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7346da2-08c0-4b13-bb31-73cdffe14412 service neutron] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:12.491507 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7346da2-08c0-4b13-bb31-73cdffe14412 service neutron] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:12.491857 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7346da2-08c0-4b13-bb31-73cdffe14412 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:12.507534 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7346da2-08c0-4b13-bb31-73cdffe14412 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:12.509101 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7346da2-08c0-4b13-bb31-73cdffe14412 service neutron] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:12.526401 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 865/1721] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:17:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:17:12.527289 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7346da2-08c0-4b13-bb31-73cdffe14412 service neutron] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:12.554846 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7346da2-08c0-4b13-bb31-73cdffe14412 service neutron] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:12.582503 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:12.625341 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970b421d-d606-46dd-9747-22f39080bdbe admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:12.646269 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8f5807-43b2-4bdf-8dd0-e1c6dcbe3885 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37633bbae0c2423c81ccd61ac3a17ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:12.648524 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8f5807-43b2-4bdf-8dd0-e1c6dcbe3885 service cinder] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:12.649260 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8f5807-43b2-4bdf-8dd0-e1c6dcbe3885 service cinder] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:12.650105 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8f5807-43b2-4bdf-8dd0-e1c6dcbe3885 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:12.730041 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a724032-2a83-4ac2-98a0-c5f0ea18d0e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:12.732136 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a724032-2a83-4ac2-98a0-c5f0ea18d0e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:12.733005 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a724032-2a83-4ac2-98a0-c5f0ea18d0e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:12.733307 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a724032-2a83-4ac2-98a0-c5f0ea18d0e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:12.734865 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a724032-2a83-4ac2-98a0-c5f0ea18d0e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:12.736516 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a724032-2a83-4ac2-98a0-c5f0ea18d0e0 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:12.764559 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8f5807-43b2-4bdf-8dd0-e1c6dcbe3885 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:12.766451 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8f5807-43b2-4bdf-8dd0-e1c6dcbe3885 service cinder] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:12.776176 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 866/1722] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:17:12 2022] GET /identity/v3/roles => generated 1420 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:17:12.786774 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 857/1723] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:17:12 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:17:12.793750 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594ee186-ce7e-47cb-a9f5-b03d2d86f610 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:12.794039 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594ee186-ce7e-47cb-a9f5-b03d2d86f610 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:12.794306 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594ee186-ce7e-47cb-a9f5-b03d2d86f610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:12.802560 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1e5917-ae3b-4aa1-b33e-a1d452fbd16c None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:12.802998 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1e5917-ae3b-4aa1-b33e-a1d452fbd16c None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:12.803282 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1e5917-ae3b-4aa1-b33e-a1d452fbd16c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:12.813486 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:12.849162 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-8a1e5917-ae3b-4aa1-b33e-a1d452fbd16c None None] MFA Rules not processed for user `b7dcead6e9584ab8949678016ed12335`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:17:12.850646 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-8a1e5917-ae3b-4aa1-b33e-a1d452fbd16c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:12.855625 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-594ee186-ce7e-47cb-a9f5-b03d2d86f610 None None] MFA Rules not processed for user `1a65057dea094b77a0d13fda46b7d6ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:17:12.857002 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-594ee186-ce7e-47cb-a9f5-b03d2d86f610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:12.940837 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 867/1724] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:17:12 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:17:12.944847 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3cf07d-9005-4943-80d4-c9413341f0de None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:12.946717 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3cf07d-9005-4943-80d4-c9413341f0de None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:12.947002 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3cf07d-9005-4943-80d4-c9413341f0de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:12.991864 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-1e3cf07d-9005-4943-80d4-c9413341f0de None None] MFA Rules not processed for user `e8cc084e721a47ed89d907c31c6e5522`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:17:12.993232 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-1e3cf07d-9005-4943-80d4-c9413341f0de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:13.056961 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 858/1725] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:17:12 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:17:13.056961 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594ee186-ce7e-47cb-a9f5-b03d2d86f610 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:13.083754 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594ee186-ce7e-47cb-a9f5-b03d2d86f610 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:13.092352 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8f42fe-1ae4-4582-b227-d83e75bc476b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:13.093067 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8f42fe-1ae4-4582-b227-d83e75bc476b admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:13.094101 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8f42fe-1ae4-4582-b227-d83e75bc476b admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:13.094387 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8f42fe-1ae4-4582-b227-d83e75bc476b admin admin] PATH_INFO: `/v3/projects/c24cdac749144d899fccd95e0065018f/users/351a9b7e130d423db1982e956faf0964/roles/16e2ccc8bd1b497d8cee780c1c7df0d2` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:13.101366 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 868/1726] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:17:12 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:17:13.101366 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3cf07d-9005-4943-80d4-c9413341f0de None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:13.102273 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8f42fe-1ae4-4582-b227-d83e75bc476b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c24cdac749144d899fccd95e0065018f, user_id=351a9b7e130d423db1982e956faf0964, role_id=16e2ccc8bd1b497d8cee780c1c7df0d2)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:13.108496 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8f42fe-1ae4-4582-b227-d83e75bc476b admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:13.122508 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3cf07d-9005-4943-80d4-c9413341f0de None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:13.133225 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f11f6e2-e243-40e3-8193-1408aed04235 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37633bbae0c2423c81ccd61ac3a17ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:13.133756 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f11f6e2-e243-40e3-8193-1408aed04235 service cinder] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:13.134037 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f11f6e2-e243-40e3-8193-1408aed04235 service cinder] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:13.134312 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f11f6e2-e243-40e3-8193-1408aed04235 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:13.136232 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 859/1727] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 5 12:17:13 2022] PUT /identity/v3/projects/c24cdac749144d899fccd95e0065018f/users/351a9b7e130d423db1982e956faf0964/roles/16e2ccc8bd1b497d8cee780c1c7df0d2 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:17:13.138417 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8f42fe-1ae4-4582-b227-d83e75bc476b admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:13.148741 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-8f11f6e2-e243-40e3-8193-1408aed04235 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:13.150828 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-dc8f42fe-1ae4-4582-b227-d83e75bc476b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:13.286688 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f11f6e2-e243-40e3-8193-1408aed04235 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:13.288156 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f11f6e2-e243-40e3-8193-1408aed04235 service cinder] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:13.301756 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 869/1728] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:17:13 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:17:13.303055 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb033429-c0a8-469f-8891-b90a6b98c321 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:13.303345 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb033429-c0a8-469f-8891-b90a6b98c321 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:13.303628 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb033429-c0a8-469f-8891-b90a6b98c321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:13.316557 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:13.327590 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-eb033429-c0a8-469f-8891-b90a6b98c321 None None] MFA Rules not processed for user `1a65057dea094b77a0d13fda46b7d6ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:17:13.328834 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-eb033429-c0a8-469f-8891-b90a6b98c321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:13.334155 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8f42fe-1ae4-4582-b227-d83e75bc476b admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:13.348729 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:13.353812 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aed996-80b3-4fbb-b276-7cef8b6c43c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb060ff495bc4abb83ff88992fb7be09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:13.354804 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aed996-80b3-4fbb-b276-7cef8b6c43c5 service nova] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:13.357254 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aed996-80b3-4fbb-b276-7cef8b6c43c5 service nova] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:13.357755 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aed996-80b3-4fbb-b276-7cef8b6c43c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:13.398096 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 870/1729] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:17:13 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:17:13.399127 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb033429-c0a8-469f-8891-b90a6b98c321 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:13.496774 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31aed996-80b3-4fbb-b276-7cef8b6c43c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:13.498673 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31aed996-80b3-4fbb-b276-7cef8b6c43c5 service nova] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:13.533353 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 860/1730] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:17:13 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:17:13.536697 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0217a21c-41f8-419f-9bf9-8bd2928d9275 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:13.537264 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0217a21c-41f8-419f-9bf9-8bd2928d9275 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:13.538611 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0217a21c-41f8-419f-9bf9-8bd2928d9275 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:13.540187 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 861/1731] 10.222.0.50 () {54 vars in 912 bytes} [Mon Sep 5 12:17:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:17:13.544057 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1d8d3e-58d4-4b14-a563-e0a37358e122 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:13.544857 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1d8d3e-58d4-4b14-a563-e0a37358e122 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:13.545352 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1d8d3e-58d4-4b14-a563-e0a37358e122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:13.573122 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb033429-c0a8-469f-8891-b90a6b98c321 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:13.583271 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bfd8a9-63c9-4c2d-a61c-8213050c64e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:13.584851 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bfd8a9-63c9-4c2d-a61c-8213050c64e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:13.585163 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bfd8a9-63c9-4c2d-a61c-8213050c64e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:13.586882 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bfd8a9-63c9-4c2d-a61c-8213050c64e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:13.587555 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bfd8a9-63c9-4c2d-a61c-8213050c64e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:13.594212 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bfd8a9-63c9-4c2d-a61c-8213050c64e8 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:13.604276 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-9e1d8d3e-58d4-4b14-a563-e0a37358e122 None None] MFA Rules not processed for user `351a9b7e130d423db1982e956faf0964`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:17:13.607097 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-9e1d8d3e-58d4-4b14-a563-e0a37358e122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:13.669561 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 871/1732] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 5 12:17:13 2022] POST /identity/v3/projects => generated 363 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:17:13.670776 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bfd8a9-63c9-4c2d-a61c-8213050c64e8 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:13.675813 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-66bfd8a9-63c9-4c2d-a61c-8213050c64e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:13.802102 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 862/1733] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:17:13 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:17:13.804934 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459e7f6c-e290-48da-9389-1fe462da3bb7 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:13.807928 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459e7f6c-e290-48da-9389-1fe462da3bb7 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:13.808352 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459e7f6c-e290-48da-9389-1fe462da3bb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:13.866778 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-459e7f6c-e290-48da-9389-1fe462da3bb7 None None] MFA Rules not processed for user `4994b4faa4ec4aa088f3dc32c9c5614d`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:17:13.870736 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-459e7f6c-e290-48da-9389-1fe462da3bb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:13.886592 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bfd8a9-63c9-4c2d-a61c-8213050c64e8 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:13.903688 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd925dfd-68e6-4041-9967-f3e4c80778d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:13.905905 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd925dfd-68e6-4041-9967-f3e4c80778d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:13.907556 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd925dfd-68e6-4041-9967-f3e4c80778d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:13.908638 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd925dfd-68e6-4041-9967-f3e4c80778d7 admin admin] PATH_INFO: `/v3/projects/1aa715929b1e42eea30e64d1ed48f905` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:13.913974 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd925dfd-68e6-4041-9967-f3e4c80778d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1aa715929b1e42eea30e64d1ed48f905)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:13.919182 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd925dfd-68e6-4041-9967-f3e4c80778d7 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:14.059337 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 863/1734] 10.222.0.50 () {58 vars in 1009 bytes} [Mon Sep 5 12:17:13 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:17:14.061347 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459e7f6c-e290-48da-9389-1fe462da3bb7 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:14.079130 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-fd925dfd-68e6-4041-9967-f3e4c80778d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1aa715929b1e42eea30e64d1ed48f905', 'request_id': 'req-fd925dfd-68e6-4041-9967-f3e4c80778d7'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:14.089215 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:14.091684 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459e7f6c-e290-48da-9389-1fe462da3bb7 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:14.106224 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-fd925dfd-68e6-4041-9967-f3e4c80778d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1aa715929b1e42eea30e64d1ed48f905', 'request_id': 'req-fd925dfd-68e6-4041-9967-f3e4c80778d7'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:14.126303 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-fd925dfd-68e6-4041-9967-f3e4c80778d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1aa715929b1e42eea30e64d1ed48f905', 'request_id': 'req-fd925dfd-68e6-4041-9967-f3e4c80778d7'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:14.145343 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-fd925dfd-68e6-4041-9967-f3e4c80778d7 admin admin] The token cache is being invalidate because project 1aa715929b1e42eea30e64d1ed48f905 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:17:14.146077 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-fd925dfd-68e6-4041-9967-f3e4c80778d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:14.147160 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-fd925dfd-68e6-4041-9967-f3e4c80778d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:14.150322 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 872/1735] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 5 12:17:13 2022] DELETE /identity/v3/projects/1aa715929b1e42eea30e64d1ed48f905 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:17:14.151895 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd925dfd-68e6-4041-9967-f3e4c80778d7 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:14.153698 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-fd925dfd-68e6-4041-9967-f3e4c80778d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:14.161104 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:14.234117 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6f582f-cf60-4ac8-943b-1b4577fa4f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:14.234760 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6f582f-cf60-4ac8-943b-1b4577fa4f5a admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:14.235008 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6f582f-cf60-4ac8-943b-1b4577fa4f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:14.235315 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6f582f-cf60-4ac8-943b-1b4577fa4f5a admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:14.236124 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6f582f-cf60-4ac8-943b-1b4577fa4f5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:14.238632 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6f582f-cf60-4ac8-943b-1b4577fa4f5a admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:14.287845 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 864/1736] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 5 12:17:14 2022] POST /identity/v3/users => generated 288 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:17:14.289126 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6f582f-cf60-4ac8-943b-1b4577fa4f5a admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:14.296803 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-cd6f582f-cf60-4ac8-943b-1b4577fa4f5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:14.302384 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd925dfd-68e6-4041-9967-f3e4c80778d7 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:14.312599 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51653244-c7c8-4db6-bfbc-a4cb44f8bac5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb060ff495bc4abb83ff88992fb7be09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:14.313551 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51653244-c7c8-4db6-bfbc-a4cb44f8bac5 service nova] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:14.314000 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51653244-c7c8-4db6-bfbc-a4cb44f8bac5 service nova] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:14.315243 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51653244-c7c8-4db6-bfbc-a4cb44f8bac5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:14.318148 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-51653244-c7c8-4db6-bfbc-a4cb44f8bac5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:14.395740 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6f582f-cf60-4ac8-943b-1b4577fa4f5a admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:14.401391 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754327be-a735-470f-a89e-e57be573203c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37633bbae0c2423c81ccd61ac3a17ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:14.402389 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754327be-a735-470f-a89e-e57be573203c service cinder] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:14.402773 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754327be-a735-470f-a89e-e57be573203c service cinder] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:14.403144 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754327be-a735-470f-a89e-e57be573203c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:14.405179 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-754327be-a735-470f-a89e-e57be573203c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:14.432320 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51653244-c7c8-4db6-bfbc-a4cb44f8bac5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:14.435682 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51653244-c7c8-4db6-bfbc-a4cb44f8bac5 service nova] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:14.452167 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 873/1737] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:17:14 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:17:14.453495 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51653244-c7c8-4db6-bfbc-a4cb44f8bac5 service nova] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:14.457209 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-51653244-c7c8-4db6-bfbc-a4cb44f8bac5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:14.587483 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754327be-a735-470f-a89e-e57be573203c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:14.591890 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754327be-a735-470f-a89e-e57be573203c service cinder] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:14.599277 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51653244-c7c8-4db6-bfbc-a4cb44f8bac5 service nova] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:14.606145 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a931ce1d-bf92-4a54-9633-967085caa848 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4994b4faa4ec4aa088f3dc32c9c5614d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:14.608322 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a931ce1d-bf92-4a54-9633-967085caa848 service neutron] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:14.609109 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a931ce1d-bf92-4a54-9633-967085caa848 service neutron] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:14.609693 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a931ce1d-bf92-4a54-9633-967085caa848 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:14.615774 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 865/1738] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:17:14 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:17:14.628187 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-a931ce1d-bf92-4a54-9633-967085caa848 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:14.632092 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a5f1df-fd21-4f94-b249-58125ea359ab None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:14.638502 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a5f1df-fd21-4f94-b249-58125ea359ab None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:14.639772 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a5f1df-fd21-4f94-b249-58125ea359ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:14.685748 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a931ce1d-bf92-4a54-9633-967085caa848 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:14.690055 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a931ce1d-bf92-4a54-9633-967085caa848 service neutron] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:14.750564 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 874/1739] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:17:14 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:17:14.751974 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-29a5f1df-fd21-4f94-b249-58125ea359ab None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:17:14.752980 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a931ce1d-bf92-4a54-9633-967085caa848 service neutron] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:14.756649 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-a931ce1d-bf92-4a54-9633-967085caa848 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:14.758457 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-29a5f1df-fd21-4f94-b249-58125ea359ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:14.807582 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a931ce1d-bf92-4a54-9633-967085caa848 service neutron] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:14.807729 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 866/1740] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:17:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:17:14.813230 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066c69eb-f91f-4939-a471-06168d7eb62b None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:14.813330 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066c69eb-f91f-4939-a471-06168d7eb62b None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:14.813591 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066c69eb-f91f-4939-a471-06168d7eb62b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:14.842974 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8538aaa1-631f-4796-8d89-2e2f3d5de5ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:14.849608 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8538aaa1-631f-4796-8d89-2e2f3d5de5ca admin admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:14.849914 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8538aaa1-631f-4796-8d89-2e2f3d5de5ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:14.850834 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8538aaa1-631f-4796-8d89-2e2f3d5de5ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:14.852746 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8538aaa1-631f-4796-8d89-2e2f3d5de5ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:14.858515 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-066c69eb-f91f-4939-a471-06168d7eb62b None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:17:14.859786 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-066c69eb-f91f-4939-a471-06168d7eb62b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:14.862281 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8538aaa1-631f-4796-8d89-2e2f3d5de5ca admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:14.882408 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 867/1741] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:17:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:17:14.883554 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066c69eb-f91f-4939-a471-06168d7eb62b None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:14.903826 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 875/1742] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:17:14 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:17:14.904822 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066c69eb-f91f-4939-a471-06168d7eb62b None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:14.907569 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8538aaa1-631f-4796-8d89-2e2f3d5de5ca admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:14.917347 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c873f573-e7eb-4484-ada0-c48053bc729d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:14.925774 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c873f573-e7eb-4484-ada0-c48053bc729d admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:14.926301 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c873f573-e7eb-4484-ada0-c48053bc729d admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:14.928154 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c873f573-e7eb-4484-ada0-c48053bc729d admin admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:14.930119 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c873f573-e7eb-4484-ada0-c48053bc729d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:17:14.930614 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c873f573-e7eb-4484-ada0-c48053bc729d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:14.938075 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c873f573-e7eb-4484-ada0-c48053bc729d admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:14.938444 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8538aaa1-631f-4796-8d89-2e2f3d5de5ca admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:14.945619 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeccfc2-56c5-4d00-b6e8-f720aaa30cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:14.946562 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeccfc2-56c5-4d00-b6e8-f720aaa30cb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:14.947008 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeccfc2-56c5-4d00-b6e8-f720aaa30cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:14.947426 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeccfc2-56c5-4d00-b6e8-f720aaa30cb9 admin admin] PATH_INFO: `/v3/projects/59048c11d39a469eb281a965fd79e506/users/11859d3236824208bee7127ca157fee2/roles/16e2ccc8bd1b497d8cee780c1c7df0d2` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:14.959753 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:14.968729 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 868/1743] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Sep 5 12:17:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:17:14.971830 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c873f573-e7eb-4484-ada0-c48053bc729d admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:14.981917 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeccfc2-56c5-4d00-b6e8-f720aaa30cb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59048c11d39a469eb281a965fd79e506, user_id=11859d3236824208bee7127ca157fee2, role_id=16e2ccc8bd1b497d8cee780c1c7df0d2)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:14.987926 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeccfc2-56c5-4d00-b6e8-f720aaa30cb9 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:14.994815 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c873f573-e7eb-4484-ada0-c48053bc729d admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:15.011826 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee63c21-92c3-4e96-a507-d573e4c72b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:15.012375 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee63c21-92c3-4e96-a507-d573e4c72b86 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:15.012661 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee63c21-92c3-4e96-a507-d573e4c72b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:15.012958 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee63c21-92c3-4e96-a507-d573e4c72b86 admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:15.013608 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee63c21-92c3-4e96-a507-d573e4c72b86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:15.015641 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee63c21-92c3-4e96-a507-d573e4c72b86 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:15.019795 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 876/1744] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 5 12:17:14 2022] PUT /identity/v3/projects/59048c11d39a469eb281a965fd79e506/users/11859d3236824208bee7127ca157fee2/roles/16e2ccc8bd1b497d8cee780c1c7df0d2 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:17:15.023699 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeccfc2-56c5-4d00-b6e8-f720aaa30cb9 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:15.081523 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 869/1745] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 5 12:17:14 2022] POST /identity/v3/projects => generated 405 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:17:15.082661 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee63c21-92c3-4e96-a507-d573e4c72b86 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:15.110099 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:15.226617 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeccfc2-56c5-4d00-b6e8-f720aaa30cb9 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:15.240581 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee63c21-92c3-4e96-a507-d573e4c72b86 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:15.246619 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db41b9fb-aa78-4d63-93d2-cfdde324f715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:15.247418 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db41b9fb-aa78-4d63-93d2-cfdde324f715 admin admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:15.247836 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db41b9fb-aa78-4d63-93d2-cfdde324f715 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:15.248022 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db41b9fb-aa78-4d63-93d2-cfdde324f715 admin admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:15.248635 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db41b9fb-aa78-4d63-93d2-cfdde324f715 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:15.257917 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db41b9fb-aa78-4d63-93d2-cfdde324f715 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:15.261486 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56cd17d-63b6-4025-bb7d-95229f831f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:15.262203 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56cd17d-63b6-4025-bb7d-95229f831f8d admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:15.262429 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56cd17d-63b6-4025-bb7d-95229f831f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:15.262878 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56cd17d-63b6-4025-bb7d-95229f831f8d admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:15.263534 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56cd17d-63b6-4025-bb7d-95229f831f8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:15.265674 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56cd17d-63b6-4025-bb7d-95229f831f8d admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:15.292137 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 877/1746] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:17:15 2022] GET /identity/v3/roles => generated 1420 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 12:17:15.297324 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db41b9fb-aa78-4d63-93d2-cfdde324f715 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:15.320056 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db41b9fb-aa78-4d63-93d2-cfdde324f715 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:15.327660 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 870/1747] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 5 12:17:15 2022] POST /identity/v3/users => generated 303 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 12:17:15.332330 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56cd17d-63b6-4025-bb7d-95229f831f8d admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:15.338744 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5bb4bd-17dc-49f7-b217-6df179aafbbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:15.339609 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5bb4bd-17dc-49f7-b217-6df179aafbbf admin admin] REQUEST_METHOD: `PUT` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:15.340428 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5bb4bd-17dc-49f7-b217-6df179aafbbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:15.340697 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5bb4bd-17dc-49f7-b217-6df179aafbbf admin admin] PATH_INFO: `/v3/projects/59048c11d39a469eb281a965fd79e506/users/11859d3236824208bee7127ca157fee2/roles/16e2ccc8bd1b497d8cee780c1c7df0d2` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:15.352864 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5bb4bd-17dc-49f7-b217-6df179aafbbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=59048c11d39a469eb281a965fd79e506, user_id=11859d3236824208bee7127ca157fee2, role_id=16e2ccc8bd1b497d8cee780c1c7df0d2)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:15.356124 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5bb4bd-17dc-49f7-b217-6df179aafbbf admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:15.362850 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56cd17d-63b6-4025-bb7d-95229f831f8d admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:15.376984 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff65c91-faa7-4ec7-a852-d6e3d8409651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:15.377358 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff65c91-faa7-4ec7-a852-d6e3d8409651 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:15.377697 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff65c91-faa7-4ec7-a852-d6e3d8409651 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:15.377825 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff65c91-faa7-4ec7-a852-d6e3d8409651 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:15.378480 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff65c91-faa7-4ec7-a852-d6e3d8409651 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:15.380110 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff65c91-faa7-4ec7-a852-d6e3d8409651 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:15.400428 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 878/1748] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 5 12:17:15 2022] PUT /identity/v3/projects/59048c11d39a469eb281a965fd79e506/users/11859d3236824208bee7127ca157fee2/roles/16e2ccc8bd1b497d8cee780c1c7df0d2 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 12:17:15.412411 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d9898d-6dde-4eab-b6c1-561fcfde6b95 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:15.412749 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d9898d-6dde-4eab-b6c1-561fcfde6b95 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:15.412994 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d9898d-6dde-4eab-b6c1-561fcfde6b95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:15.430831 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 871/1749] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:17:15 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 12:17:15.433251 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e114383-612b-4723-af75-05593d551a8e None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:15.437828 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e114383-612b-4723-af75-05593d551a8e None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:15.438355 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e114383-612b-4723-af75-05593d551a8e None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:15.451651 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 872/1750] 10.222.0.50 () {54 vars in 912 bytes} [Mon Sep 5 12:17:15 2022] GET /identity => generated 270 bytes in 20 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:17:15.453103 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e114383-612b-4723-af75-05593d551a8e None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:15.491163 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-82d9898d-6dde-4eab-b6c1-561fcfde6b95 None None] MFA Rules not processed for user `11859d3236824208bee7127ca157fee2`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:17:15.492417 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-82d9898d-6dde-4eab-b6c1-561fcfde6b95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:15.674351 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e114383-612b-4723-af75-05593d551a8e None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:15.764405 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cfe84e-697a-4d25-a1ab-f6dacf07a01d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:15.767598 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cfe84e-697a-4d25-a1ab-f6dacf07a01d admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:15.767831 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cfe84e-697a-4d25-a1ab-f6dacf07a01d admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:15.768122 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cfe84e-697a-4d25-a1ab-f6dacf07a01d admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:15.768794 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cfe84e-697a-4d25-a1ab-f6dacf07a01d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:15.772844 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cfe84e-697a-4d25-a1ab-f6dacf07a01d admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:15.802737 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 873/1751] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:17:15 2022] GET /identity/v3/roles => generated 1420 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:17:15.804940 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6de037-16f7-4992-8bde-847763deabbe None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:15.805374 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6de037-16f7-4992-8bde-847763deabbe None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:15.805654 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6de037-16f7-4992-8bde-847763deabbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:15.844447 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 879/1752] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:17:15 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 427 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 12:17:15.844447 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d9898d-6dde-4eab-b6c1-561fcfde6b95 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:15.848804 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-3e6de037-16f7-4992-8bde-847763deabbe None None] MFA Rules not processed for user `4994b4faa4ec4aa088f3dc32c9c5614d`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:17:15.852424 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-3e6de037-16f7-4992-8bde-847763deabbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:15.864647 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d9898d-6dde-4eab-b6c1-561fcfde6b95 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:15.877617 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a9962e-db04-4ecb-ab10-8b3cec0a1da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:15.878312 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a9962e-db04-4ecb-ab10-8b3cec0a1da3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:15.883703 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a9962e-db04-4ecb-ab10-8b3cec0a1da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:15.887449 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a9962e-db04-4ecb-ab10-8b3cec0a1da3 admin admin] PATH_INFO: `/v3/projects/f8379bbd35114aa78517f8d33dc52aca/users/f5392206213f416398ec93d962928701/roles/ed72181e1403401facb77dcf33644757` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:15.978417 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a9962e-db04-4ecb-ab10-8b3cec0a1da3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8379bbd35114aa78517f8d33dc52aca, user_id=f5392206213f416398ec93d962928701, role_id=ed72181e1403401facb77dcf33644757)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:15.982544 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a9962e-db04-4ecb-ab10-8b3cec0a1da3 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:16.015044 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 874/1753] 10.222.0.50 () {58 vars in 1009 bytes} [Mon Sep 5 12:17:15 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:17:16.016216 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6de037-16f7-4992-8bde-847763deabbe None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:16.017864 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-3e6de037-16f7-4992-8bde-847763deabbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:16.034029 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 880/1754] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 5 12:17:15 2022] PUT /identity/v3/projects/f8379bbd35114aa78517f8d33dc52aca/users/f5392206213f416398ec93d962928701/roles/ed72181e1403401facb77dcf33644757 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:17:16.034029 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a9962e-db04-4ecb-ab10-8b3cec0a1da3 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:16.123658 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:16.164580 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:16.169105 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a9962e-db04-4ecb-ab10-8b3cec0a1da3 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:16.189508 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9ab9f5-6d03-4e0e-9999-85dcaa8916c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4994b4faa4ec4aa088f3dc32c9c5614d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:16.201611 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9ab9f5-6d03-4e0e-9999-85dcaa8916c6 service neutron] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:16.203578 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9ab9f5-6d03-4e0e-9999-85dcaa8916c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:16.204204 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9ab9f5-6d03-4e0e-9999-85dcaa8916c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:16.219694 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6de037-16f7-4992-8bde-847763deabbe None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:16.224654 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9ab9f5-6d03-4e0e-9999-85dcaa8916c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:16.230846 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9ab9f5-6d03-4e0e-9999-85dcaa8916c6 service neutron] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:16.251333 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 881/1755] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:17:16 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:17:16.253989 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3d69f8-1498-4737-9a0a-052dcb09cca8 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:16.256689 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3d69f8-1498-4737-9a0a-052dcb09cca8 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:16.257212 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3d69f8-1498-4737-9a0a-052dcb09cca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:16.328607 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-7e3d69f8-1498-4737-9a0a-052dcb09cca8 None None] MFA Rules not processed for user `f5392206213f416398ec93d962928701`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:17:16.333698 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-7e3d69f8-1498-4737-9a0a-052dcb09cca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:16.345981 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd28787c-4c89-4376-b666-ab8fc61b613e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37633bbae0c2423c81ccd61ac3a17ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:16.346697 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd28787c-4c89-4376-b666-ab8fc61b613e service cinder] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:16.347049 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd28787c-4c89-4376-b666-ab8fc61b613e service cinder] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:16.347396 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd28787c-4c89-4376-b666-ab8fc61b613e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:16.477920 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd28787c-4c89-4376-b666-ab8fc61b613e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:16.481316 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd28787c-4c89-4376-b666-ab8fc61b613e service cinder] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:16.501430 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 875/1756] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:17:16 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:17:16.503269 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd28787c-4c89-4376-b666-ab8fc61b613e service cinder] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:16.513977 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-dd28787c-4c89-4376-b666-ab8fc61b613e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:16.527951 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 882/1757] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:17:16 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:17:16.529410 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e042aab-d9fc-4296-ba87-81d93596f3f9 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:16.535236 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e042aab-d9fc-4296-ba87-81d93596f3f9 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:16.536036 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e042aab-d9fc-4296-ba87-81d93596f3f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:16.613039 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-5e042aab-d9fc-4296-ba87-81d93596f3f9 None None] MFA Rules not processed for user `95c65245dd614ebb9b9ebf2fcc620cea`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:17:16.615798 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-5e042aab-d9fc-4296-ba87-81d93596f3f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:16.718306 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd28787c-4c89-4376-b666-ab8fc61b613e service cinder] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:16.732768 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3b0af7-0c84-41a2-b065-c924e7514984 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5427d0752de4817b6aa25e28c2d9a30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:16.733557 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3b0af7-0c84-41a2-b065-c924e7514984 service placement] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:16.733949 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3b0af7-0c84-41a2-b065-c924e7514984 service placement] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:16.734333 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3b0af7-0c84-41a2-b065-c924e7514984 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:16.748477 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-5b3b0af7-0c84-41a2-b065-c924e7514984 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:16.765736 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 883/1758] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:17:16 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:17:16.766229 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e042aab-d9fc-4296-ba87-81d93596f3f9 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:16.789425 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e042aab-d9fc-4296-ba87-81d93596f3f9 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:16.790694 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3b0af7-0c84-41a2-b065-c924e7514984 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:16.794250 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3b0af7-0c84-41a2-b065-c924e7514984 service placement] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:16.802166 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7573bda3-e38f-4888-8024-61707f2dd048 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37633bbae0c2423c81ccd61ac3a17ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:16.803079 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7573bda3-e38f-4888-8024-61707f2dd048 service cinder] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:16.803669 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7573bda3-e38f-4888-8024-61707f2dd048 service cinder] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:16.804089 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7573bda3-e38f-4888-8024-61707f2dd048 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:16.806591 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-7573bda3-e38f-4888-8024-61707f2dd048 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:16.833735 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 876/1759] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:17:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:17:16.834771 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3b0af7-0c84-41a2-b065-c924e7514984 service placement] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:16.947027 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:16.961211 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7573bda3-e38f-4888-8024-61707f2dd048 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:16.966139 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7573bda3-e38f-4888-8024-61707f2dd048 service cinder] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:16.994017 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 884/1760] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:17:16 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:17:16.995371 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f65688c-1702-4794-93cb-2c7025dda50e None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:16.995658 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f65688c-1702-4794-93cb-2c7025dda50e None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:16.995934 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f65688c-1702-4794-93cb-2c7025dda50e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:17.005570 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3b0af7-0c84-41a2-b065-c924e7514984 service placement] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:17.023637 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bcedfc-e03b-47b9-9576-66e987b6daaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:17.024823 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bcedfc-e03b-47b9-9576-66e987b6daaa admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:17.025225 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bcedfc-e03b-47b9-9576-66e987b6daaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:17.025591 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bcedfc-e03b-47b9-9576-66e987b6daaa admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:17.026344 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bcedfc-e03b-47b9-9576-66e987b6daaa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:17.032418 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bcedfc-e03b-47b9-9576-66e987b6daaa admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:17.042793 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:17.059939 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-3f65688c-1702-4794-93cb-2c7025dda50e None None] MFA Rules not processed for user `b7dcead6e9584ab8949678016ed12335`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:17:17.061246 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-3f65688c-1702-4794-93cb-2c7025dda50e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:17.107086 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 877/1761] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 5 12:17:16 2022] POST /identity/v3/projects => generated 405 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:17:17.108312 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bcedfc-e03b-47b9-9576-66e987b6daaa admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:17.246857 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 885/1762] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:17:16 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:17:17.319232 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bcedfc-e03b-47b9-9576-66e987b6daaa admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:17.324208 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bfa740-1874-40e2-88c3-3b7c43fe9039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:17.326230 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bfa740-1874-40e2-88c3-3b7c43fe9039 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:17.326506 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bfa740-1874-40e2-88c3-3b7c43fe9039 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:17.326778 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bfa740-1874-40e2-88c3-3b7c43fe9039 admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:17.327433 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bfa740-1874-40e2-88c3-3b7c43fe9039 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:17.329420 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bfa740-1874-40e2-88c3-3b7c43fe9039 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:17.362186 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 878/1763] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 5 12:17:17 2022] POST /identity/v3/users => generated 309 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:17:17.366479 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f65688c-1702-4794-93cb-2c7025dda50e None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:17.393364 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f65688c-1702-4794-93cb-2c7025dda50e None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:17.412292 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac398d57-c539-4939-bfd7-f54bda36008a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:17.417651 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac398d57-c539-4939-bfd7-f54bda36008a admin admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:17.418745 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac398d57-c539-4939-bfd7-f54bda36008a admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:17.420212 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac398d57-c539-4939-bfd7-f54bda36008a admin admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:17.426267 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac398d57-c539-4939-bfd7-f54bda36008a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:17.431547 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac398d57-c539-4939-bfd7-f54bda36008a admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:17.466076 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 886/1764] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:17:17 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:17:17.479400 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bfa740-1874-40e2-88c3-3b7c43fe9039 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:17.543278 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bfa740-1874-40e2-88c3-3b7c43fe9039 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:17.575197 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f38378-7bc4-458c-8ca6-fe9afd3f5c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:17.575875 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f38378-7bc4-458c-8ca6-fe9afd3f5c12 admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:17.576165 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f38378-7bc4-458c-8ca6-fe9afd3f5c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:17.588399 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f38378-7bc4-458c-8ca6-fe9afd3f5c12 admin admin] PATH_INFO: `/v3/projects/6bb4ca25541845d5af589bd0938c412a/users/2f7e34c3277244f38370bc88c20bfda9/roles/16e2ccc8bd1b497d8cee780c1c7df0d2` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:17.645582 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f38378-7bc4-458c-8ca6-fe9afd3f5c12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bb4ca25541845d5af589bd0938c412a, user_id=2f7e34c3277244f38370bc88c20bfda9, role_id=16e2ccc8bd1b497d8cee780c1c7df0d2)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:17.653717 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f38378-7bc4-458c-8ca6-fe9afd3f5c12 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:17.697930 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 879/1765] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 5 12:17:17 2022] PUT /identity/v3/projects/6bb4ca25541845d5af589bd0938c412a/users/2f7e34c3277244f38370bc88c20bfda9/roles/16e2ccc8bd1b497d8cee780c1c7df0d2 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:17:17.698681 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac398d57-c539-4939-bfd7-f54bda36008a admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:17.720409 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac398d57-c539-4939-bfd7-f54bda36008a admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:17.915792 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c486b0d1-cc17-48fc-ab8c-1af6765abc43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:17.916469 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c486b0d1-cc17-48fc-ab8c-1af6765abc43 admin admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:17.917606 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c486b0d1-cc17-48fc-ab8c-1af6765abc43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:17.918090 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c486b0d1-cc17-48fc-ab8c-1af6765abc43 admin admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:17.935617 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c486b0d1-cc17-48fc-ab8c-1af6765abc43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:17.941854 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c486b0d1-cc17-48fc-ab8c-1af6765abc43 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:17.968432 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 887/1766] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:17:17 2022] GET /identity/v3/roles => generated 1420 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 12:17:17.972751 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f38378-7bc4-458c-8ca6-fe9afd3f5c12 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:17.988677 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f38378-7bc4-458c-8ca6-fe9afd3f5c12 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:18.003445 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3982ec-596e-434a-9d0e-fdb97b64c655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:18.005148 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3982ec-596e-434a-9d0e-fdb97b64c655 admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:18.005445 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3982ec-596e-434a-9d0e-fdb97b64c655 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:18.006044 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3982ec-596e-434a-9d0e-fdb97b64c655 admin admin] PATH_INFO: `/v3/projects/6bb4ca25541845d5af589bd0938c412a/users/2f7e34c3277244f38370bc88c20bfda9/roles/16e2ccc8bd1b497d8cee780c1c7df0d2` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:18.012404 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3982ec-596e-434a-9d0e-fdb97b64c655 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bb4ca25541845d5af589bd0938c412a, user_id=2f7e34c3277244f38370bc88c20bfda9, role_id=16e2ccc8bd1b497d8cee780c1c7df0d2)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:18.021206 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3982ec-596e-434a-9d0e-fdb97b64c655 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:18.050934 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 880/1767] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 5 12:17:17 2022] PUT /identity/v3/projects/6bb4ca25541845d5af589bd0938c412a/users/2f7e34c3277244f38370bc88c20bfda9/roles/16e2ccc8bd1b497d8cee780c1c7df0d2 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:17:18.063548 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038a6424-aec9-4e13-bc72-a6401ccf4c5f None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:18.064113 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038a6424-aec9-4e13-bc72-a6401ccf4c5f None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:18.064583 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038a6424-aec9-4e13-bc72-a6401ccf4c5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:18.149912 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-038a6424-aec9-4e13-bc72-a6401ccf4c5f None None] MFA Rules not processed for user `2f7e34c3277244f38370bc88c20bfda9`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:17:18.151073 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-038a6424-aec9-4e13-bc72-a6401ccf4c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:18.353580 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 888/1768] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:17:18 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:17:18.443654 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3982ec-596e-434a-9d0e-fdb97b64c655 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:18.572383 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3982ec-596e-434a-9d0e-fdb97b64c655 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:18.584572 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6881183d-2667-40f5-888b-347760c8e232 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37633bbae0c2423c81ccd61ac3a17ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:18.585536 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6881183d-2667-40f5-888b-347760c8e232 service cinder] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:18.585981 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6881183d-2667-40f5-888b-347760c8e232 service cinder] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:18.586458 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6881183d-2667-40f5-888b-347760c8e232 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:18.616970 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6881183d-2667-40f5-888b-347760c8e232 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:18.618760 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6881183d-2667-40f5-888b-347760c8e232 service cinder] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:18.644662 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 881/1769] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:17:18 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:17:18.912451 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038a6424-aec9-4e13-bc72-a6401ccf4c5f None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:19.079341 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:19.161983 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6881183d-2667-40f5-888b-347760c8e232 service cinder] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:19.305555 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:19.488284 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038a6424-aec9-4e13-bc72-a6401ccf4c5f None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:19.508993 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68399ac-04b0-4af7-ad6d-1ccddd9a1f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:19.510664 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68399ac-04b0-4af7-ad6d-1ccddd9a1f38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:19.521730 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68399ac-04b0-4af7-ad6d-1ccddd9a1f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:19.524823 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68399ac-04b0-4af7-ad6d-1ccddd9a1f38 admin admin] PATH_INFO: `/v3/users/e8cc084e721a47ed89d907c31c6e5522` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:19.527963 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68399ac-04b0-4af7-ad6d-1ccddd9a1f38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8cc084e721a47ed89d907c31c6e5522)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:19.537387 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68399ac-04b0-4af7-ad6d-1ccddd9a1f38 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:19.656560 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6881183d-2667-40f5-888b-347760c8e232 service cinder] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:19.672846 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612e2282-3f37-443a-abd1-34df3def41dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:19.674234 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612e2282-3f37-443a-abd1-34df3def41dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:19.674712 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612e2282-3f37-443a-abd1-34df3def41dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:19.675285 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612e2282-3f37-443a-abd1-34df3def41dc admin admin] PATH_INFO: `/v3/users/f5392206213f416398ec93d962928701` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:19.706436 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612e2282-3f37-443a-abd1-34df3def41dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5392206213f416398ec93d962928701)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:19.713932 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612e2282-3f37-443a-abd1-34df3def41dc admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:19.730392 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-d68399ac-04b0-4af7-ad6d-1ccddd9a1f38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8cc084e721a47ed89d907c31c6e5522'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:19.731806 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-d68399ac-04b0-4af7-ad6d-1ccddd9a1f38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8cc084e721a47ed89d907c31c6e5522'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:19.753704 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-d68399ac-04b0-4af7-ad6d-1ccddd9a1f38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8cc084e721a47ed89d907c31c6e5522'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:19.754515 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-d68399ac-04b0-4af7-ad6d-1ccddd9a1f38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8cc084e721a47ed89d907c31c6e5522'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:19.823630 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-d68399ac-04b0-4af7-ad6d-1ccddd9a1f38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8cc084e721a47ed89d907c31c6e5522'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:19.878167 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 889/1770] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 5 12:17:18 2022] DELETE /identity/v3/users/e8cc084e721a47ed89d907c31c6e5522 => generated 0 bytes in 967 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:17:19.898792 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289a52f9-a5ea-4c6c-8a89-aa9415d60557 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:19.900122 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289a52f9-a5ea-4c6c-8a89-aa9415d60557 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:19.903234 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289a52f9-a5ea-4c6c-8a89-aa9415d60557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:19.916332 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-612e2282-3f37-443a-abd1-34df3def41dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5392206213f416398ec93d962928701'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:19.923968 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-612e2282-3f37-443a-abd1-34df3def41dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5392206213f416398ec93d962928701'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:19.942546 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-612e2282-3f37-443a-abd1-34df3def41dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5392206213f416398ec93d962928701'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:19.944154 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-612e2282-3f37-443a-abd1-34df3def41dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5392206213f416398ec93d962928701'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:19.978466 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-612e2282-3f37-443a-abd1-34df3def41dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5392206213f416398ec93d962928701'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:19.991472 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-289a52f9-a5ea-4c6c-8a89-aa9415d60557 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:17:19.994174 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-289a52f9-a5ea-4c6c-8a89-aa9415d60557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:20.049243 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 882/1771] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 5 12:17:19 2022] DELETE /identity/v3/users/f5392206213f416398ec93d962928701 => generated 0 bytes in 888 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:17:20.055257 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e06eddf-9b76-45f2-8f35-47dd90ffd19e None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:20.057522 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e06eddf-9b76-45f2-8f35-47dd90ffd19e None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:20.058747 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e06eddf-9b76-45f2-8f35-47dd90ffd19e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:20.136007 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-9e06eddf-9b76-45f2-8f35-47dd90ffd19e None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:17:20.139350 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-9e06eddf-9b76-45f2-8f35-47dd90ffd19e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:20.269334 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 890/1772] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:17:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 386 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:17:20.280251 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289a52f9-a5ea-4c6c-8a89-aa9415d60557 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:20.312781 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-289a52f9-a5ea-4c6c-8a89-aa9415d60557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:20.382681 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 883/1773] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:17:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:17:20.392221 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e06eddf-9b76-45f2-8f35-47dd90ffd19e None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:20.393950 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-9e06eddf-9b76-45f2-8f35-47dd90ffd19e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:20.510992 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:20.590722 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e06eddf-9b76-45f2-8f35-47dd90ffd19e None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:20.622130 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0653cbb9-d525-4782-93e6-e7470fb61a00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4994b4faa4ec4aa088f3dc32c9c5614d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:20.624137 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0653cbb9-d525-4782-93e6-e7470fb61a00 service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:20.625394 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0653cbb9-d525-4782-93e6-e7470fb61a00 service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:20.626716 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0653cbb9-d525-4782-93e6-e7470fb61a00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:20.652359 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:20.654204 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0653cbb9-d525-4782-93e6-e7470fb61a00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:20.658849 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0653cbb9-d525-4782-93e6-e7470fb61a00 service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:20.703725 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 884/1774] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:17:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 12:17:20.706135 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0653cbb9-d525-4782-93e6-e7470fb61a00 service neutron] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:20.709443 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289a52f9-a5ea-4c6c-8a89-aa9415d60557 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:20.709937 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-0653cbb9-d525-4782-93e6-e7470fb61a00 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:20.724659 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585f8368-2ad9-4d76-bab9-e7838ee46f78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4994b4faa4ec4aa088f3dc32c9c5614d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:20.726497 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585f8368-2ad9-4d76-bab9-e7838ee46f78 service neutron] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:20.727797 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585f8368-2ad9-4d76-bab9-e7838ee46f78 service neutron] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:20.729750 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585f8368-2ad9-4d76-bab9-e7838ee46f78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:20.770645 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0653cbb9-d525-4782-93e6-e7470fb61a00 service neutron] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:20.777554 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20afe33-54fe-482c-a252-f5f3c4b692cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:20.778957 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20afe33-54fe-482c-a252-f5f3c4b692cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:20.779473 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20afe33-54fe-482c-a252-f5f3c4b692cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:20.779960 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20afe33-54fe-482c-a252-f5f3c4b692cc admin admin] PATH_INFO: `/v3/users/22dcc620730a4801b42c1752cb3a8c7a` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:20.781770 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20afe33-54fe-482c-a252-f5f3c4b692cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=22dcc620730a4801b42c1752cb3a8c7a)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:20.786104 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20afe33-54fe-482c-a252-f5f3c4b692cc admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:20.800414 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585f8368-2ad9-4d76-bab9-e7838ee46f78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:20.811063 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585f8368-2ad9-4d76-bab9-e7838ee46f78 service neutron] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:20.897787 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 891/1775] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:17:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 619 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:17:20.988549 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-e20afe33-54fe-482c-a252-f5f3c4b692cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22dcc620730a4801b42c1752cb3a8c7a'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:20.990698 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-e20afe33-54fe-482c-a252-f5f3c4b692cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22dcc620730a4801b42c1752cb3a8c7a'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:21.013126 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-e20afe33-54fe-482c-a252-f5f3c4b692cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22dcc620730a4801b42c1752cb3a8c7a'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:21.013769 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-e20afe33-54fe-482c-a252-f5f3c4b692cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22dcc620730a4801b42c1752cb3a8c7a'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:21.041561 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-e20afe33-54fe-482c-a252-f5f3c4b692cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22dcc620730a4801b42c1752cb3a8c7a'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:21.070961 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 885/1776] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 5 12:17:20 2022] DELETE /identity/v3/users/22dcc620730a4801b42c1752cb3a8c7a => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:17:21.075540 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59f8e53-473b-4d19-aabc-9fe713bf07c4 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:21.075839 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59f8e53-473b-4d19-aabc-9fe713bf07c4 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:21.076122 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59f8e53-473b-4d19-aabc-9fe713bf07c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:21.140530 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-a59f8e53-473b-4d19-aabc-9fe713bf07c4 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:17:21.142056 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-a59f8e53-473b-4d19-aabc-9fe713bf07c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:21.381465 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 892/1777] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:17:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:17:21.403686 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20afe33-54fe-482c-a252-f5f3c4b692cc admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:21.406986 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-e20afe33-54fe-482c-a252-f5f3c4b692cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:21.567216 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d333508e-c332-4dcb-95e6-50d0da74d0a6 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:21.567531 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d333508e-c332-4dcb-95e6-50d0da74d0a6 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:21.567773 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d333508e-c332-4dcb-95e6-50d0da74d0a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:21.656086 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20afe33-54fe-482c-a252-f5f3c4b692cc admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:21.670975 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f717ca58-a892-4ec1-959c-440840bcfc4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4994b4faa4ec4aa088f3dc32c9c5614d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:21.671611 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f717ca58-a892-4ec1-959c-440840bcfc4b service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:21.671895 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f717ca58-a892-4ec1-959c-440840bcfc4b service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:21.678755 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f717ca58-a892-4ec1-959c-440840bcfc4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:21.712231 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f717ca58-a892-4ec1-959c-440840bcfc4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:21.719545 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f717ca58-a892-4ec1-959c-440840bcfc4b service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:21.727071 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-d333508e-c332-4dcb-95e6-50d0da74d0a6 None None] MFA Rules not processed for user `bacc8ece8df24bf498c1d55ca2918224`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:17:21.729318 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-d333508e-c332-4dcb-95e6-50d0da74d0a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:21.759625 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 886/1778] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:17:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:17:21.894233 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 893/1779] 10.222.0.50 () {58 vars in 1009 bytes} [Mon Sep 5 12:17:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Sep 05 12:17:22.218661 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f717ca58-a892-4ec1-959c-440840bcfc4b service neutron] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:22.220325 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-f717ca58-a892-4ec1-959c-440840bcfc4b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:22.331884 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:22.335456 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d333508e-c332-4dcb-95e6-50d0da74d0a6 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:22.337289 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-d333508e-c332-4dcb-95e6-50d0da74d0a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:22.388557 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d333508e-c332-4dcb-95e6-50d0da74d0a6 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:22.400918 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582500a6-8d67-465d-835f-9c65cde099f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:22.402325 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582500a6-8d67-465d-835f-9c65cde099f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:22.405597 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582500a6-8d67-465d-835f-9c65cde099f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:22.406251 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582500a6-8d67-465d-835f-9c65cde099f5 admin admin] PATH_INFO: `/v3/projects/f8379bbd35114aa78517f8d33dc52aca` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:22.407766 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582500a6-8d67-465d-835f-9c65cde099f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8379bbd35114aa78517f8d33dc52aca)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:22.410812 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582500a6-8d67-465d-835f-9c65cde099f5 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:22.444118 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f717ca58-a892-4ec1-959c-440840bcfc4b service neutron] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:22.454013 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2067f4-cbc4-4142-ba91-33288f86d04d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2b32d58d964585a24e7c5784a8355f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:22.457046 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2067f4-cbc4-4142-ba91-33288f86d04d service swift] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:22.458246 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2067f4-cbc4-4142-ba91-33288f86d04d service swift] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:22.458860 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2067f4-cbc4-4142-ba91-33288f86d04d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:22.472568 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2067f4-cbc4-4142-ba91-33288f86d04d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:22.475279 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2067f4-cbc4-4142-ba91-33288f86d04d service swift] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:22.485937 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 887/1780] 10.222.0.50 () {60 vars in 1384 bytes} [Mon Sep 5 12:17:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 05 12:17:22.507858 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2067f4-cbc4-4142-ba91-33288f86d04d service swift] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:22.511106 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-0e2067f4-cbc4-4142-ba91-33288f86d04d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:22.517497 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-582500a6-8d67-465d-835f-9c65cde099f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8379bbd35114aa78517f8d33dc52aca', 'request_id': 'req-582500a6-8d67-465d-835f-9c65cde099f5'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:22.525707 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:22.537253 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-582500a6-8d67-465d-835f-9c65cde099f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8379bbd35114aa78517f8d33dc52aca', 'request_id': 'req-582500a6-8d67-465d-835f-9c65cde099f5'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:22.566518 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2067f4-cbc4-4142-ba91-33288f86d04d service swift] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:22.568443 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-582500a6-8d67-465d-835f-9c65cde099f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8379bbd35114aa78517f8d33dc52aca', 'request_id': 'req-582500a6-8d67-465d-835f-9c65cde099f5'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:22.603324 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-582500a6-8d67-465d-835f-9c65cde099f5 admin admin] The token cache is being invalidate because project f8379bbd35114aa78517f8d33dc52aca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:17:22.603671 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-582500a6-8d67-465d-835f-9c65cde099f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:22.610545 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-582500a6-8d67-465d-835f-9c65cde099f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:22.617287 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 894/1781] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 5 12:17:22 2022] DELETE /identity/v3/projects/f8379bbd35114aa78517f8d33dc52aca => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:17:22.622990 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582500a6-8d67-465d-835f-9c65cde099f5 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:22.628836 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-582500a6-8d67-465d-835f-9c65cde099f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:22.780033 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bae2ed-17ca-40a8-a8ae-fd561e49fb06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:22.793862 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bae2ed-17ca-40a8-a8ae-fd561e49fb06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:22.800131 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bae2ed-17ca-40a8-a8ae-fd561e49fb06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:22.800653 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bae2ed-17ca-40a8-a8ae-fd561e49fb06 admin admin] PATH_INFO: `/v3/projects/0f31cfec64f245eda4d6285532bea381` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:22.806289 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bae2ed-17ca-40a8-a8ae-fd561e49fb06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f31cfec64f245eda4d6285532bea381)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:22.808239 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bae2ed-17ca-40a8-a8ae-fd561e49fb06 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:22.934911 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582500a6-8d67-465d-835f-9c65cde099f5 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:22.949063 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14ffcd0-6adc-4d9e-8051-a424009502e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:22.949722 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14ffcd0-6adc-4d9e-8051-a424009502e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:22.950010 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14ffcd0-6adc-4d9e-8051-a424009502e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:22.950279 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14ffcd0-6adc-4d9e-8051-a424009502e1 admin admin] PATH_INFO: `/v3/users/2f7e34c3277244f38370bc88c20bfda9` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:22.952697 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14ffcd0-6adc-4d9e-8051-a424009502e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f7e34c3277244f38370bc88c20bfda9)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:22.954742 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14ffcd0-6adc-4d9e-8051-a424009502e1 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:23.093250 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-99bae2ed-17ca-40a8-a8ae-fd561e49fb06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f31cfec64f245eda4d6285532bea381', 'request_id': 'req-99bae2ed-17ca-40a8-a8ae-fd561e49fb06'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:23.116449 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-99bae2ed-17ca-40a8-a8ae-fd561e49fb06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f31cfec64f245eda4d6285532bea381', 'request_id': 'req-99bae2ed-17ca-40a8-a8ae-fd561e49fb06'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:23.133196 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-99bae2ed-17ca-40a8-a8ae-fd561e49fb06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f31cfec64f245eda4d6285532bea381', 'request_id': 'req-99bae2ed-17ca-40a8-a8ae-fd561e49fb06'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:23.179776 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-99bae2ed-17ca-40a8-a8ae-fd561e49fb06 admin admin] The token cache is being invalidate because project 0f31cfec64f245eda4d6285532bea381 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:17:23.180060 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-99bae2ed-17ca-40a8-a8ae-fd561e49fb06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:23.184970 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-99bae2ed-17ca-40a8-a8ae-fd561e49fb06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:23.193412 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 888/1782] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 5 12:17:22 2022] DELETE /identity/v3/projects/0f31cfec64f245eda4d6285532bea381 => generated 0 bytes in 684 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:17:23.194486 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bae2ed-17ca-40a8-a8ae-fd561e49fb06 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:23.196354 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-e14ffcd0-6adc-4d9e-8051-a424009502e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f7e34c3277244f38370bc88c20bfda9'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:23.198378 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-e14ffcd0-6adc-4d9e-8051-a424009502e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f7e34c3277244f38370bc88c20bfda9'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:23.199534 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-99bae2ed-17ca-40a8-a8ae-fd561e49fb06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:23.232696 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-e14ffcd0-6adc-4d9e-8051-a424009502e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f7e34c3277244f38370bc88c20bfda9'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:23.233445 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-e14ffcd0-6adc-4d9e-8051-a424009502e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f7e34c3277244f38370bc88c20bfda9'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:23.284193 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-e14ffcd0-6adc-4d9e-8051-a424009502e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f7e34c3277244f38370bc88c20bfda9'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:23.318195 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 895/1783] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 5 12:17:22 2022] DELETE /identity/v3/users/2f7e34c3277244f38370bc88c20bfda9 => generated 0 bytes in 695 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 12:17:23.332429 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14ffcd0-6adc-4d9e-8051-a424009502e1 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:23.334135 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-e14ffcd0-6adc-4d9e-8051-a424009502e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:23.383401 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:23.420636 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bae2ed-17ca-40a8-a8ae-fd561e49fb06 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:23.533614 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14ffcd0-6adc-4d9e-8051-a424009502e1 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:23.546827 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacdbc65-5747-4ec9-bb06-0b74b71ee68d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37633bbae0c2423c81ccd61ac3a17ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:23.549346 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacdbc65-5747-4ec9-bb06-0b74b71ee68d service cinder] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:23.552142 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacdbc65-5747-4ec9-bb06-0b74b71ee68d service cinder] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:23.554034 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacdbc65-5747-4ec9-bb06-0b74b71ee68d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:23.560651 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-cacdbc65-5747-4ec9-bb06-0b74b71ee68d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:23.611718 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:23.635270 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ead5f5d-67a9-4576-89aa-03d68efa893a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:23.638548 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ead5f5d-67a9-4576-89aa-03d68efa893a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:23.639039 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ead5f5d-67a9-4576-89aa-03d68efa893a admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:23.639560 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ead5f5d-67a9-4576-89aa-03d68efa893a admin admin] PATH_INFO: `/v3/users/7ecd6e7a7a5c4d8c9497bf3ef9fc7f06` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:23.643340 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ead5f5d-67a9-4576-89aa-03d68efa893a admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ecd6e7a7a5c4d8c9497bf3ef9fc7f06)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:23.646081 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ead5f5d-67a9-4576-89aa-03d68efa893a admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:23.794349 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacdbc65-5747-4ec9-bb06-0b74b71ee68d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:23.795012 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-5ead5f5d-67a9-4576-89aa-03d68efa893a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ecd6e7a7a5c4d8c9497bf3ef9fc7f06'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:23.796143 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacdbc65-5747-4ec9-bb06-0b74b71ee68d service cinder] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:23.797406 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-5ead5f5d-67a9-4576-89aa-03d68efa893a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ecd6e7a7a5c4d8c9497bf3ef9fc7f06'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:23.810415 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-5ead5f5d-67a9-4576-89aa-03d68efa893a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ecd6e7a7a5c4d8c9497bf3ef9fc7f06'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:23.812865 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-5ead5f5d-67a9-4576-89aa-03d68efa893a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ecd6e7a7a5c4d8c9497bf3ef9fc7f06'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:23.837646 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 896/1784] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:17:23 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 12:17:23.838730 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacdbc65-5747-4ec9-bb06-0b74b71ee68d service cinder] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:23.844315 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-cacdbc65-5747-4ec9-bb06-0b74b71ee68d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:23.864962 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-5ead5f5d-67a9-4576-89aa-03d68efa893a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ecd6e7a7a5c4d8c9497bf3ef9fc7f06'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:23.903396 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacdbc65-5747-4ec9-bb06-0b74b71ee68d service cinder] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:23.909208 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 889/1785] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 5 12:17:23 2022] DELETE /identity/v3/users/7ecd6e7a7a5c4d8c9497bf3ef9fc7f06 => generated 0 bytes in 711 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 12:17:24.078426 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddb3f83-1052-471e-aaad-a1c7b9ba4213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:24.079109 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddb3f83-1052-471e-aaad-a1c7b9ba4213 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:24.079467 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddb3f83-1052-471e-aaad-a1c7b9ba4213 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:24.079918 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddb3f83-1052-471e-aaad-a1c7b9ba4213 admin admin] PATH_INFO: `/v3/users/fadd03599d1440829d62638bd66c4c56` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:24.083334 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddb3f83-1052-471e-aaad-a1c7b9ba4213 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fadd03599d1440829d62638bd66c4c56)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:24.085352 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddb3f83-1052-471e-aaad-a1c7b9ba4213 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:24.254006 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-eddb3f83-1052-471e-aaad-a1c7b9ba4213 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fadd03599d1440829d62638bd66c4c56'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:24.254983 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-eddb3f83-1052-471e-aaad-a1c7b9ba4213 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fadd03599d1440829d62638bd66c4c56'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:24.269289 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-eddb3f83-1052-471e-aaad-a1c7b9ba4213 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fadd03599d1440829d62638bd66c4c56'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:24.270179 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-eddb3f83-1052-471e-aaad-a1c7b9ba4213 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fadd03599d1440829d62638bd66c4c56'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:24.300365 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-eddb3f83-1052-471e-aaad-a1c7b9ba4213 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fadd03599d1440829d62638bd66c4c56'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:24.340778 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 897/1786] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 5 12:17:23 2022] DELETE /identity/v3/users/fadd03599d1440829d62638bd66c4c56 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:17:24.342398 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fa7890-25af-4014-9f35-e2c55d1cdbc2 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:24.345983 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fa7890-25af-4014-9f35-e2c55d1cdbc2 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:24.346327 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fa7890-25af-4014-9f35-e2c55d1cdbc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:24.406522 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-25fa7890-25af-4014-9f35-e2c55d1cdbc2 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:17:24.406919 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddb3f83-1052-471e-aaad-a1c7b9ba4213 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:24.409669 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-eddb3f83-1052-471e-aaad-a1c7b9ba4213 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:24.410307 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-25fa7890-25af-4014-9f35-e2c55d1cdbc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:24.507036 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:24.600312 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 890/1787] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:17:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:17:24.628221 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddb3f83-1052-471e-aaad-a1c7b9ba4213 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:24.672211 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39c43da-e214-4c31-8307-6d0b77885ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:24.672939 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39c43da-e214-4c31-8307-6d0b77885ddd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:24.673212 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39c43da-e214-4c31-8307-6d0b77885ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:24.673488 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39c43da-e214-4c31-8307-6d0b77885ddd admin admin] PATH_INFO: `/v3/projects/6bb4ca25541845d5af589bd0938c412a` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:24.676589 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39c43da-e214-4c31-8307-6d0b77885ddd admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bb4ca25541845d5af589bd0938c412a)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:24.678751 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39c43da-e214-4c31-8307-6d0b77885ddd admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:24.705185 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fa7890-25af-4014-9f35-e2c55d1cdbc2 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:24.708153 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-25fa7890-25af-4014-9f35-e2c55d1cdbc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:24.758252 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:24.797531 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-e39c43da-e214-4c31-8307-6d0b77885ddd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bb4ca25541845d5af589bd0938c412a', 'request_id': 'req-e39c43da-e214-4c31-8307-6d0b77885ddd'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:24.812021 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-e39c43da-e214-4c31-8307-6d0b77885ddd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bb4ca25541845d5af589bd0938c412a', 'request_id': 'req-e39c43da-e214-4c31-8307-6d0b77885ddd'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:24.827582 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-e39c43da-e214-4c31-8307-6d0b77885ddd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bb4ca25541845d5af589bd0938c412a', 'request_id': 'req-e39c43da-e214-4c31-8307-6d0b77885ddd'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:24.859247 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-e39c43da-e214-4c31-8307-6d0b77885ddd admin admin] The token cache is being invalidate because project 6bb4ca25541845d5af589bd0938c412a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:17:24.859649 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-e39c43da-e214-4c31-8307-6d0b77885ddd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:24.871171 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-e39c43da-e214-4c31-8307-6d0b77885ddd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:24.876839 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 898/1788] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 5 12:17:24 2022] DELETE /identity/v3/projects/6bb4ca25541845d5af589bd0938c412a => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:17:24.878312 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dc78a2-cd21-494d-b1ba-ee4b66447f88 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:24.878598 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dc78a2-cd21-494d-b1ba-ee4b66447f88 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:24.878876 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dc78a2-cd21-494d-b1ba-ee4b66447f88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:24.895747 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fa7890-25af-4014-9f35-e2c55d1cdbc2 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:24.924024 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-59dc78a2-cd21-494d-b1ba-ee4b66447f88 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:17:24.925309 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-59dc78a2-cd21-494d-b1ba-ee4b66447f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:25.030951 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a53de9-59ce-4cf4-890b-8c7abb4b7919 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4994b4faa4ec4aa088f3dc32c9c5614d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:25.031584 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a53de9-59ce-4cf4-890b-8c7abb4b7919 service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:25.031863 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a53de9-59ce-4cf4-890b-8c7abb4b7919 service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:25.032139 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a53de9-59ce-4cf4-890b-8c7abb4b7919 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:25.036348 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-77a53de9-59ce-4cf4-890b-8c7abb4b7919 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:25.058543 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 899/1789] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:17:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:17:25.060030 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc0bb8a-2c18-4bab-a72f-e4ae03dc946c None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:25.060318 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc0bb8a-2c18-4bab-a72f-e4ae03dc946c None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:25.060594 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc0bb8a-2c18-4bab-a72f-e4ae03dc946c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:25.117123 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-6cc0bb8a-2c18-4bab-a72f-e4ae03dc946c None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:17:25.129424 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-6cc0bb8a-2c18-4bab-a72f-e4ae03dc946c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:25.149852 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 900/1790] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:17:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:17:25.155176 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc0bb8a-2c18-4bab-a72f-e4ae03dc946c None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:25.173066 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc0bb8a-2c18-4bab-a72f-e4ae03dc946c None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:25.188529 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4127cc7-60aa-4c13-9af9-b786c37ab14a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:25.189415 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4127cc7-60aa-4c13-9af9-b786c37ab14a admin admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:25.189843 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4127cc7-60aa-4c13-9af9-b786c37ab14a admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:25.190207 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4127cc7-60aa-4c13-9af9-b786c37ab14a admin admin] PATH_INFO: `/v3/domains` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:25.191104 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4127cc7-60aa-4c13-9af9-b786c37ab14a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:17:25.191563 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4127cc7-60aa-4c13-9af9-b786c37ab14a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:25.193520 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4127cc7-60aa-4c13-9af9-b786c37ab14a admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:25.218524 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 901/1791] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Sep 5 12:17:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:17:25.223782 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4127cc7-60aa-4c13-9af9-b786c37ab14a admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:25.242154 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4127cc7-60aa-4c13-9af9-b786c37ab14a admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:25.260217 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435f1c03-986f-4357-a9c0-2cfb5f92bd43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:25.260955 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435f1c03-986f-4357-a9c0-2cfb5f92bd43 admin admin] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:25.261324 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435f1c03-986f-4357-a9c0-2cfb5f92bd43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:25.262316 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435f1c03-986f-4357-a9c0-2cfb5f92bd43 admin admin] PATH_INFO: `/v3/projects` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:25.263415 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435f1c03-986f-4357-a9c0-2cfb5f92bd43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:25.265513 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435f1c03-986f-4357-a9c0-2cfb5f92bd43 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:25.273600 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a53de9-59ce-4cf4-890b-8c7abb4b7919 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:25.276708 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a53de9-59ce-4cf4-890b-8c7abb4b7919 service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:25.295689 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 891/1792] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:17:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 591 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 12:17:25.360010 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a53de9-59ce-4cf4-890b-8c7abb4b7919 service neutron] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:25.367174 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 902/1793] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 5 12:17:25 2022] POST /identity/v3/projects => generated 387 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:17:25.373419 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a53de9-59ce-4cf4-890b-8c7abb4b7919 service neutron] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:25.598105 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b002c4-733b-4e02-85d9-09f09126cbd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:25.598990 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b002c4-733b-4e02-85d9-09f09126cbd9 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:25.599368 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b002c4-733b-4e02-85d9-09f09126cbd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:25.599839 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b002c4-733b-4e02-85d9-09f09126cbd9 admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:25.600695 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b002c4-733b-4e02-85d9-09f09126cbd9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:25.602979 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b002c4-733b-4e02-85d9-09f09126cbd9 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:25.632358 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435f1c03-986f-4357-a9c0-2cfb5f92bd43 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:25.634872 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-435f1c03-986f-4357-a9c0-2cfb5f92bd43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:25.670445 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 892/1794] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 5 12:17:25 2022] POST /identity/v3/users => generated 294 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:17:25.678979 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b002c4-733b-4e02-85d9-09f09126cbd9 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:25.679181 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435f1c03-986f-4357-a9c0-2cfb5f92bd43 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:25.690921 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f77e29-b5bd-4f36-82e0-8bd3370b1fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:25.691878 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f77e29-b5bd-4f36-82e0-8bd3370b1fde admin admin] REQUEST_METHOD: `DELETE` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:25.692167 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f77e29-b5bd-4f36-82e0-8bd3370b1fde admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:25.692467 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f77e29-b5bd-4f36-82e0-8bd3370b1fde admin admin] PATH_INFO: `/v3/projects/a2fc35a2a7a0445891dfe9808eb57fbf` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:25.695028 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f77e29-b5bd-4f36-82e0-8bd3370b1fde admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2fc35a2a7a0445891dfe9808eb57fbf)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:25.698707 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f77e29-b5bd-4f36-82e0-8bd3370b1fde admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:25.709252 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b002c4-733b-4e02-85d9-09f09126cbd9 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:25.729430 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f36b4b6-63b4-4726-b7f0-5eec38cc0632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:25.732136 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f36b4b6-63b4-4726-b7f0-5eec38cc0632 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:25.733030 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f36b4b6-63b4-4726-b7f0-5eec38cc0632 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:25.734309 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f36b4b6-63b4-4726-b7f0-5eec38cc0632 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:25.736522 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f36b4b6-63b4-4726-b7f0-5eec38cc0632 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:25.740049 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f36b4b6-63b4-4726-b7f0-5eec38cc0632 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:25.773837 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:25.786835 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 893/1795] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:17:25 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:17:25.791854 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f36b4b6-63b4-4726-b7f0-5eec38cc0632 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:25.813248 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:25.824274 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f36b4b6-63b4-4726-b7f0-5eec38cc0632 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:25.862912 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-f8f77e29-b5bd-4f36-82e0-8bd3370b1fde admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2fc35a2a7a0445891dfe9808eb57fbf', 'request_id': 'req-f8f77e29-b5bd-4f36-82e0-8bd3370b1fde'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:25.880926 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-f8f77e29-b5bd-4f36-82e0-8bd3370b1fde admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2fc35a2a7a0445891dfe9808eb57fbf', 'request_id': 'req-f8f77e29-b5bd-4f36-82e0-8bd3370b1fde'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:25.911690 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-f8f77e29-b5bd-4f36-82e0-8bd3370b1fde admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2fc35a2a7a0445891dfe9808eb57fbf', 'request_id': 'req-f8f77e29-b5bd-4f36-82e0-8bd3370b1fde'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:25.945119 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-f8f77e29-b5bd-4f36-82e0-8bd3370b1fde admin admin] The token cache is being invalidate because project a2fc35a2a7a0445891dfe9808eb57fbf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:17:25.945682 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-f8f77e29-b5bd-4f36-82e0-8bd3370b1fde admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:25.951318 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-f8f77e29-b5bd-4f36-82e0-8bd3370b1fde admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:25.954347 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 903/1796] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 5 12:17:25 2022] DELETE /identity/v3/projects/a2fc35a2a7a0445891dfe9808eb57fbf => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:17:25.965792 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f77e29-b5bd-4f36-82e0-8bd3370b1fde admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:25.971524 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-f8f77e29-b5bd-4f36-82e0-8bd3370b1fde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:26.028417 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a259963-22b2-484d-aa6a-e56d8c8bcecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:26.029081 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a259963-22b2-484d-aa6a-e56d8c8bcecd admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:26.029500 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a259963-22b2-484d-aa6a-e56d8c8bcecd admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:26.029789 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a259963-22b2-484d-aa6a-e56d8c8bcecd admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:26.030769 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a259963-22b2-484d-aa6a-e56d8c8bcecd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:26.034661 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a259963-22b2-484d-aa6a-e56d8c8bcecd admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:26.075828 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 894/1797] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:17:25 2022] GET /identity/v3/roles => generated 1420 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:17:26.082092 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a259963-22b2-484d-aa6a-e56d8c8bcecd admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:26.096936 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-8a259963-22b2-484d-aa6a-e56d8c8bcecd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:26.129510 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a259963-22b2-484d-aa6a-e56d8c8bcecd admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:26.148478 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25c7339-cf55-47a1-886c-2b92f04c9a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:26.154369 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25c7339-cf55-47a1-886c-2b92f04c9a39 admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:26.154743 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25c7339-cf55-47a1-886c-2b92f04c9a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:26.155088 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25c7339-cf55-47a1-886c-2b92f04c9a39 admin admin] PATH_INFO: `/v3/projects/5fc6f9babb914eeb83b825638a66a5e9/users/10457188e01644b48d35eaecff515789/roles/ed72181e1403401facb77dcf33644757` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:26.161016 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f77e29-b5bd-4f36-82e0-8bd3370b1fde admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:26.169530 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6bb6c5-5e5e-4505-846c-654332fd0f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:26.170317 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6bb6c5-5e5e-4505-846c-654332fd0f69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:26.170707 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6bb6c5-5e5e-4505-846c-654332fd0f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:26.171050 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6bb6c5-5e5e-4505-846c-654332fd0f69 admin admin] PATH_INFO: `/v3/users/11859d3236824208bee7127ca157fee2` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:26.172321 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6bb6c5-5e5e-4505-846c-654332fd0f69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11859d3236824208bee7127ca157fee2)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:26.174691 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6bb6c5-5e5e-4505-846c-654332fd0f69 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:26.220401 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25c7339-cf55-47a1-886c-2b92f04c9a39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fc6f9babb914eeb83b825638a66a5e9, user_id=10457188e01644b48d35eaecff515789, role_id=ed72181e1403401facb77dcf33644757)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:26.227612 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25c7339-cf55-47a1-886c-2b92f04c9a39 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:26.275180 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 895/1798] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 5 12:17:26 2022] PUT /identity/v3/projects/5fc6f9babb914eeb83b825638a66a5e9/users/10457188e01644b48d35eaecff515789/roles/ed72181e1403401facb77dcf33644757 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:17:26.276810 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9135b89e-46f3-4052-aa77-f2b7cc0b5943 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:26.277164 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9135b89e-46f3-4052-aa77-f2b7cc0b5943 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:26.279122 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9135b89e-46f3-4052-aa77-f2b7cc0b5943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:26.287401 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-cf6bb6c5-5e5e-4505-846c-654332fd0f69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11859d3236824208bee7127ca157fee2'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:26.288387 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-cf6bb6c5-5e5e-4505-846c-654332fd0f69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11859d3236824208bee7127ca157fee2'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:26.301775 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-cf6bb6c5-5e5e-4505-846c-654332fd0f69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11859d3236824208bee7127ca157fee2'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:26.303017 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-cf6bb6c5-5e5e-4505-846c-654332fd0f69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11859d3236824208bee7127ca157fee2'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:26.332979 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-cf6bb6c5-5e5e-4505-846c-654332fd0f69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11859d3236824208bee7127ca157fee2'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:26.354392 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 904/1799] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 5 12:17:25 2022] DELETE /identity/v3/users/11859d3236824208bee7127ca157fee2 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:17:26.362412 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-9135b89e-46f3-4052-aa77-f2b7cc0b5943 None None] MFA Rules not processed for user `10457188e01644b48d35eaecff515789`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:17:26.363816 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-9135b89e-46f3-4052-aa77-f2b7cc0b5943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:26.495519 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6bb6c5-5e5e-4505-846c-654332fd0f69 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:26.499446 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-cf6bb6c5-5e5e-4505-846c-654332fd0f69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:26.659489 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:26.684472 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 896/1800] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:17:26 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 407 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:17:26.687341 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9135b89e-46f3-4052-aa77-f2b7cc0b5943 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:26.694692 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-9135b89e-46f3-4052-aa77-f2b7cc0b5943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:26.755657 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6bb6c5-5e5e-4505-846c-654332fd0f69 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:26.794014 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866c2594-6d76-4656-b3e5-8c99bef38eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:26.794686 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866c2594-6d76-4656-b3e5-8c99bef38eb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:26.794965 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866c2594-6d76-4656-b3e5-8c99bef38eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:26.795233 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866c2594-6d76-4656-b3e5-8c99bef38eb6 admin admin] PATH_INFO: `/v3/projects/4cc691ee746a4913802bd95421fdd2a7` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:26.796389 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866c2594-6d76-4656-b3e5-8c99bef38eb6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4cc691ee746a4913802bd95421fdd2a7)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:26.798400 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866c2594-6d76-4656-b3e5-8c99bef38eb6 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:26.848086 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9135b89e-46f3-4052-aa77-f2b7cc0b5943 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:26.866098 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-866c2594-6d76-4656-b3e5-8c99bef38eb6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4cc691ee746a4913802bd95421fdd2a7', 'request_id': 'req-866c2594-6d76-4656-b3e5-8c99bef38eb6'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:26.875951 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:26.878434 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-866c2594-6d76-4656-b3e5-8c99bef38eb6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4cc691ee746a4913802bd95421fdd2a7', 'request_id': 'req-866c2594-6d76-4656-b3e5-8c99bef38eb6'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:26.889925 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-866c2594-6d76-4656-b3e5-8c99bef38eb6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4cc691ee746a4913802bd95421fdd2a7', 'request_id': 'req-866c2594-6d76-4656-b3e5-8c99bef38eb6'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:26.908388 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-866c2594-6d76-4656-b3e5-8c99bef38eb6 admin admin] The token cache is being invalidate because project 4cc691ee746a4913802bd95421fdd2a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:17:26.908587 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-866c2594-6d76-4656-b3e5-8c99bef38eb6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:26.909299 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-866c2594-6d76-4656-b3e5-8c99bef38eb6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:26.914507 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 905/1801] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 5 12:17:26 2022] DELETE /identity/v3/projects/4cc691ee746a4913802bd95421fdd2a7 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:17:26.914507 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866c2594-6d76-4656-b3e5-8c99bef38eb6 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:26.916774 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-866c2594-6d76-4656-b3e5-8c99bef38eb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:27.015930 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036f1e26-7925-4c69-b04a-ead44fa96bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:27.016565 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036f1e26-7925-4c69-b04a-ead44fa96bd9 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:27.017558 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036f1e26-7925-4c69-b04a-ead44fa96bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:27.017837 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036f1e26-7925-4c69-b04a-ead44fa96bd9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:27.018784 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036f1e26-7925-4c69-b04a-ead44fa96bd9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:27.025097 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036f1e26-7925-4c69-b04a-ead44fa96bd9 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:27.092183 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 897/1802] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 5 12:17:26 2022] POST /identity/v3/projects => generated 385 bytes in 405 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:17:27.093570 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff243aaf-f1f7-4d7d-9872-53bcd610a5b3 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:27.093862 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff243aaf-f1f7-4d7d-9872-53bcd610a5b3 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:27.094138 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff243aaf-f1f7-4d7d-9872-53bcd610a5b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:27.119664 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866c2594-6d76-4656-b3e5-8c99bef38eb6 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:27.128538 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-ff243aaf-f1f7-4d7d-9872-53bcd610a5b3 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:17:27.130859 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-ff243aaf-f1f7-4d7d-9872-53bcd610a5b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:27.294384 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718cdede-e565-4de0-865c-609712339b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:27.300582 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718cdede-e565-4de0-865c-609712339b17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:27.301742 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 898/1803] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:17:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:17:27.302471 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718cdede-e565-4de0-865c-609712339b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:27.304090 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718cdede-e565-4de0-865c-609712339b17 admin admin] PATH_INFO: `/v3/projects/3b2a8eee0c7b4f6fbb9bac836ba309d6` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:27.304924 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff243aaf-f1f7-4d7d-9872-53bcd610a5b3 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:27.307447 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-ff243aaf-f1f7-4d7d-9872-53bcd610a5b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:27.320057 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718cdede-e565-4de0-865c-609712339b17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b2a8eee0c7b4f6fbb9bac836ba309d6)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:27.338113 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff243aaf-f1f7-4d7d-9872-53bcd610a5b3 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:27.347891 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60412118-4d13-4fd1-9cb3-4e0d8f4e3882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:27.349356 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60412118-4d13-4fd1-9cb3-4e0d8f4e3882 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:27.349491 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718cdede-e565-4de0-865c-609712339b17 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:27.350040 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60412118-4d13-4fd1-9cb3-4e0d8f4e3882 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:27.350559 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60412118-4d13-4fd1-9cb3-4e0d8f4e3882 admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:27.352970 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60412118-4d13-4fd1-9cb3-4e0d8f4e3882 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:27.356103 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:27.357488 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60412118-4d13-4fd1-9cb3-4e0d8f4e3882 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:27.426690 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 899/1804] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 5 12:17:27 2022] POST /identity/v3/users => generated 299 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:17:27.431754 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462c9c78-fa5b-4cba-8150-c3c2429c0aa9 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:27.432722 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462c9c78-fa5b-4cba-8150-c3c2429c0aa9 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:27.435105 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462c9c78-fa5b-4cba-8150-c3c2429c0aa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:27.448324 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-718cdede-e565-4de0-865c-609712339b17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b2a8eee0c7b4f6fbb9bac836ba309d6', 'request_id': 'req-718cdede-e565-4de0-865c-609712339b17'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:27.467160 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-718cdede-e565-4de0-865c-609712339b17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b2a8eee0c7b4f6fbb9bac836ba309d6', 'request_id': 'req-718cdede-e565-4de0-865c-609712339b17'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:27.483556 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-718cdede-e565-4de0-865c-609712339b17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b2a8eee0c7b4f6fbb9bac836ba309d6', 'request_id': 'req-718cdede-e565-4de0-865c-609712339b17'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:27.498777 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-462c9c78-fa5b-4cba-8150-c3c2429c0aa9 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:17:27.504826 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-462c9c78-fa5b-4cba-8150-c3c2429c0aa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:27.518541 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-718cdede-e565-4de0-865c-609712339b17 admin admin] The token cache is being invalidate because project 3b2a8eee0c7b4f6fbb9bac836ba309d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:17:27.519851 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-718cdede-e565-4de0-865c-609712339b17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:27.521873 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-718cdede-e565-4de0-865c-609712339b17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:27.527953 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 906/1805] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 5 12:17:26 2022] DELETE /identity/v3/projects/3b2a8eee0c7b4f6fbb9bac836ba309d6 => generated 0 bytes in 612 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:17:27.529915 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718cdede-e565-4de0-865c-609712339b17 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:27.533239 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-718cdede-e565-4de0-865c-609712339b17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:27.759653 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 900/1806] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:17:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:17:27.759653 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462c9c78-fa5b-4cba-8150-c3c2429c0aa9 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:27.761828 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-462c9c78-fa5b-4cba-8150-c3c2429c0aa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:27.775245 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718cdede-e565-4de0-865c-609712339b17 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:27.782009 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17026ef-c107-4d44-9015-e07b7dbf9488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:27.782787 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17026ef-c107-4d44-9015-e07b7dbf9488 admin admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:27.783072 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17026ef-c107-4d44-9015-e07b7dbf9488 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:27.783345 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17026ef-c107-4d44-9015-e07b7dbf9488 admin admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:27.784000 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17026ef-c107-4d44-9015-e07b7dbf9488 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:27.785732 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17026ef-c107-4d44-9015-e07b7dbf9488 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:27.795791 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462c9c78-fa5b-4cba-8150-c3c2429c0aa9 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:27.804779 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 907/1807] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:17:27 2022] GET /identity/v3/roles => generated 1420 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:17:27.805931 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17026ef-c107-4d44-9015-e07b7dbf9488 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:27.825428 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17026ef-c107-4d44-9015-e07b7dbf9488 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:27.833296 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810880c1-7073-4178-a8c6-09081084dc55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:27.833960 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810880c1-7073-4178-a8c6-09081084dc55 admin admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:27.834310 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810880c1-7073-4178-a8c6-09081084dc55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:27.834577 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810880c1-7073-4178-a8c6-09081084dc55 admin admin] PATH_INFO: `/v3/domains` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:27.835240 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810880c1-7073-4178-a8c6-09081084dc55 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:17:27.835604 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810880c1-7073-4178-a8c6-09081084dc55 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:27.837640 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d32d89b-b347-43b2-b781-ad6e139d5bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:27.842094 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810880c1-7073-4178-a8c6-09081084dc55 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:27.844509 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d32d89b-b347-43b2-b781-ad6e139d5bc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:27.845942 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d32d89b-b347-43b2-b781-ad6e139d5bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:27.846733 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d32d89b-b347-43b2-b781-ad6e139d5bc0 admin admin] PATH_INFO: `/v3/users/8da643c162f5405da5e9640761498e2e` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:27.849789 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d32d89b-b347-43b2-b781-ad6e139d5bc0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8da643c162f5405da5e9640761498e2e)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:27.853405 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d32d89b-b347-43b2-b781-ad6e139d5bc0 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:27.882949 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 908/1808] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Sep 5 12:17:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:17:27.886906 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810880c1-7073-4178-a8c6-09081084dc55 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:27.889243 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:27.913656 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810880c1-7073-4178-a8c6-09081084dc55 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:27.930280 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e9bbb2-46ea-437b-b50b-aa6b4bbf05ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:27.930280 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e9bbb2-46ea-437b-b50b-aa6b4bbf05ec admin admin] REQUEST_METHOD: `PUT` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:27.930280 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e9bbb2-46ea-437b-b50b-aa6b4bbf05ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:27.930593 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e9bbb2-46ea-437b-b50b-aa6b4bbf05ec admin admin] PATH_INFO: `/v3/projects/6bf3130d2db74c6caa0972fdde4b17e5/users/4348eaa21c3849b29815685840b16910/roles/16e2ccc8bd1b497d8cee780c1c7df0d2` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:27.972633 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e9bbb2-46ea-437b-b50b-aa6b4bbf05ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bf3130d2db74c6caa0972fdde4b17e5, user_id=4348eaa21c3849b29815685840b16910, role_id=16e2ccc8bd1b497d8cee780c1c7df0d2)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:27.975477 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e9bbb2-46ea-437b-b50b-aa6b4bbf05ec admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:28.005736 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-9d32d89b-b347-43b2-b781-ad6e139d5bc0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8da643c162f5405da5e9640761498e2e'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:28.007579 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 909/1809] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 5 12:17:27 2022] PUT /identity/v3/projects/6bf3130d2db74c6caa0972fdde4b17e5/users/4348eaa21c3849b29815685840b16910/roles/16e2ccc8bd1b497d8cee780c1c7df0d2 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:17:28.009110 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e9bbb2-46ea-437b-b50b-aa6b4bbf05ec admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:28.009627 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-9d32d89b-b347-43b2-b781-ad6e139d5bc0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8da643c162f5405da5e9640761498e2e'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:28.010960 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-42e9bbb2-46ea-437b-b50b-aa6b4bbf05ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:28.030738 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-9d32d89b-b347-43b2-b781-ad6e139d5bc0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8da643c162f5405da5e9640761498e2e'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:28.032170 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-9d32d89b-b347-43b2-b781-ad6e139d5bc0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8da643c162f5405da5e9640761498e2e'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:28.072847 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-9d32d89b-b347-43b2-b781-ad6e139d5bc0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8da643c162f5405da5e9640761498e2e'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:28.120083 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 901/1810] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 5 12:17:27 2022] DELETE /identity/v3/users/8da643c162f5405da5e9640761498e2e => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:17:28.125828 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d32d89b-b347-43b2-b781-ad6e139d5bc0 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:28.129340 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-9d32d89b-b347-43b2-b781-ad6e139d5bc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:28.165321 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:28.196135 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e9bbb2-46ea-437b-b50b-aa6b4bbf05ec admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:28.355956 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d32d89b-b347-43b2-b781-ad6e139d5bc0 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:28.375933 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1e83e5-6315-4f96-895e-ca4b9e0bcc99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:28.377811 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1e83e5-6315-4f96-895e-ca4b9e0bcc99 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:28.378677 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1e83e5-6315-4f96-895e-ca4b9e0bcc99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:28.379822 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1e83e5-6315-4f96-895e-ca4b9e0bcc99 admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:28.381832 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1e83e5-6315-4f96-895e-ca4b9e0bcc99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:28.388287 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1e83e5-6315-4f96-895e-ca4b9e0bcc99 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:28.393742 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74801db5-d8e2-4ebf-9283-1cf5625b64a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:28.395023 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74801db5-d8e2-4ebf-9283-1cf5625b64a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:28.395489 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74801db5-d8e2-4ebf-9283-1cf5625b64a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:28.396032 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74801db5-d8e2-4ebf-9283-1cf5625b64a4 admin admin] PATH_INFO: `/v3/users/e144609094ae4e1085e19415319f6ff9` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:28.397510 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74801db5-d8e2-4ebf-9283-1cf5625b64a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e144609094ae4e1085e19415319f6ff9)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:28.400861 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74801db5-d8e2-4ebf-9283-1cf5625b64a4 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:28.497462 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 902/1811] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 5 12:17:28 2022] POST /identity/v3/projects => generated 399 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:17:28.512320 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3a85b4-e839-4e6e-bfba-79197d38a603 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:28.512608 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3a85b4-e839-4e6e-bfba-79197d38a603 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:28.512881 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3a85b4-e839-4e6e-bfba-79197d38a603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:28.517200 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-74801db5-d8e2-4ebf-9283-1cf5625b64a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e144609094ae4e1085e19415319f6ff9'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:28.519034 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-74801db5-d8e2-4ebf-9283-1cf5625b64a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e144609094ae4e1085e19415319f6ff9'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:28.536934 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-74801db5-d8e2-4ebf-9283-1cf5625b64a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e144609094ae4e1085e19415319f6ff9'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:28.542526 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-74801db5-d8e2-4ebf-9283-1cf5625b64a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e144609094ae4e1085e19415319f6ff9'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:28.564662 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-0e3a85b4-e839-4e6e-bfba-79197d38a603 None None] MFA Rules not processed for user `4994b4faa4ec4aa088f3dc32c9c5614d`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:17:28.568185 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-0e3a85b4-e839-4e6e-bfba-79197d38a603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:28.574111 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-74801db5-d8e2-4ebf-9283-1cf5625b64a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e144609094ae4e1085e19415319f6ff9'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:28.613688 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 910/1812] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 5 12:17:28 2022] DELETE /identity/v3/users/e144609094ae4e1085e19415319f6ff9 => generated 0 bytes in 605 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:17:28.615467 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74801db5-d8e2-4ebf-9283-1cf5625b64a4 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:28.619122 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-74801db5-d8e2-4ebf-9283-1cf5625b64a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:28.658541 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 903/1813] 10.222.0.26 () {58 vars in 1015 bytes} [Mon Sep 5 12:17:28 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:17:28.660027 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3a85b4-e839-4e6e-bfba-79197d38a603 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:28.661669 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-0e3a85b4-e839-4e6e-bfba-79197d38a603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:28.752790 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:28.807792 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74801db5-d8e2-4ebf-9283-1cf5625b64a4 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:28.819476 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b55dca-3b5d-49fc-a181-334a154d8881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:28.820118 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b55dca-3b5d-49fc-a181-334a154d8881 admin admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:28.820398 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b55dca-3b5d-49fc-a181-334a154d8881 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:28.820674 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b55dca-3b5d-49fc-a181-334a154d8881 admin admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:28.829864 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b55dca-3b5d-49fc-a181-334a154d8881 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:28.832413 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b55dca-3b5d-49fc-a181-334a154d8881 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:28.872886 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 911/1814] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:17:28 2022] GET /identity/v3/roles => generated 1420 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:17:28.874292 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8e19b6-1d5b-455c-bc5d-fb0a62c85852 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:28.874624 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8e19b6-1d5b-455c-bc5d-fb0a62c85852 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:28.874845 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8e19b6-1d5b-455c-bc5d-fb0a62c85852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:28.883394 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3a85b4-e839-4e6e-bfba-79197d38a603 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:28.898812 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d572a9a-9c67-44da-9298-3b24baf2971f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:28.900704 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d572a9a-9c67-44da-9298-3b24baf2971f admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:28.901399 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d572a9a-9c67-44da-9298-3b24baf2971f admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:28.902894 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d572a9a-9c67-44da-9298-3b24baf2971f admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:28.903839 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d572a9a-9c67-44da-9298-3b24baf2971f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:28.906274 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-fd8e19b6-1d5b-455c-bc5d-fb0a62c85852 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:17:28.906834 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d572a9a-9c67-44da-9298-3b24baf2971f admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:28.907632 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-fd8e19b6-1d5b-455c-bc5d-fb0a62c85852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:28.917771 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 912/1815] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:17:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:17:28.918732 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8e19b6-1d5b-455c-bc5d-fb0a62c85852 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:28.927444 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-fd8e19b6-1d5b-455c-bc5d-fb0a62c85852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:28.944956 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:28.982480 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 904/1816] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 5 12:17:28 2022] POST /identity/v3/users => generated 300 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:17:28.983781 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d572a9a-9c67-44da-9298-3b24baf2971f admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:28.985702 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-8d572a9a-9c67-44da-9298-3b24baf2971f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:29.019376 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8e19b6-1d5b-455c-bc5d-fb0a62c85852 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:29.024073 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2d9b1b-099a-42fd-925c-dfc9b265eb12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4994b4faa4ec4aa088f3dc32c9c5614d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:29.024778 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2d9b1b-099a-42fd-925c-dfc9b265eb12 service neutron] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:29.025165 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2d9b1b-099a-42fd-925c-dfc9b265eb12 service neutron] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:29.025445 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2d9b1b-099a-42fd-925c-dfc9b265eb12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:29.045393 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2d9b1b-099a-42fd-925c-dfc9b265eb12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:29.050947 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2d9b1b-099a-42fd-925c-dfc9b265eb12 service neutron] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:29.062435 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 913/1817] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:17:28 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:17:29.063742 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2d9b1b-099a-42fd-925c-dfc9b265eb12 service neutron] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:29.065579 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-4c2d9b1b-099a-42fd-925c-dfc9b265eb12 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:29.084588 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2d9b1b-099a-42fd-925c-dfc9b265eb12 service neutron] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:29.095936 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36193646-cfe4-4d88-ac16-b3819b932abc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4994b4faa4ec4aa088f3dc32c9c5614d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:29.095936 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36193646-cfe4-4d88-ac16-b3819b932abc service neutron] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:29.095936 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36193646-cfe4-4d88-ac16-b3819b932abc service neutron] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:29.096284 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36193646-cfe4-4d88-ac16-b3819b932abc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:29.112365 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36193646-cfe4-4d88-ac16-b3819b932abc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:29.115868 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36193646-cfe4-4d88-ac16-b3819b932abc service neutron] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:29.138276 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d572a9a-9c67-44da-9298-3b24baf2971f admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:29.144364 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 914/1818] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:17:29 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:17:29.145229 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36193646-cfe4-4d88-ac16-b3819b932abc service neutron] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:29.148744 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b63c55-03b8-4536-b74c-f7d95027b03c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4994b4faa4ec4aa088f3dc32c9c5614d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:29.149520 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b63c55-03b8-4536-b74c-f7d95027b03c service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:29.149863 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b63c55-03b8-4536-b74c-f7d95027b03c service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:29.150328 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b63c55-03b8-4536-b74c-f7d95027b03c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:29.164620 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b63c55-03b8-4536-b74c-f7d95027b03c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:29.165811 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b63c55-03b8-4536-b74c-f7d95027b03c service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:29.176221 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36193646-cfe4-4d88-ac16-b3819b932abc service neutron] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:29.188086 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 905/1819] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:17:28 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:17:29.188808 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b63c55-03b8-4536-b74c-f7d95027b03c service neutron] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:29.201357 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7493eec3-3473-4db7-a8bf-3d809d8223bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:29.202235 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7493eec3-3473-4db7-a8bf-3d809d8223bf admin admin] REQUEST_METHOD: `PUT` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:29.202681 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7493eec3-3473-4db7-a8bf-3d809d8223bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:29.203119 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7493eec3-3473-4db7-a8bf-3d809d8223bf admin admin] PATH_INFO: `/v3/projects/6bf3130d2db74c6caa0972fdde4b17e5/users/4348eaa21c3849b29815685840b16910/roles/16e2ccc8bd1b497d8cee780c1c7df0d2` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:29.207447 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7493eec3-3473-4db7-a8bf-3d809d8223bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bf3130d2db74c6caa0972fdde4b17e5, user_id=4348eaa21c3849b29815685840b16910, role_id=16e2ccc8bd1b497d8cee780c1c7df0d2)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:29.216115 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7493eec3-3473-4db7-a8bf-3d809d8223bf admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:29.217738 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b63c55-03b8-4536-b74c-f7d95027b03c service neutron] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:29.226965 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b73cff-8f47-4241-be34-331f4ae60fbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4994b4faa4ec4aa088f3dc32c9c5614d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:29.227609 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b73cff-8f47-4241-be34-331f4ae60fbb service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:29.227904 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b73cff-8f47-4241-be34-331f4ae60fbb service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:29.228241 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b73cff-8f47-4241-be34-331f4ae60fbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:29.260040 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b73cff-8f47-4241-be34-331f4ae60fbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:29.261286 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b73cff-8f47-4241-be34-331f4ae60fbb service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:29.270137 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 915/1820] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 5 12:17:29 2022] PUT /identity/v3/projects/6bf3130d2db74c6caa0972fdde4b17e5/users/4348eaa21c3849b29815685840b16910/roles/16e2ccc8bd1b497d8cee780c1c7df0d2 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:17:29.275599 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7493eec3-3473-4db7-a8bf-3d809d8223bf admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:29.297742 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 906/1821] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:17:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:17:29.298890 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b73cff-8f47-4241-be34-331f4ae60fbb service neutron] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:29.319929 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b73cff-8f47-4241-be34-331f4ae60fbb service neutron] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:29.426475 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7493eec3-3473-4db7-a8bf-3d809d8223bf admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:29.434618 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1830c95d-5153-4302-9b01-e8408e408777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:29.435575 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1830c95d-5153-4302-9b01-e8408e408777 admin admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:29.436004 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1830c95d-5153-4302-9b01-e8408e408777 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:29.436475 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1830c95d-5153-4302-9b01-e8408e408777 admin admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:29.437465 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1830c95d-5153-4302-9b01-e8408e408777 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:29.441005 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1830c95d-5153-4302-9b01-e8408e408777 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:29.450096 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045fedad-19d5-4311-87e2-f8e3803af5c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4994b4faa4ec4aa088f3dc32c9c5614d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:29.450727 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045fedad-19d5-4311-87e2-f8e3803af5c8 service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:29.451009 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045fedad-19d5-4311-87e2-f8e3803af5c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:29.451284 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045fedad-19d5-4311-87e2-f8e3803af5c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:29.462047 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 916/1822] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:17:29 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:17:29.463677 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1830c95d-5153-4302-9b01-e8408e408777 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:29.469999 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045fedad-19d5-4311-87e2-f8e3803af5c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:29.470965 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-1830c95d-5153-4302-9b01-e8408e408777 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:29.471652 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045fedad-19d5-4311-87e2-f8e3803af5c8 service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:29.493667 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 907/1823] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:17:29 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:17:29.495179 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936c3867-1a6e-4e99-a04a-88b7b8a9a553 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:29.495495 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936c3867-1a6e-4e99-a04a-88b7b8a9a553 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:29.497049 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936c3867-1a6e-4e99-a04a-88b7b8a9a553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:29.531329 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1830c95d-5153-4302-9b01-e8408e408777 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:29.555067 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab77b79-56b7-493d-87d9-fbb7b106d60f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:29.559795 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab77b79-56b7-493d-87d9-fbb7b106d60f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:29.560287 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab77b79-56b7-493d-87d9-fbb7b106d60f admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:29.560448 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab77b79-56b7-493d-87d9-fbb7b106d60f admin admin] PATH_INFO: `/v3/projects/7a5b49631e964e17b75dc043fbc69148` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:29.569429 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab77b79-56b7-493d-87d9-fbb7b106d60f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a5b49631e964e17b75dc043fbc69148)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:29.575137 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-936c3867-1a6e-4e99-a04a-88b7b8a9a553 None None] MFA Rules not processed for user `4348eaa21c3849b29815685840b16910`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:17:29.576094 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab77b79-56b7-493d-87d9-fbb7b106d60f admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:29.576445 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-936c3867-1a6e-4e99-a04a-88b7b8a9a553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:29.665756 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-9ab77b79-56b7-493d-87d9-fbb7b106d60f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a5b49631e964e17b75dc043fbc69148', 'request_id': 'req-9ab77b79-56b7-493d-87d9-fbb7b106d60f'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:29.670899 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:29.686034 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-9ab77b79-56b7-493d-87d9-fbb7b106d60f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a5b49631e964e17b75dc043fbc69148', 'request_id': 'req-9ab77b79-56b7-493d-87d9-fbb7b106d60f'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:29.696081 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-9ab77b79-56b7-493d-87d9-fbb7b106d60f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a5b49631e964e17b75dc043fbc69148', 'request_id': 'req-9ab77b79-56b7-493d-87d9-fbb7b106d60f'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:29.716117 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-9ab77b79-56b7-493d-87d9-fbb7b106d60f admin admin] The token cache is being invalidate because project 7a5b49631e964e17b75dc043fbc69148 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:17:29.716423 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-9ab77b79-56b7-493d-87d9-fbb7b106d60f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:29.717494 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-9ab77b79-56b7-493d-87d9-fbb7b106d60f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:29.722979 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 917/1824] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 5 12:17:29 2022] DELETE /identity/v3/projects/7a5b49631e964e17b75dc043fbc69148 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:17:29.722979 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab77b79-56b7-493d-87d9-fbb7b106d60f admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:29.723238 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-9ab77b79-56b7-493d-87d9-fbb7b106d60f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:29.731162 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:29.766512 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 908/1825] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:17:29 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:17:29.767851 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936c3867-1a6e-4e99-a04a-88b7b8a9a553 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:29.790112 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-936c3867-1a6e-4e99-a04a-88b7b8a9a553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:29.818024 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936c3867-1a6e-4e99-a04a-88b7b8a9a553 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:29.845054 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab77b79-56b7-493d-87d9-fbb7b106d60f admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:29.852246 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7194b699-0d23-4cfc-bb29-8b3453a26f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:29.852929 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7194b699-0d23-4cfc-bb29-8b3453a26f8a admin admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:29.853239 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7194b699-0d23-4cfc-bb29-8b3453a26f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:29.853514 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7194b699-0d23-4cfc-bb29-8b3453a26f8a admin admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:29.854183 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7194b699-0d23-4cfc-bb29-8b3453a26f8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:29.856418 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7194b699-0d23-4cfc-bb29-8b3453a26f8a admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:29.881441 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 918/1826] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:17:29 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:17:29.883160 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f68ca0a-25b0-4447-a5e3-14b6e283e966 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:29.883527 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f68ca0a-25b0-4447-a5e3-14b6e283e966 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:29.883808 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f68ca0a-25b0-4447-a5e3-14b6e283e966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:29.915374 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-3f68ca0a-25b0-4447-a5e3-14b6e283e966 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:17:29.916716 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-3f68ca0a-25b0-4447-a5e3-14b6e283e966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:29.938562 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 919/1827] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:17:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:17:29.938562 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f68ca0a-25b0-4447-a5e3-14b6e283e966 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:29.938562 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-3f68ca0a-25b0-4447-a5e3-14b6e283e966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:29.955513 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb7ed8a-cfab-4e09-a882-206f613dd01c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:29.957043 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb7ed8a-cfab-4e09-a882-206f613dd01c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:29.957479 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb7ed8a-cfab-4e09-a882-206f613dd01c admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:29.957917 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb7ed8a-cfab-4e09-a882-206f613dd01c admin admin] PATH_INFO: `/v3/projects/59048c11d39a469eb281a965fd79e506` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:29.959332 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb7ed8a-cfab-4e09-a882-206f613dd01c admin admin] RBAC: Authorizing `identity:delete_project(project_id=59048c11d39a469eb281a965fd79e506)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:29.962710 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb7ed8a-cfab-4e09-a882-206f613dd01c admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:30.063573 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f68ca0a-25b0-4447-a5e3-14b6e283e966 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:30.092379 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-0cb7ed8a-cfab-4e09-a882-206f613dd01c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59048c11d39a469eb281a965fd79e506', 'request_id': 'req-0cb7ed8a-cfab-4e09-a882-206f613dd01c'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:30.102582 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-0cb7ed8a-cfab-4e09-a882-206f613dd01c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59048c11d39a469eb281a965fd79e506', 'request_id': 'req-0cb7ed8a-cfab-4e09-a882-206f613dd01c'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:30.112092 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-0cb7ed8a-cfab-4e09-a882-206f613dd01c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59048c11d39a469eb281a965fd79e506', 'request_id': 'req-0cb7ed8a-cfab-4e09-a882-206f613dd01c'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:30.147602 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-0cb7ed8a-cfab-4e09-a882-206f613dd01c admin admin] The token cache is being invalidate because project 59048c11d39a469eb281a965fd79e506 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:17:30.147979 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-0cb7ed8a-cfab-4e09-a882-206f613dd01c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:30.148716 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-0cb7ed8a-cfab-4e09-a882-206f613dd01c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:30.152606 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 909/1828] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 5 12:17:29 2022] DELETE /identity/v3/projects/59048c11d39a469eb281a965fd79e506 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:17:30.156050 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb7ed8a-cfab-4e09-a882-206f613dd01c admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:30.157728 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-0cb7ed8a-cfab-4e09-a882-206f613dd01c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:30.169665 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a3dfee-a508-4795-b153-7e3d529b14b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37633bbae0c2423c81ccd61ac3a17ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:30.170855 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a3dfee-a508-4795-b153-7e3d529b14b9 service cinder] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:30.171241 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a3dfee-a508-4795-b153-7e3d529b14b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:30.171615 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a3dfee-a508-4795-b153-7e3d529b14b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:30.176501 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-00a3dfee-a508-4795-b153-7e3d529b14b9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:30.374155 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a3dfee-a508-4795-b153-7e3d529b14b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:30.376945 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a3dfee-a508-4795-b153-7e3d529b14b9 service cinder] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:30.380248 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb7ed8a-cfab-4e09-a882-206f613dd01c admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:30.383180 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:30.391683 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a02bb31-30e2-4b6f-846e-d41923edd71f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:30.393071 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a02bb31-30e2-4b6f-846e-d41923edd71f admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:30.393521 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a02bb31-30e2-4b6f-846e-d41923edd71f admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:30.393933 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a02bb31-30e2-4b6f-846e-d41923edd71f admin admin] PATH_INFO: `/v3/projects/d410ae718ff44838833d66347af8ef05/users/bc9d07543bd244aab7995cd4a4110775/roles/ed72181e1403401facb77dcf33644757` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:30.406638 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 920/1829] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:17:29 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:17:30.409634 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa302f89-4fcb-4d93-bbed-ef4f7df4f72f None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:30.410551 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa302f89-4fcb-4d93-bbed-ef4f7df4f72f None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:30.410946 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa302f89-4fcb-4d93-bbed-ef4f7df4f72f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:30.429391 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:30.444596 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a02bb31-30e2-4b6f-846e-d41923edd71f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d410ae718ff44838833d66347af8ef05, user_id=bc9d07543bd244aab7995cd4a4110775, role_id=ed72181e1403401facb77dcf33644757)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:30.447716 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a02bb31-30e2-4b6f-846e-d41923edd71f admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:30.483155 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 910/1830] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 5 12:17:30 2022] PUT /identity/v3/projects/d410ae718ff44838833d66347af8ef05/users/bc9d07543bd244aab7995cd4a4110775/roles/ed72181e1403401facb77dcf33644757 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:17:30.484705 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c49d85f-5bf2-4568-b9b3-58046e42df76 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:30.485256 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c49d85f-5bf2-4568-b9b3-58046e42df76 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:30.485716 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c49d85f-5bf2-4568-b9b3-58046e42df76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:30.521895 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-fa302f89-4fcb-4d93-bbed-ef4f7df4f72f None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:17:30.526522 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-fa302f89-4fcb-4d93-bbed-ef4f7df4f72f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:30.537795 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-4c49d85f-5bf2-4568-b9b3-58046e42df76 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:17:30.539474 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-4c49d85f-5bf2-4568-b9b3-58046e42df76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:30.709732 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 911/1831] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:17:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:17:30.709732 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d265ab82-df6f-4a99-858b-45c46f99e038 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:30.709732 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d265ab82-df6f-4a99-858b-45c46f99e038 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:30.709732 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d265ab82-df6f-4a99-858b-45c46f99e038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:30.724482 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 921/1832] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:17:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:17:30.727130 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa302f89-4fcb-4d93-bbed-ef4f7df4f72f None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:30.732336 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-fa302f89-4fcb-4d93-bbed-ef4f7df4f72f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:30.772152 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa302f89-4fcb-4d93-bbed-ef4f7df4f72f None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:30.787177 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-d265ab82-df6f-4a99-858b-45c46f99e038 None None] MFA Rules not processed for user `bc9d07543bd244aab7995cd4a4110775`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:17:30.788654 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-d265ab82-df6f-4a99-858b-45c46f99e038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:30.791105 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8149ddb9-4ad3-465a-b881-7896c50dc492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:30.795662 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8149ddb9-4ad3-465a-b881-7896c50dc492 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:30.796191 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8149ddb9-4ad3-465a-b881-7896c50dc492 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:30.796677 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8149ddb9-4ad3-465a-b881-7896c50dc492 admin admin] PATH_INFO: `/v3/users/10457188e01644b48d35eaecff515789` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:30.801443 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8149ddb9-4ad3-465a-b881-7896c50dc492 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10457188e01644b48d35eaecff515789)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:30.812789 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8149ddb9-4ad3-465a-b881-7896c50dc492 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:30.947872 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 912/1833] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:17:30 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:17:30.950048 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e8328a-398d-4fac-81af-ffdaa824b25a None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:30.950430 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e8328a-398d-4fac-81af-ffdaa824b25a None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:30.950801 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e8328a-398d-4fac-81af-ffdaa824b25a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:30.961003 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-8149ddb9-4ad3-465a-b881-7896c50dc492 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10457188e01644b48d35eaecff515789'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:30.964213 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-8149ddb9-4ad3-465a-b881-7896c50dc492 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10457188e01644b48d35eaecff515789'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:30.984470 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-8149ddb9-4ad3-465a-b881-7896c50dc492 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10457188e01644b48d35eaecff515789'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:30.985625 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-8149ddb9-4ad3-465a-b881-7896c50dc492 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10457188e01644b48d35eaecff515789'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:30.994052 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-46e8328a-398d-4fac-81af-ffdaa824b25a None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:17:30.995553 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-46e8328a-398d-4fac-81af-ffdaa824b25a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:31.017972 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-8149ddb9-4ad3-465a-b881-7896c50dc492 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10457188e01644b48d35eaecff515789'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:31.023421 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 913/1834] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:17:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:17:31.024482 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e8328a-398d-4fac-81af-ffdaa824b25a None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:31.026265 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-46e8328a-398d-4fac-81af-ffdaa824b25a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:31.050412 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e8328a-398d-4fac-81af-ffdaa824b25a None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:31.060669 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 922/1835] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 5 12:17:30 2022] DELETE /identity/v3/users/10457188e01644b48d35eaecff515789 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:17:31.062784 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8149ddb9-4ad3-465a-b881-7896c50dc492 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:31.064404 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be07f04-98bc-448a-aca4-2d0d274349d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:31.065202 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be07f04-98bc-448a-aca4-2d0d274349d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:31.065611 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be07f04-98bc-448a-aca4-2d0d274349d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:31.066141 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be07f04-98bc-448a-aca4-2d0d274349d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:31.067045 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be07f04-98bc-448a-aca4-2d0d274349d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:17:31.067450 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be07f04-98bc-448a-aca4-2d0d274349d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:31.068022 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-8149ddb9-4ad3-465a-b881-7896c50dc492 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:31.069328 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be07f04-98bc-448a-aca4-2d0d274349d5 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:31.097232 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 914/1836] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Sep 5 12:17:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:17:31.101535 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be07f04-98bc-448a-aca4-2d0d274349d5 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:31.123485 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be07f04-98bc-448a-aca4-2d0d274349d5 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:31.249058 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:31.256129 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8149ddb9-4ad3-465a-b881-7896c50dc492 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:31.258339 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac56e06-45a9-401e-861a-7cf3453aff3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:31.259335 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac56e06-45a9-401e-861a-7cf3453aff3a admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:31.259724 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac56e06-45a9-401e-861a-7cf3453aff3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:31.260106 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac56e06-45a9-401e-861a-7cf3453aff3a admin admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:31.262725 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac56e06-45a9-401e-861a-7cf3453aff3a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:17:31.263151 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac56e06-45a9-401e-861a-7cf3453aff3a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:31.264911 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac56e06-45a9-401e-861a-7cf3453aff3a admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:31.272653 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4de02b-e02a-431a-8a04-222790e629c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:31.273437 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4de02b-e02a-431a-8a04-222790e629c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:31.273787 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4de02b-e02a-431a-8a04-222790e629c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:31.274113 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4de02b-e02a-431a-8a04-222790e629c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:31.274764 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4de02b-e02a-431a-8a04-222790e629c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:31.277701 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4de02b-e02a-431a-8a04-222790e629c1 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:31.304570 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 915/1837] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Sep 5 12:17:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:17:31.306324 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd8ec66-835c-4aad-8958-abc46890cf3e None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:31.306715 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd8ec66-835c-4aad-8958-abc46890cf3e None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:31.307112 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd8ec66-835c-4aad-8958-abc46890cf3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:31.318110 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:31.342989 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 923/1838] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 5 12:17:31 2022] POST /identity/v3/projects => generated 399 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:17:31.344187 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4de02b-e02a-431a-8a04-222790e629c1 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:31.364984 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-3dd8ec66-835c-4aad-8958-abc46890cf3e None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:17:31.366477 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-3dd8ec66-835c-4aad-8958-abc46890cf3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:31.521059 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 916/1839] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:17:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:17:31.521910 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd8ec66-835c-4aad-8958-abc46890cf3e None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:31.541726 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd8ec66-835c-4aad-8958-abc46890cf3e None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:31.553777 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4de02b-e02a-431a-8a04-222790e629c1 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:31.554214 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e326473b-7a1d-4b9a-acf4-df29f749c12d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:31.554969 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e326473b-7a1d-4b9a-acf4-df29f749c12d admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:31.555353 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e326473b-7a1d-4b9a-acf4-df29f749c12d admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:31.555766 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e326473b-7a1d-4b9a-acf4-df29f749c12d admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:31.556518 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e326473b-7a1d-4b9a-acf4-df29f749c12d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:31.561817 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e326473b-7a1d-4b9a-acf4-df29f749c12d admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:31.568599 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1295246c-7904-4d32-a27c-f1ea8efb8ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:31.569458 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1295246c-7904-4d32-a27c-f1ea8efb8ce8 admin admin] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:31.569805 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1295246c-7904-4d32-a27c-f1ea8efb8ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:31.570153 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1295246c-7904-4d32-a27c-f1ea8efb8ce8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:31.570902 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1295246c-7904-4d32-a27c-f1ea8efb8ce8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:31.573172 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1295246c-7904-4d32-a27c-f1ea8efb8ce8 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:31.622369 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 917/1840] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 5 12:17:31 2022] POST /identity/v3/projects => generated 365 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:17:31.623449 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e326473b-7a1d-4b9a-acf4-df29f749c12d admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:31.659476 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 924/1841] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 5 12:17:31 2022] POST /identity/v3/projects => generated 365 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:17:31.662508 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1295246c-7904-4d32-a27c-f1ea8efb8ce8 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:31.670378 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-1295246c-7904-4d32-a27c-f1ea8efb8ce8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:31.826725 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e326473b-7a1d-4b9a-acf4-df29f749c12d admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:31.871264 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1295246c-7904-4d32-a27c-f1ea8efb8ce8 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:31.887051 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58cf9e5-658d-4c21-9135-8218a466b5d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4994b4faa4ec4aa088f3dc32c9c5614d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:31.887697 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58cf9e5-658d-4c21-9135-8218a466b5d5 service neutron] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:31.887976 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58cf9e5-658d-4c21-9135-8218a466b5d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:31.888245 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58cf9e5-658d-4c21-9135-8218a466b5d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:31.931952 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435d3ee7-a326-4514-a679-b9f6f288e45d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:31.933852 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435d3ee7-a326-4514-a679-b9f6f288e45d admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:31.933852 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435d3ee7-a326-4514-a679-b9f6f288e45d admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:31.934335 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435d3ee7-a326-4514-a679-b9f6f288e45d admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:31.935477 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435d3ee7-a326-4514-a679-b9f6f288e45d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:31.937771 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435d3ee7-a326-4514-a679-b9f6f288e45d admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:31.971820 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 918/1842] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 5 12:17:31 2022] POST /identity/v3/users => generated 306 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:17:31.971820 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435d3ee7-a326-4514-a679-b9f6f288e45d admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:31.984124 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435d3ee7-a326-4514-a679-b9f6f288e45d admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:31.990049 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1608b81-2477-4a02-8424-c0faaef4a7ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:31.990854 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1608b81-2477-4a02-8424-c0faaef4a7ec admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:31.991260 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1608b81-2477-4a02-8424-c0faaef4a7ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:31.991707 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1608b81-2477-4a02-8424-c0faaef4a7ec admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:31.992491 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1608b81-2477-4a02-8424-c0faaef4a7ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:31.994732 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1608b81-2477-4a02-8424-c0faaef4a7ec admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:32.006518 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:32.023397 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58cf9e5-658d-4c21-9135-8218a466b5d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:32.024725 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58cf9e5-658d-4c21-9135-8218a466b5d5 service neutron] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:32.036945 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 919/1843] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 5 12:17:31 2022] POST /identity/v3/users => generated 283 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:17:32.038355 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1608b81-2477-4a02-8424-c0faaef4a7ec admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:32.044517 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 925/1844] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:17:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:17:32.045464 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58cf9e5-658d-4c21-9135-8218a466b5d5 service neutron] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:32.056210 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58cf9e5-658d-4c21-9135-8218a466b5d5 service neutron] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:32.060813 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1608b81-2477-4a02-8424-c0faaef4a7ec admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:32.062497 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c2023d-51fd-4761-b3ed-823b10880cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:32.063123 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c2023d-51fd-4761-b3ed-823b10880cd0 admin admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:32.063576 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c2023d-51fd-4761-b3ed-823b10880cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:32.063826 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c2023d-51fd-4761-b3ed-823b10880cd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:32.064605 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c2023d-51fd-4761-b3ed-823b10880cd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:32.070865 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c2023d-51fd-4761-b3ed-823b10880cd0 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:32.078048 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d30630e-a739-4297-8a2e-b95c772ef346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:32.079798 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d30630e-a739-4297-8a2e-b95c772ef346 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:32.079798 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d30630e-a739-4297-8a2e-b95c772ef346 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:32.079798 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d30630e-a739-4297-8a2e-b95c772ef346 admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:32.080718 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d30630e-a739-4297-8a2e-b95c772ef346 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:32.085436 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 926/1845] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:17:32 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:17:32.085436 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c2023d-51fd-4761-b3ed-823b10880cd0 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:32.085680 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d30630e-a739-4297-8a2e-b95c772ef346 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:32.113703 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c2023d-51fd-4761-b3ed-823b10880cd0 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:32.139130 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 920/1846] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 5 12:17:32 2022] POST /identity/v3/users => generated 283 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:17:32.139130 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d30630e-a739-4297-8a2e-b95c772ef346 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:32.143024 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9078df20-de66-45ec-a6e6-da45df08ff60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:32.144364 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9078df20-de66-45ec-a6e6-da45df08ff60 admin admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:32.144803 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9078df20-de66-45ec-a6e6-da45df08ff60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:32.145758 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9078df20-de66-45ec-a6e6-da45df08ff60 admin admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:32.149946 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9078df20-de66-45ec-a6e6-da45df08ff60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:32.165627 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9078df20-de66-45ec-a6e6-da45df08ff60 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:32.216013 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d30630e-a739-4297-8a2e-b95c772ef346 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:32.231421 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 927/1847] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:17:32 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:17:32.232480 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ee41ef-572d-4609-a7d8-c5b9d170bf25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:32.234404 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9078df20-de66-45ec-a6e6-da45df08ff60 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:32.234813 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ee41ef-572d-4609-a7d8-c5b9d170bf25 admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:32.235816 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ee41ef-572d-4609-a7d8-c5b9d170bf25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:32.236763 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ee41ef-572d-4609-a7d8-c5b9d170bf25 admin admin] PATH_INFO: `/v3/projects/28c43658f3254eb0b215b1dff7966538/users/18e722161d214cb1b5e1c7b2dc752d95/roles/16e2ccc8bd1b497d8cee780c1c7df0d2` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:32.269264 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9078df20-de66-45ec-a6e6-da45df08ff60 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:32.278655 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6c079a-b3ae-4046-9162-ac54ff0652d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:32.279954 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6c079a-b3ae-4046-9162-ac54ff0652d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:32.280570 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6c079a-b3ae-4046-9162-ac54ff0652d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:32.281213 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6c079a-b3ae-4046-9162-ac54ff0652d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:32.282725 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6c079a-b3ae-4046-9162-ac54ff0652d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:32.283423 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ee41ef-572d-4609-a7d8-c5b9d170bf25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28c43658f3254eb0b215b1dff7966538, user_id=18e722161d214cb1b5e1c7b2dc752d95, role_id=16e2ccc8bd1b497d8cee780c1c7df0d2)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:32.286117 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ee41ef-572d-4609-a7d8-c5b9d170bf25 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:32.286677 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6c079a-b3ae-4046-9162-ac54ff0652d8 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:32.290892 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:32.322665 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 928/1848] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:17:32 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:17:32.323929 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6c079a-b3ae-4046-9162-ac54ff0652d8 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:32.336266 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 921/1849] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 5 12:17:32 2022] PUT /identity/v3/projects/28c43658f3254eb0b215b1dff7966538/users/18e722161d214cb1b5e1c7b2dc752d95/roles/16e2ccc8bd1b497d8cee780c1c7df0d2 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:17:32.345362 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e432335d-9e22-483a-bd3c-765debb89c69 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:32.345807 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e432335d-9e22-483a-bd3c-765debb89c69 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:32.346582 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e432335d-9e22-483a-bd3c-765debb89c69 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:32.349704 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 922/1850] 10.222.0.50 () {54 vars in 921 bytes} [Mon Sep 5 12:17:32 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:17:32.350881 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e432335d-9e22-483a-bd3c-765debb89c69 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:32.355675 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6c079a-b3ae-4046-9162-ac54ff0652d8 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:32.546453 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f251b23-eabd-4c09-a716-48930f97b1ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:32.547357 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f251b23-eabd-4c09-a716-48930f97b1ed admin admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:32.547782 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f251b23-eabd-4c09-a716-48930f97b1ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:32.548221 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f251b23-eabd-4c09-a716-48930f97b1ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:32.549053 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f251b23-eabd-4c09-a716-48930f97b1ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:32.550827 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f251b23-eabd-4c09-a716-48930f97b1ed admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:32.574994 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 929/1851] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:17:32 2022] GET /identity/v3/roles => generated 1420 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:17:32.582431 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f251b23-eabd-4c09-a716-48930f97b1ed admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:32.600318 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e432335d-9e22-483a-bd3c-765debb89c69 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:32.614087 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73db6a9c-2f59-4764-95da-b09dfed430df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:32.614403 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73db6a9c-2f59-4764-95da-b09dfed430df admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:32.614576 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73db6a9c-2f59-4764-95da-b09dfed430df admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:32.614781 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73db6a9c-2f59-4764-95da-b09dfed430df admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:32.615442 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73db6a9c-2f59-4764-95da-b09dfed430df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:32.617787 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73db6a9c-2f59-4764-95da-b09dfed430df admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:32.620857 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f251b23-eabd-4c09-a716-48930f97b1ed admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:32.639161 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 923/1852] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:17:32 2022] GET /identity/v3/roles => generated 1420 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:17:32.640152 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e4413b-abdd-432a-9aed-7d38a7f3fc73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:32.643082 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c380f306-6e7c-4024-abe8-475f18797ebd None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:32.643369 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c380f306-6e7c-4024-abe8-475f18797ebd None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:32.643644 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c380f306-6e7c-4024-abe8-475f18797ebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:32.644108 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e4413b-abdd-432a-9aed-7d38a7f3fc73 admin admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:32.644594 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e4413b-abdd-432a-9aed-7d38a7f3fc73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:32.645107 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e4413b-abdd-432a-9aed-7d38a7f3fc73 admin admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:32.646348 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e4413b-abdd-432a-9aed-7d38a7f3fc73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:32.650656 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e4413b-abdd-432a-9aed-7d38a7f3fc73 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:32.677951 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 930/1853] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:17:32 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:17:32.679137 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e4413b-abdd-432a-9aed-7d38a7f3fc73 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:32.702261 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e4413b-abdd-432a-9aed-7d38a7f3fc73 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:32.727367 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-c380f306-6e7c-4024-abe8-475f18797ebd None None] MFA Rules not processed for user `cb060ff495bc4abb83ff88992fb7be09`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:17:32.728624 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-c380f306-6e7c-4024-abe8-475f18797ebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:32.731460 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7553ed-4449-4dfa-b12a-cbd355e026f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:32.732429 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7553ed-4449-4dfa-b12a-cbd355e026f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:32.732945 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7553ed-4449-4dfa-b12a-cbd355e026f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:32.733510 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7553ed-4449-4dfa-b12a-cbd355e026f7 admin admin] PATH_INFO: `/v3/projects/2d8271c8507944a888d04bce281dd895/users/6861bf8202de4606a286038224c21811/roles/ed72181e1403401facb77dcf33644757` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:32.774789 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7553ed-4449-4dfa-b12a-cbd355e026f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d8271c8507944a888d04bce281dd895, user_id=6861bf8202de4606a286038224c21811, role_id=ed72181e1403401facb77dcf33644757)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:32.786729 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7553ed-4449-4dfa-b12a-cbd355e026f7 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:32.821590 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 931/1854] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 5 12:17:32 2022] PUT /identity/v3/projects/2d8271c8507944a888d04bce281dd895/users/6861bf8202de4606a286038224c21811/roles/ed72181e1403401facb77dcf33644757 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:17:32.822969 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7553ed-4449-4dfa-b12a-cbd355e026f7 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:32.906423 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 924/1855] 10.222.0.50 () {58 vars in 1018 bytes} [Mon Sep 5 12:17:32 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:17:32.907301 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c380f306-6e7c-4024-abe8-475f18797ebd None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:32.928855 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c380f306-6e7c-4024-abe8-475f18797ebd None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:33.019158 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:33.078004 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030bcbab-e57e-4bed-8cbf-64182d02aac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:33.078961 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030bcbab-e57e-4bed-8cbf-64182d02aac3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:33.079468 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030bcbab-e57e-4bed-8cbf-64182d02aac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:33.080090 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030bcbab-e57e-4bed-8cbf-64182d02aac3 admin admin] PATH_INFO: `/v3/projects/28c43658f3254eb0b215b1dff7966538/users/18e722161d214cb1b5e1c7b2dc752d95/roles/16e2ccc8bd1b497d8cee780c1c7df0d2` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:33.083294 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030bcbab-e57e-4bed-8cbf-64182d02aac3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28c43658f3254eb0b215b1dff7966538, user_id=18e722161d214cb1b5e1c7b2dc752d95, role_id=16e2ccc8bd1b497d8cee780c1c7df0d2)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:33.086755 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030bcbab-e57e-4bed-8cbf-64182d02aac3 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:33.112363 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7553ed-4449-4dfa-b12a-cbd355e026f7 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:33.126025 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 925/1856] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 5 12:17:32 2022] PUT /identity/v3/projects/28c43658f3254eb0b215b1dff7966538/users/18e722161d214cb1b5e1c7b2dc752d95/roles/16e2ccc8bd1b497d8cee780c1c7df0d2 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:17:33.127405 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030bcbab-e57e-4bed-8cbf-64182d02aac3 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:33.140181 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-030bcbab-e57e-4bed-8cbf-64182d02aac3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:33.282318 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030bcbab-e57e-4bed-8cbf-64182d02aac3 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:33.301975 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9294b318-cf55-415b-b8bf-9ddf817624bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:33.302757 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9294b318-cf55-415b-b8bf-9ddf817624bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:33.303144 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9294b318-cf55-415b-b8bf-9ddf817624bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:33.303527 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9294b318-cf55-415b-b8bf-9ddf817624bd admin admin] PATH_INFO: `/v3/projects/80f177f3dd6346e1ac6c4cf7dcb9458c` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:33.305086 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9294b318-cf55-415b-b8bf-9ddf817624bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=80f177f3dd6346e1ac6c4cf7dcb9458c)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:33.307797 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9294b318-cf55-415b-b8bf-9ddf817624bd admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:33.366643 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8ea482-e456-46dc-b04c-98c3bf75c614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:33.368089 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8ea482-e456-46dc-b04c-98c3bf75c614 admin admin] REQUEST_METHOD: `PUT` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:33.376197 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8ea482-e456-46dc-b04c-98c3bf75c614 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:33.377221 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8ea482-e456-46dc-b04c-98c3bf75c614 admin admin] PATH_INFO: `/v3/projects/627f2a945a4a4903b8320befa43f3aa3/users/5c4bd324c2bd4a37b7304856095b2dfe/roles/ed72181e1403401facb77dcf33644757` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:33.412076 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:33.412713 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-9294b318-cf55-415b-b8bf-9ddf817624bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80f177f3dd6346e1ac6c4cf7dcb9458c', 'request_id': 'req-9294b318-cf55-415b-b8bf-9ddf817624bd'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:33.429752 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8ea482-e456-46dc-b04c-98c3bf75c614 admin admin] RBAC: Authorizing `identity:create_grant(project_id=627f2a945a4a4903b8320befa43f3aa3, user_id=5c4bd324c2bd4a37b7304856095b2dfe, role_id=ed72181e1403401facb77dcf33644757)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:33.430800 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-9294b318-cf55-415b-b8bf-9ddf817624bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80f177f3dd6346e1ac6c4cf7dcb9458c', 'request_id': 'req-9294b318-cf55-415b-b8bf-9ddf817624bd'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:33.445986 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-9294b318-cf55-415b-b8bf-9ddf817624bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80f177f3dd6346e1ac6c4cf7dcb9458c', 'request_id': 'req-9294b318-cf55-415b-b8bf-9ddf817624bd'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:33.448867 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8ea482-e456-46dc-b04c-98c3bf75c614 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:33.462056 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-9294b318-cf55-415b-b8bf-9ddf817624bd admin admin] The token cache is being invalidate because project 80f177f3dd6346e1ac6c4cf7dcb9458c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:17:33.462470 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-9294b318-cf55-415b-b8bf-9ddf817624bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:33.465019 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-9294b318-cf55-415b-b8bf-9ddf817624bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:33.476016 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 926/1857] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 5 12:17:33 2022] DELETE /identity/v3/projects/80f177f3dd6346e1ac6c4cf7dcb9458c => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:17:33.477595 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178e78fb-5678-4cdc-9194-00bfa8525252 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:33.477983 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178e78fb-5678-4cdc-9194-00bfa8525252 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:33.478361 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178e78fb-5678-4cdc-9194-00bfa8525252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:33.514919 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 932/1858] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 5 12:17:32 2022] PUT /identity/v3/projects/627f2a945a4a4903b8320befa43f3aa3/users/5c4bd324c2bd4a37b7304856095b2dfe/roles/ed72181e1403401facb77dcf33644757 => generated 0 bytes in 681 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:17:33.516224 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8ea482-e456-46dc-b04c-98c3bf75c614 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:33.521593 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-9b8ea482-e456-46dc-b04c-98c3bf75c614 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:33.537893 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-178e78fb-5678-4cdc-9194-00bfa8525252 None None] MFA Rules not processed for user `6861bf8202de4606a286038224c21811`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:17:33.539305 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-178e78fb-5678-4cdc-9194-00bfa8525252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:33.643285 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:33.679069 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 927/1859] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:17:33 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:17:33.680590 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a3f130-db88-461c-866c-dbe3cd3fb9cc None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:33.681009 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a3f130-db88-461c-866c-dbe3cd3fb9cc None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:33.681379 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a3f130-db88-461c-866c-dbe3cd3fb9cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:33.762988 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-23a3f130-db88-461c-866c-dbe3cd3fb9cc None None] MFA Rules not processed for user `18e722161d214cb1b5e1c7b2dc752d95`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:17:33.764391 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-23a3f130-db88-461c-866c-dbe3cd3fb9cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:33.773299 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8ea482-e456-46dc-b04c-98c3bf75c614 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:33.790107 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf7c734-7b85-4f20-865a-ae5f24974171 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb060ff495bc4abb83ff88992fb7be09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:33.790855 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf7c734-7b85-4f20-865a-ae5f24974171 service nova] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:33.791329 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf7c734-7b85-4f20-865a-ae5f24974171 service nova] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:33.791611 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf7c734-7b85-4f20-865a-ae5f24974171 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:33.799186 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-abf7c734-7b85-4f20-865a-ae5f24974171 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:33.834128 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf7c734-7b85-4f20-865a-ae5f24974171 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:33.835849 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf7c734-7b85-4f20-865a-ae5f24974171 service nova] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:33.902024 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 933/1860] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:17:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:17:33.903264 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf7c734-7b85-4f20-865a-ae5f24974171 service nova] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:33.907939 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-abf7c734-7b85-4f20-865a-ae5f24974171 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:33.935715 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 928/1861] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:17:33 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:17:33.937363 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256b4a82-8540-461d-9589-c498fd63b78d None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:33.938088 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256b4a82-8540-461d-9589-c498fd63b78d None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:33.938088 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256b4a82-8540-461d-9589-c498fd63b78d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:33.984599 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-256b4a82-8540-461d-9589-c498fd63b78d None None] MFA Rules not processed for user `5c4bd324c2bd4a37b7304856095b2dfe`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:17:33.985960 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-256b4a82-8540-461d-9589-c498fd63b78d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:34.064299 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf7c734-7b85-4f20-865a-ae5f24974171 service nova] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:34.077760 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d583295-738a-4534-8471-fa7f00528d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:34.078740 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d583295-738a-4534-8471-fa7f00528d75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:34.079277 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d583295-738a-4534-8471-fa7f00528d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:34.079857 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d583295-738a-4534-8471-fa7f00528d75 admin admin] PATH_INFO: `/v3/users/9e375da27053437985e138a377d399d2` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:34.086754 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d583295-738a-4534-8471-fa7f00528d75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e375da27053437985e138a377d399d2)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:34.089161 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d583295-738a-4534-8471-fa7f00528d75 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:34.123448 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 929/1862] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:17:33 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:17:34.125777 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bffe007-91bb-4c05-b72d-17b0b8c50865 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:34.126135 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bffe007-91bb-4c05-b72d-17b0b8c50865 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:34.126532 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bffe007-91bb-4c05-b72d-17b0b8c50865 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:34.129050 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 930/1863] 10.222.0.50 () {54 vars in 921 bytes} [Mon Sep 5 12:17:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:17:34.130354 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bffe007-91bb-4c05-b72d-17b0b8c50865 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:34.133578 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-3bffe007-91bb-4c05-b72d-17b0b8c50865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:34.158467 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bffe007-91bb-4c05-b72d-17b0b8c50865 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:34.168261 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fda6860-c2e6-42b9-90e1-752370793b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:34.169967 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fda6860-c2e6-42b9-90e1-752370793b12 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:34.170161 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fda6860-c2e6-42b9-90e1-752370793b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:34.170917 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fda6860-c2e6-42b9-90e1-752370793b12 admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:34.172124 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fda6860-c2e6-42b9-90e1-752370793b12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:34.176931 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fda6860-c2e6-42b9-90e1-752370793b12 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:34.188886 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-2d583295-738a-4534-8471-fa7f00528d75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e375da27053437985e138a377d399d2'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:34.190703 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-2d583295-738a-4534-8471-fa7f00528d75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e375da27053437985e138a377d399d2'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:34.201885 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-2d583295-738a-4534-8471-fa7f00528d75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e375da27053437985e138a377d399d2'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:34.201885 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-2d583295-738a-4534-8471-fa7f00528d75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e375da27053437985e138a377d399d2'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:34.220741 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-2d583295-738a-4534-8471-fa7f00528d75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e375da27053437985e138a377d399d2'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:34.221425 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 931/1864] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 5 12:17:34 2022] POST /identity/v3/projects => generated 363 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:17:34.222537 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fda6860-c2e6-42b9-90e1-752370793b12 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:34.227338 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-9fda6860-c2e6-42b9-90e1-752370793b12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:34.230704 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:34.244654 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 934/1865] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 5 12:17:33 2022] DELETE /identity/v3/users/9e375da27053437985e138a377d399d2 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:17:34.250549 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d583295-738a-4534-8471-fa7f00528d75 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:34.251996 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-2d583295-738a-4534-8471-fa7f00528d75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:34.302721 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:34.323032 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fda6860-c2e6-42b9-90e1-752370793b12 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:34.360286 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d583295-738a-4534-8471-fa7f00528d75 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:34.367498 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96b45fc-80d6-4eaf-8614-8e329fdacc51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:34.368292 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96b45fc-80d6-4eaf-8614-8e329fdacc51 admin admin] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:34.368665 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96b45fc-80d6-4eaf-8614-8e329fdacc51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:34.368870 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96b45fc-80d6-4eaf-8614-8e329fdacc51 admin admin] PATH_INFO: `/v3/projects` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:34.369580 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96b45fc-80d6-4eaf-8614-8e329fdacc51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:34.373149 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96b45fc-80d6-4eaf-8614-8e329fdacc51 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:34.397904 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2232416-8c49-4294-99f2-7b193498573c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37633bbae0c2423c81ccd61ac3a17ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:34.399661 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2232416-8c49-4294-99f2-7b193498573c service cinder] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:34.400524 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2232416-8c49-4294-99f2-7b193498573c service cinder] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:34.400879 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2232416-8c49-4294-99f2-7b193498573c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:34.403906 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-a2232416-8c49-4294-99f2-7b193498573c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:34.418438 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 935/1866] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 5 12:17:34 2022] POST /identity/v3/projects => generated 365 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:17:34.421746 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633182d3-330e-451e-9806-383cdadbedd9 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:34.422186 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633182d3-330e-451e-9806-383cdadbedd9 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:34.422968 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633182d3-330e-451e-9806-383cdadbedd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:34.450821 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-633182d3-330e-451e-9806-383cdadbedd9 None None] MFA Rules not processed for user `cb060ff495bc4abb83ff88992fb7be09`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:17:34.452491 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-633182d3-330e-451e-9806-383cdadbedd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:34.517190 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2232416-8c49-4294-99f2-7b193498573c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:34.519383 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2232416-8c49-4294-99f2-7b193498573c service cinder] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:34.535659 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 932/1867] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:17:34 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:17:34.536342 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2232416-8c49-4294-99f2-7b193498573c service cinder] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:34.539305 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-a2232416-8c49-4294-99f2-7b193498573c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:34.557754 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2232416-8c49-4294-99f2-7b193498573c service cinder] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:34.575045 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 936/1868] 10.222.0.50 () {58 vars in 1018 bytes} [Mon Sep 5 12:17:34 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:17:34.577090 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633182d3-330e-451e-9806-383cdadbedd9 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:34.645379 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4809d91-ed87-4320-b256-634b0eed6dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:34.646103 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4809d91-ed87-4320-b256-634b0eed6dfd admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:34.646483 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4809d91-ed87-4320-b256-634b0eed6dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:34.646867 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4809d91-ed87-4320-b256-634b0eed6dfd admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:34.647622 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4809d91-ed87-4320-b256-634b0eed6dfd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:34.649807 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4809d91-ed87-4320-b256-634b0eed6dfd admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:34.692471 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 933/1869] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 5 12:17:34 2022] POST /identity/v3/users => generated 288 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:17:34.692944 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4809d91-ed87-4320-b256-634b0eed6dfd admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:34.711628 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633182d3-330e-451e-9806-383cdadbedd9 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:34.719407 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beef43ae-532d-4472-b1eb-bce183e24d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:34.720264 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beef43ae-532d-4472-b1eb-bce183e24d08 admin admin] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:34.720705 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beef43ae-532d-4472-b1eb-bce183e24d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:34.721017 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beef43ae-532d-4472-b1eb-bce183e24d08 admin admin] PATH_INFO: `/v3/users` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:34.722074 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beef43ae-532d-4472-b1eb-bce183e24d08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:34.725308 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beef43ae-532d-4472-b1eb-bce183e24d08 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:34.756939 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:34.762620 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:34.775913 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 937/1870] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 5 12:17:34 2022] POST /identity/v3/users => generated 289 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:17:34.779051 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beef43ae-532d-4472-b1eb-bce183e24d08 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:34.780848 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-beef43ae-532d-4472-b1eb-bce183e24d08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:34.810257 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4809d91-ed87-4320-b256-634b0eed6dfd admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:34.811017 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beef43ae-532d-4472-b1eb-bce183e24d08 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:34.814484 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f389ede0-b559-48f1-a217-84500bed29f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37633bbae0c2423c81ccd61ac3a17ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:34.815297 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f389ede0-b559-48f1-a217-84500bed29f6 service cinder] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:34.815758 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f389ede0-b559-48f1-a217-84500bed29f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:34.816063 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f389ede0-b559-48f1-a217-84500bed29f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:34.819358 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3fd03e-96ad-4035-92cf-b8ce8c871e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:34.820721 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3fd03e-96ad-4035-92cf-b8ce8c871e92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:34.820721 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3fd03e-96ad-4035-92cf-b8ce8c871e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:34.822191 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-f389ede0-b559-48f1-a217-84500bed29f6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:34.823509 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3fd03e-96ad-4035-92cf-b8ce8c871e92 admin admin] PATH_INFO: `/v3/projects/5fc6f9babb914eeb83b825638a66a5e9` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:34.826512 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3fd03e-96ad-4035-92cf-b8ce8c871e92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fc6f9babb914eeb83b825638a66a5e9)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:34.831302 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3fd03e-96ad-4035-92cf-b8ce8c871e92 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:34.934716 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-4d3fd03e-96ad-4035-92cf-b8ce8c871e92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fc6f9babb914eeb83b825638a66a5e9', 'request_id': 'req-4d3fd03e-96ad-4035-92cf-b8ce8c871e92'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:34.952326 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-4d3fd03e-96ad-4035-92cf-b8ce8c871e92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fc6f9babb914eeb83b825638a66a5e9', 'request_id': 'req-4d3fd03e-96ad-4035-92cf-b8ce8c871e92'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:34.960621 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-4d3fd03e-96ad-4035-92cf-b8ce8c871e92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fc6f9babb914eeb83b825638a66a5e9', 'request_id': 'req-4d3fd03e-96ad-4035-92cf-b8ce8c871e92'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:34.969512 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f389ede0-b559-48f1-a217-84500bed29f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:34.971236 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f389ede0-b559-48f1-a217-84500bed29f6 service cinder] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:34.977632 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-4d3fd03e-96ad-4035-92cf-b8ce8c871e92 admin admin] The token cache is being invalidate because project 5fc6f9babb914eeb83b825638a66a5e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:17:34.978153 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-4d3fd03e-96ad-4035-92cf-b8ce8c871e92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:34.980047 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-4d3fd03e-96ad-4035-92cf-b8ce8c871e92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:34.982816 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 938/1871] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 5 12:17:34 2022] DELETE /identity/v3/projects/5fc6f9babb914eeb83b825638a66a5e9 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:17:34.984447 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3fd03e-96ad-4035-92cf-b8ce8c871e92 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:34.987441 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-4d3fd03e-96ad-4035-92cf-b8ce8c871e92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:34.995897 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 934/1872] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:17:34 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:17:34.997203 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f389ede0-b559-48f1-a217-84500bed29f6 service cinder] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:35.002949 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-f389ede0-b559-48f1-a217-84500bed29f6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:35.036645 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f389ede0-b559-48f1-a217-84500bed29f6 service cinder] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:35.114435 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3fd03e-96ad-4035-92cf-b8ce8c871e92 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:35.121399 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe589b2e-9432-42d4-9f00-bdf8a6552e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:35.123080 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe589b2e-9432-42d4-9f00-bdf8a6552e94 admin admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:35.123369 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe589b2e-9432-42d4-9f00-bdf8a6552e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:35.123646 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe589b2e-9432-42d4-9f00-bdf8a6552e94 admin admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:35.124443 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe589b2e-9432-42d4-9f00-bdf8a6552e94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:35.126369 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe589b2e-9432-42d4-9f00-bdf8a6552e94 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:35.145152 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 939/1873] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:17:34 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:17:35.146441 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe589b2e-9432-42d4-9f00-bdf8a6552e94 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:35.150772 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-fe589b2e-9432-42d4-9f00-bdf8a6552e94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:35.164741 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f65f6c-5d68-486c-a5f5-15ec411b12d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb060ff495bc4abb83ff88992fb7be09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:35.165476 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f65f6c-5d68-486c-a5f5-15ec411b12d4 service nova] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:35.165860 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f65f6c-5d68-486c-a5f5-15ec411b12d4 service nova] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:35.166251 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f65f6c-5d68-486c-a5f5-15ec411b12d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:35.168226 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-82f65f6c-5d68-486c-a5f5-15ec411b12d4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:35.170431 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe589b2e-9432-42d4-9f00-bdf8a6552e94 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:35.182410 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f65f6c-5d68-486c-a5f5-15ec411b12d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:35.184176 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f65f6c-5d68-486c-a5f5-15ec411b12d4 service nova] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:35.188075 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fc7309-a7cb-4c57-ae4d-d0cb0b37fcf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:35.188972 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fc7309-a7cb-4c57-ae4d-d0cb0b37fcf3 admin admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:35.189289 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fc7309-a7cb-4c57-ae4d-d0cb0b37fcf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:35.189747 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fc7309-a7cb-4c57-ae4d-d0cb0b37fcf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:35.190715 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fc7309-a7cb-4c57-ae4d-d0cb0b37fcf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:35.192473 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fc7309-a7cb-4c57-ae4d-d0cb0b37fcf3 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:35.196656 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 935/1874] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:17:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:17:35.197590 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f65f6c-5d68-486c-a5f5-15ec411b12d4 service nova] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:35.199969 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-82f65f6c-5d68-486c-a5f5-15ec411b12d4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:35.206005 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 940/1875] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:17:35 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:17:35.207053 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fc7309-a7cb-4c57-ae4d-d0cb0b37fcf3 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:35.215182 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f65f6c-5d68-486c-a5f5-15ec411b12d4 service nova] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:35.220134 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fc7309-a7cb-4c57-ae4d-d0cb0b37fcf3 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:35.220349 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe02c1c-f0c4-4f71-9a94-3f434ffc31dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:35.221163 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe02c1c-f0c4-4f71-9a94-3f434ffc31dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:35.221444 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe02c1c-f0c4-4f71-9a94-3f434ffc31dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:35.221742 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe02c1c-f0c4-4f71-9a94-3f434ffc31dd admin admin] PATH_INFO: `/v3/users/4348eaa21c3849b29815685840b16910` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:35.223030 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe02c1c-f0c4-4f71-9a94-3f434ffc31dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=4348eaa21c3849b29815685840b16910)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:35.226272 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe02c1c-f0c4-4f71-9a94-3f434ffc31dd admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:35.226927 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfdbfb1-7851-4d44-88d8-9325d5a4710a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:35.228120 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfdbfb1-7851-4d44-88d8-9325d5a4710a admin admin] REQUEST_METHOD: `PUT` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:35.228406 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfdbfb1-7851-4d44-88d8-9325d5a4710a admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:35.229266 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfdbfb1-7851-4d44-88d8-9325d5a4710a admin admin] PATH_INFO: `/v3/projects/1178f5f9038143489c06038500c6cb99/users/579590fb8e184836a2c3526a031bc83c/roles/16e2ccc8bd1b497d8cee780c1c7df0d2` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:35.260276 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfdbfb1-7851-4d44-88d8-9325d5a4710a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1178f5f9038143489c06038500c6cb99, user_id=579590fb8e184836a2c3526a031bc83c, role_id=16e2ccc8bd1b497d8cee780c1c7df0d2)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:35.264108 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfdbfb1-7851-4d44-88d8-9325d5a4710a admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:35.285595 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 941/1876] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 5 12:17:35 2022] PUT /identity/v3/projects/1178f5f9038143489c06038500c6cb99/users/579590fb8e184836a2c3526a031bc83c/roles/16e2ccc8bd1b497d8cee780c1c7df0d2 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:17:35.287109 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfdbfb1-7851-4d44-88d8-9325d5a4710a admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:35.305091 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-ebe02c1c-f0c4-4f71-9a94-3f434ffc31dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4348eaa21c3849b29815685840b16910'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:35.306210 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-ebe02c1c-f0c4-4f71-9a94-3f434ffc31dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4348eaa21c3849b29815685840b16910'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:35.317535 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-ebe02c1c-f0c4-4f71-9a94-3f434ffc31dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4348eaa21c3849b29815685840b16910'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:35.318443 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-ebe02c1c-f0c4-4f71-9a94-3f434ffc31dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4348eaa21c3849b29815685840b16910'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:35.337219 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-ebe02c1c-f0c4-4f71-9a94-3f434ffc31dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4348eaa21c3849b29815685840b16910'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:35.340765 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:35.361465 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 936/1877] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 5 12:17:35 2022] DELETE /identity/v3/users/4348eaa21c3849b29815685840b16910 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:17:35.361465 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe02c1c-f0c4-4f71-9a94-3f434ffc31dd admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:35.361953 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:35.363579 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-ebe02c1c-f0c4-4f71-9a94-3f434ffc31dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:35.382554 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfdbfb1-7851-4d44-88d8-9325d5a4710a admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:35.465903 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57067c8-2647-475c-90aa-3f85d8eec8d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:35.466830 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57067c8-2647-475c-90aa-3f85d8eec8d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:35.467209 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57067c8-2647-475c-90aa-3f85d8eec8d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:35.467561 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57067c8-2647-475c-90aa-3f85d8eec8d5 admin admin] PATH_INFO: `/v3/projects/93a23e96f5804b11b54d46e3c6b63b1a/users/d2548eb3bc2b47fd8ccf09821ab8132b/roles/16e2ccc8bd1b497d8cee780c1c7df0d2` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:35.470721 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe02c1c-f0c4-4f71-9a94-3f434ffc31dd admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:35.485469 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57067c8-2647-475c-90aa-3f85d8eec8d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93a23e96f5804b11b54d46e3c6b63b1a, user_id=d2548eb3bc2b47fd8ccf09821ab8132b, role_id=16e2ccc8bd1b497d8cee780c1c7df0d2)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:35.487768 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eec8d80-e548-475a-8036-cf28c727cba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:35.488762 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eec8d80-e548-475a-8036-cf28c727cba4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:35.489025 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57067c8-2647-475c-90aa-3f85d8eec8d5 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:35.489150 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eec8d80-e548-475a-8036-cf28c727cba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:35.489408 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eec8d80-e548-475a-8036-cf28c727cba4 admin admin] PATH_INFO: `/v3/projects/535f6fe53c054b11b1e26a3d1305a5e6` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:35.490935 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eec8d80-e548-475a-8036-cf28c727cba4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=535f6fe53c054b11b1e26a3d1305a5e6)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:35.493337 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eec8d80-e548-475a-8036-cf28c727cba4 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:35.506836 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 942/1878] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 5 12:17:35 2022] PUT /identity/v3/projects/93a23e96f5804b11b54d46e3c6b63b1a/users/d2548eb3bc2b47fd8ccf09821ab8132b/roles/16e2ccc8bd1b497d8cee780c1c7df0d2 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:17:35.508077 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57067c8-2647-475c-90aa-3f85d8eec8d5 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:35.509841 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-e57067c8-2647-475c-90aa-3f85d8eec8d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:35.562138 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-9eec8d80-e548-475a-8036-cf28c727cba4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '535f6fe53c054b11b1e26a3d1305a5e6', 'request_id': 'req-9eec8d80-e548-475a-8036-cf28c727cba4'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:35.571650 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-9eec8d80-e548-475a-8036-cf28c727cba4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '535f6fe53c054b11b1e26a3d1305a5e6', 'request_id': 'req-9eec8d80-e548-475a-8036-cf28c727cba4'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:35.580128 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-9eec8d80-e548-475a-8036-cf28c727cba4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '535f6fe53c054b11b1e26a3d1305a5e6', 'request_id': 'req-9eec8d80-e548-475a-8036-cf28c727cba4'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:35.594535 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-9eec8d80-e548-475a-8036-cf28c727cba4 admin admin] The token cache is being invalidate because project 535f6fe53c054b11b1e26a3d1305a5e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:17:35.594968 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-9eec8d80-e548-475a-8036-cf28c727cba4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:35.595720 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-9eec8d80-e548-475a-8036-cf28c727cba4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:35.600805 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 937/1879] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 5 12:17:35 2022] DELETE /identity/v3/projects/535f6fe53c054b11b1e26a3d1305a5e6 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:17:35.600805 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eec8d80-e548-475a-8036-cf28c727cba4 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:35.602204 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-9eec8d80-e548-475a-8036-cf28c727cba4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:35.604767 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57067c8-2647-475c-90aa-3f85d8eec8d5 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:35.673587 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a272089-72cb-4d02-99dc-73bda75beec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:35.674491 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a272089-72cb-4d02-99dc-73bda75beec5 admin admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:35.675035 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a272089-72cb-4d02-99dc-73bda75beec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:35.675506 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a272089-72cb-4d02-99dc-73bda75beec5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:35.676134 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a272089-72cb-4d02-99dc-73bda75beec5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:35.679549 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a272089-72cb-4d02-99dc-73bda75beec5 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:35.694066 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eec8d80-e548-475a-8036-cf28c727cba4 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:35.694681 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 943/1880] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:17:35 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:17:35.695930 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a272089-72cb-4d02-99dc-73bda75beec5 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:35.698521 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-5a272089-72cb-4d02-99dc-73bda75beec5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:35.704829 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090f4131-dbf0-4711-b7a5-758f6ae5490b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:35.705937 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090f4131-dbf0-4711-b7a5-758f6ae5490b admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:35.706466 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090f4131-dbf0-4711-b7a5-758f6ae5490b admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:35.707017 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090f4131-dbf0-4711-b7a5-758f6ae5490b admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:35.708068 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090f4131-dbf0-4711-b7a5-758f6ae5490b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:35.710079 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090f4131-dbf0-4711-b7a5-758f6ae5490b admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:35.713855 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a272089-72cb-4d02-99dc-73bda75beec5 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:35.720210 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e497b5a1-33dd-4e30-95a9-26818bf907d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:35.721401 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e497b5a1-33dd-4e30-95a9-26818bf907d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:35.721918 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e497b5a1-33dd-4e30-95a9-26818bf907d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:35.722456 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e497b5a1-33dd-4e30-95a9-26818bf907d4 admin admin] PATH_INFO: `/v3/users/351a9b7e130d423db1982e956faf0964` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:35.724015 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e497b5a1-33dd-4e30-95a9-26818bf907d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=351a9b7e130d423db1982e956faf0964)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:35.726237 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e497b5a1-33dd-4e30-95a9-26818bf907d4 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:35.729030 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 938/1881] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:17:35 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:17:35.731181 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090f4131-dbf0-4711-b7a5-758f6ae5490b admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:35.735045 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-090f4131-dbf0-4711-b7a5-758f6ae5490b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:35.749232 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:35.764409 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090f4131-dbf0-4711-b7a5-758f6ae5490b admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:35.770305 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53498e6-2829-440f-a85a-33a551bf9573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:35.771741 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53498e6-2829-440f-a85a-33a551bf9573 admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:35.772116 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53498e6-2829-440f-a85a-33a551bf9573 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:35.772494 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53498e6-2829-440f-a85a-33a551bf9573 admin admin] PATH_INFO: `/v3/projects/1178f5f9038143489c06038500c6cb99/users/579590fb8e184836a2c3526a031bc83c/roles/16e2ccc8bd1b497d8cee780c1c7df0d2` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:35.776102 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53498e6-2829-440f-a85a-33a551bf9573 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1178f5f9038143489c06038500c6cb99, user_id=579590fb8e184836a2c3526a031bc83c, role_id=16e2ccc8bd1b497d8cee780c1c7df0d2)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:35.779351 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53498e6-2829-440f-a85a-33a551bf9573 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:35.792957 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 939/1882] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 5 12:17:35 2022] PUT /identity/v3/projects/1178f5f9038143489c06038500c6cb99/users/579590fb8e184836a2c3526a031bc83c/roles/16e2ccc8bd1b497d8cee780c1c7df0d2 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:17:35.797820 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53498e6-2829-440f-a85a-33a551bf9573 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:35.806615 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:35.823609 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-e497b5a1-33dd-4e30-95a9-26818bf907d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '351a9b7e130d423db1982e956faf0964'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:35.824426 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-e497b5a1-33dd-4e30-95a9-26818bf907d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '351a9b7e130d423db1982e956faf0964'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:35.835546 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-e497b5a1-33dd-4e30-95a9-26818bf907d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '351a9b7e130d423db1982e956faf0964'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:35.836645 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-e497b5a1-33dd-4e30-95a9-26818bf907d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '351a9b7e130d423db1982e956faf0964'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:35.853730 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-e497b5a1-33dd-4e30-95a9-26818bf907d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '351a9b7e130d423db1982e956faf0964'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:35.871828 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 944/1883] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 5 12:17:35 2022] DELETE /identity/v3/users/351a9b7e130d423db1982e956faf0964 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:17:35.871828 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e497b5a1-33dd-4e30-95a9-26818bf907d4 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:35.871828 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-e497b5a1-33dd-4e30-95a9-26818bf907d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:35.885162 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53498e6-2829-440f-a85a-33a551bf9573 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:35.962347 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f311601-900b-42e2-ad0b-a87a2068be4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:35.963470 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f311601-900b-42e2-ad0b-a87a2068be4f admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:35.963893 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f311601-900b-42e2-ad0b-a87a2068be4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:35.964403 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f311601-900b-42e2-ad0b-a87a2068be4f admin admin] PATH_INFO: `/v3/projects/93a23e96f5804b11b54d46e3c6b63b1a/users/d2548eb3bc2b47fd8ccf09821ab8132b/roles/16e2ccc8bd1b497d8cee780c1c7df0d2` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:35.967220 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f311601-900b-42e2-ad0b-a87a2068be4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=93a23e96f5804b11b54d46e3c6b63b1a, user_id=d2548eb3bc2b47fd8ccf09821ab8132b, role_id=16e2ccc8bd1b497d8cee780c1c7df0d2)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:35.971091 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e497b5a1-33dd-4e30-95a9-26818bf907d4 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:35.971243 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f311601-900b-42e2-ad0b-a87a2068be4f admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:35.979482 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9f7e0c-2e67-4d34-9355-98833a001ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:35.980607 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9f7e0c-2e67-4d34-9355-98833a001ad5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:35.980917 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9f7e0c-2e67-4d34-9355-98833a001ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:35.981359 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9f7e0c-2e67-4d34-9355-98833a001ad5 admin admin] PATH_INFO: `/v3/projects/6bf3130d2db74c6caa0972fdde4b17e5` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:35.983150 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9f7e0c-2e67-4d34-9355-98833a001ad5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bf3130d2db74c6caa0972fdde4b17e5)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:35.985351 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9f7e0c-2e67-4d34-9355-98833a001ad5 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:35.988978 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 940/1884] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 5 12:17:35 2022] PUT /identity/v3/projects/93a23e96f5804b11b54d46e3c6b63b1a/users/d2548eb3bc2b47fd8ccf09821ab8132b/roles/16e2ccc8bd1b497d8cee780c1c7df0d2 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:17:35.991115 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687fb560-a901-4290-a3bd-52bada4a8f46 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:35.991480 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687fb560-a901-4290-a3bd-52bada4a8f46 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:35.991762 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687fb560-a901-4290-a3bd-52bada4a8f46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:36.037196 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-687fb560-a901-4290-a3bd-52bada4a8f46 None None] MFA Rules not processed for user `579590fb8e184836a2c3526a031bc83c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:17:36.037196 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-687fb560-a901-4290-a3bd-52bada4a8f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:36.051051 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-0f9f7e0c-2e67-4d34-9355-98833a001ad5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bf3130d2db74c6caa0972fdde4b17e5', 'request_id': 'req-0f9f7e0c-2e67-4d34-9355-98833a001ad5'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:36.060541 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-0f9f7e0c-2e67-4d34-9355-98833a001ad5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bf3130d2db74c6caa0972fdde4b17e5', 'request_id': 'req-0f9f7e0c-2e67-4d34-9355-98833a001ad5'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:36.073020 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-0f9f7e0c-2e67-4d34-9355-98833a001ad5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bf3130d2db74c6caa0972fdde4b17e5', 'request_id': 'req-0f9f7e0c-2e67-4d34-9355-98833a001ad5'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:36.099278 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-0f9f7e0c-2e67-4d34-9355-98833a001ad5 admin admin] The token cache is being invalidate because project 6bf3130d2db74c6caa0972fdde4b17e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:17:36.099922 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-0f9f7e0c-2e67-4d34-9355-98833a001ad5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:36.101106 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-0f9f7e0c-2e67-4d34-9355-98833a001ad5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:36.104590 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 945/1885] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 5 12:17:35 2022] DELETE /identity/v3/projects/6bf3130d2db74c6caa0972fdde4b17e5 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:17:36.107226 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15485511-8a01-4e09-acdd-9713438af417 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:36.107576 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15485511-8a01-4e09-acdd-9713438af417 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:36.108245 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15485511-8a01-4e09-acdd-9713438af417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:36.114927 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 941/1886] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:17:35 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:17:36.117080 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d7d617-673e-4a62-bbfa-5e3d902690aa None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:36.118090 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d7d617-673e-4a62-bbfa-5e3d902690aa None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:36.118560 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d7d617-673e-4a62-bbfa-5e3d902690aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:36.145073 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-56d7d617-673e-4a62-bbfa-5e3d902690aa None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:17:36.146456 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-56d7d617-673e-4a62-bbfa-5e3d902690aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:36.150919 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-15485511-8a01-4e09-acdd-9713438af417 None None] MFA Rules not processed for user `d2548eb3bc2b47fd8ccf09821ab8132b`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:17:36.152661 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-15485511-8a01-4e09-acdd-9713438af417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:36.163850 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:36.182108 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:36.223162 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 942/1887] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:17:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:17:36.224567 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d7d617-673e-4a62-bbfa-5e3d902690aa None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:36.227195 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-56d7d617-673e-4a62-bbfa-5e3d902690aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:36.265943 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 946/1888] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:17:36 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:17:36.268074 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eee76d6-f8bc-4905-9808-78f6ea7dae15 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:36.268458 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eee76d6-f8bc-4905-9808-78f6ea7dae15 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:36.268852 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eee76d6-f8bc-4905-9808-78f6ea7dae15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:36.305895 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-7eee76d6-f8bc-4905-9808-78f6ea7dae15 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:17:36.307173 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-7eee76d6-f8bc-4905-9808-78f6ea7dae15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:36.317893 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 947/1889] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:17:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:17:36.318735 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eee76d6-f8bc-4905-9808-78f6ea7dae15 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:36.320015 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-7eee76d6-f8bc-4905-9808-78f6ea7dae15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:36.332084 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eee76d6-f8bc-4905-9808-78f6ea7dae15 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:36.332750 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d7d617-673e-4a62-bbfa-5e3d902690aa None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:36.336697 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369b56d5-ece1-4be6-8faf-713e65600e29 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37633bbae0c2423c81ccd61ac3a17ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:36.336863 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be0d7e2-fb36-48c0-a24c-16ee8b942ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:36.337381 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be0d7e2-fb36-48c0-a24c-16ee8b942ebb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:36.337492 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369b56d5-ece1-4be6-8faf-713e65600e29 service cinder] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:36.337658 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be0d7e2-fb36-48c0-a24c-16ee8b942ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:36.337924 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369b56d5-ece1-4be6-8faf-713e65600e29 service cinder] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:36.338013 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be0d7e2-fb36-48c0-a24c-16ee8b942ebb admin admin] PATH_INFO: `/v3/projects/c24cdac749144d899fccd95e0065018f` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:36.338311 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369b56d5-ece1-4be6-8faf-713e65600e29 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:36.339053 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be0d7e2-fb36-48c0-a24c-16ee8b942ebb admin admin] RBAC: Authorizing `identity:delete_project(project_id=c24cdac749144d899fccd95e0065018f)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:36.340743 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-369b56d5-ece1-4be6-8faf-713e65600e29 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:36.341630 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be0d7e2-fb36-48c0-a24c-16ee8b942ebb admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:36.390880 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-0be0d7e2-fb36-48c0-a24c-16ee8b942ebb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c24cdac749144d899fccd95e0065018f', 'request_id': 'req-0be0d7e2-fb36-48c0-a24c-16ee8b942ebb'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:36.398840 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-0be0d7e2-fb36-48c0-a24c-16ee8b942ebb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c24cdac749144d899fccd95e0065018f', 'request_id': 'req-0be0d7e2-fb36-48c0-a24c-16ee8b942ebb'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:36.407077 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-0be0d7e2-fb36-48c0-a24c-16ee8b942ebb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c24cdac749144d899fccd95e0065018f', 'request_id': 'req-0be0d7e2-fb36-48c0-a24c-16ee8b942ebb'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:36.407224 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369b56d5-ece1-4be6-8faf-713e65600e29 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:36.408629 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369b56d5-ece1-4be6-8faf-713e65600e29 service cinder] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:36.418499 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 943/1890] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:17:36 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:17:36.418806 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-0be0d7e2-fb36-48c0-a24c-16ee8b942ebb admin admin] The token cache is being invalidate because project c24cdac749144d899fccd95e0065018f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:17:36.419103 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-0be0d7e2-fb36-48c0-a24c-16ee8b942ebb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:36.419313 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369b56d5-ece1-4be6-8faf-713e65600e29 service cinder] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:36.419914 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-0be0d7e2-fb36-48c0-a24c-16ee8b942ebb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:36.420612 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-369b56d5-ece1-4be6-8faf-713e65600e29 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:36.421786 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 948/1891] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 5 12:17:36 2022] DELETE /identity/v3/projects/c24cdac749144d899fccd95e0065018f => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:17:36.422314 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be0d7e2-fb36-48c0-a24c-16ee8b942ebb admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:36.423573 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-0be0d7e2-fb36-48c0-a24c-16ee8b942ebb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:36.431978 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369b56d5-ece1-4be6-8faf-713e65600e29 service cinder] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:36.484947 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5183b9-587b-463d-b5f9-7e7cb3a5e39c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37633bbae0c2423c81ccd61ac3a17ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:36.485626 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5183b9-587b-463d-b5f9-7e7cb3a5e39c service cinder] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:36.485910 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5183b9-587b-463d-b5f9-7e7cb3a5e39c service cinder] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:36.486183 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5183b9-587b-463d-b5f9-7e7cb3a5e39c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:36.488552 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-ca5183b9-587b-463d-b5f9-7e7cb3a5e39c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:36.505505 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be0d7e2-fb36-48c0-a24c-16ee8b942ebb admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:36.517633 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72d7725-9fea-4be2-b51a-a5f935f9b076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:36.517633 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72d7725-9fea-4be2-b51a-a5f935f9b076 admin admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:36.517633 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72d7725-9fea-4be2-b51a-a5f935f9b076 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:36.517633 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72d7725-9fea-4be2-b51a-a5f935f9b076 admin admin] PATH_INFO: `/v3/domains` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:36.517927 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72d7725-9fea-4be2-b51a-a5f935f9b076 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:17:36.517927 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72d7725-9fea-4be2-b51a-a5f935f9b076 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:36.517927 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72d7725-9fea-4be2-b51a-a5f935f9b076 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:36.524296 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:36.537157 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 949/1892] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Sep 5 12:17:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:17:36.544077 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2f416f-fbac-4ed6-a655-94de3d80b541 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:36.544077 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2f416f-fbac-4ed6-a655-94de3d80b541 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:36.544077 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2f416f-fbac-4ed6-a655-94de3d80b541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:36.564797 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5183b9-587b-463d-b5f9-7e7cb3a5e39c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:36.566301 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5183b9-587b-463d-b5f9-7e7cb3a5e39c service cinder] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:36.569416 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-2c2f416f-fbac-4ed6-a655-94de3d80b541 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:17:36.571083 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-2c2f416f-fbac-4ed6-a655-94de3d80b541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:36.582036 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 950/1893] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:17:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:17:36.583103 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2f416f-fbac-4ed6-a655-94de3d80b541 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:36.599099 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 944/1894] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:17:36 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:17:36.600228 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9776e560-212b-454b-8849-9a4d2970fd72 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:36.601159 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9776e560-212b-454b-8849-9a4d2970fd72 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:36.601382 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9776e560-212b-454b-8849-9a4d2970fd72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:36.617679 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2f416f-fbac-4ed6-a655-94de3d80b541 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:36.628253 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62e7152-2b4f-46a2-a123-e78ae69e1f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:36.629233 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62e7152-2b4f-46a2-a123-e78ae69e1f6d admin admin] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:36.629605 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62e7152-2b4f-46a2-a123-e78ae69e1f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:36.630016 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62e7152-2b4f-46a2-a123-e78ae69e1f6d admin admin] PATH_INFO: `/v3/projects` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:36.645500 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62e7152-2b4f-46a2-a123-e78ae69e1f6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:36.648011 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62e7152-2b4f-46a2-a123-e78ae69e1f6d admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:36.656377 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-9776e560-212b-454b-8849-9a4d2970fd72 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:17:36.658727 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-9776e560-212b-454b-8849-9a4d2970fd72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:36.667948 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:36.678074 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 945/1895] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:17:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:17:36.678867 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9776e560-212b-454b-8849-9a4d2970fd72 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:36.684798 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-9776e560-212b-454b-8849-9a4d2970fd72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:36.710154 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 951/1896] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 5 12:17:36 2022] POST /identity/v3/projects => generated 381 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:17:36.711483 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62e7152-2b4f-46a2-a123-e78ae69e1f6d admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:36.715639 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9776e560-212b-454b-8849-9a4d2970fd72 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:36.817773 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62e7152-2b4f-46a2-a123-e78ae69e1f6d admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:36.824664 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff155f7-f720-4c4b-a55f-f1ad5008c504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:36.828975 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff155f7-f720-4c4b-a55f-f1ad5008c504 admin admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:36.829262 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff155f7-f720-4c4b-a55f-f1ad5008c504 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:36.829559 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff155f7-f720-4c4b-a55f-f1ad5008c504 admin admin] PATH_INFO: `/v3/domains` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:36.830243 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff155f7-f720-4c4b-a55f-f1ad5008c504 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:17:36.830560 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff155f7-f720-4c4b-a55f-f1ad5008c504 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:36.832305 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff155f7-f720-4c4b-a55f-f1ad5008c504 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:36.847242 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 952/1897] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Sep 5 12:17:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:17:36.848140 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff155f7-f720-4c4b-a55f-f1ad5008c504 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:36.860432 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff155f7-f720-4c4b-a55f-f1ad5008c504 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:36.866564 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1018fb-576f-49e0-8feb-23cd27e1246e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37633bbae0c2423c81ccd61ac3a17ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:36.867927 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1018fb-576f-49e0-8feb-23cd27e1246e service cinder] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:36.868200 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1018fb-576f-49e0-8feb-23cd27e1246e service cinder] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:36.869093 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6391d7a-f225-4462-8bd0-8583a007579f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:36.869607 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1018fb-576f-49e0-8feb-23cd27e1246e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:36.871300 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6391d7a-f225-4462-8bd0-8583a007579f admin admin] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:36.873099 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-fa1018fb-576f-49e0-8feb-23cd27e1246e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:36.873220 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6391d7a-f225-4462-8bd0-8583a007579f admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:36.873506 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6391d7a-f225-4462-8bd0-8583a007579f admin admin] PATH_INFO: `/v3/users` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:36.875312 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6391d7a-f225-4462-8bd0-8583a007579f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:36.880614 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6391d7a-f225-4462-8bd0-8583a007579f admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:36.928742 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 953/1898] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 5 12:17:36 2022] POST /identity/v3/users => generated 291 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:17:36.928742 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6391d7a-f225-4462-8bd0-8583a007579f admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:36.942833 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6391d7a-f225-4462-8bd0-8583a007579f admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:36.950193 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31d5fd1-e450-4eec-910b-51959da7ebc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:36.951097 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31d5fd1-e450-4eec-910b-51959da7ebc5 admin admin] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:36.951711 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31d5fd1-e450-4eec-910b-51959da7ebc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:36.953173 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31d5fd1-e450-4eec-910b-51959da7ebc5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:36.954200 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31d5fd1-e450-4eec-910b-51959da7ebc5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:36.956395 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31d5fd1-e450-4eec-910b-51959da7ebc5 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:36.982936 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1018fb-576f-49e0-8feb-23cd27e1246e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:36.984165 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1018fb-576f-49e0-8feb-23cd27e1246e service cinder] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:36.996832 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 946/1899] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:17:36 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:17:36.997710 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1018fb-576f-49e0-8feb-23cd27e1246e service cinder] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:37.030376 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1018fb-576f-49e0-8feb-23cd27e1246e service cinder] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:37.031751 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 954/1900] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 5 12:17:36 2022] POST /identity/v3/projects => generated 393 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:17:37.036988 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31d5fd1-e450-4eec-910b-51959da7ebc5 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:37.169384 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20e3f7a-92a2-46a3-a218-fe744cdedecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:37.170285 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e3f7a-92a2-46a3-a218-fe744cdedecc admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:37.170984 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e3f7a-92a2-46a3-a218-fe744cdedecc admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:37.170984 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e3f7a-92a2-46a3-a218-fe744cdedecc admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:37.171767 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20e3f7a-92a2-46a3-a218-fe744cdedecc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:37.173774 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20e3f7a-92a2-46a3-a218-fe744cdedecc admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:37.190825 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 947/1901] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:17:36 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:17:37.190825 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20e3f7a-92a2-46a3-a218-fe744cdedecc admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:37.192822 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-e20e3f7a-92a2-46a3-a218-fe744cdedecc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:37.215666 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31d5fd1-e450-4eec-910b-51959da7ebc5 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:37.216454 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:37.228112 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fb2898-4f1e-4b6c-be22-b94cb9b8c086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:37.229092 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fb2898-4f1e-4b6c-be22-b94cb9b8c086 admin admin] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:37.229753 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fb2898-4f1e-4b6c-be22-b94cb9b8c086 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:37.230788 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fb2898-4f1e-4b6c-be22-b94cb9b8c086 admin admin] PATH_INFO: `/v3/users` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:37.231659 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fb2898-4f1e-4b6c-be22-b94cb9b8c086 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:37.236244 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fb2898-4f1e-4b6c-be22-b94cb9b8c086 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:37.277427 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 955/1902] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 5 12:17:37 2022] POST /identity/v3/users => generated 297 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:17:37.278428 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fb2898-4f1e-4b6c-be22-b94cb9b8c086 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:37.295223 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fb2898-4f1e-4b6c-be22-b94cb9b8c086 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:37.306595 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2cc665-fe76-4abe-aaf5-d4bb0f5e40fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:37.307226 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2cc665-fe76-4abe-aaf5-d4bb0f5e40fe admin admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:37.307507 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2cc665-fe76-4abe-aaf5-d4bb0f5e40fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:37.308968 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2cc665-fe76-4abe-aaf5-d4bb0f5e40fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:37.309226 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2cc665-fe76-4abe-aaf5-d4bb0f5e40fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:37.310507 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20e3f7a-92a2-46a3-a218-fe744cdedecc admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:37.310835 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2cc665-fe76-4abe-aaf5-d4bb0f5e40fe admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:37.323314 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 956/1903] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:17:37 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:17:37.324522 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2cc665-fe76-4abe-aaf5-d4bb0f5e40fe admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:37.327868 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d9dd63-111b-4a16-b70c-562cdbb3dc4f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37633bbae0c2423c81ccd61ac3a17ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:37.328724 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d9dd63-111b-4a16-b70c-562cdbb3dc4f service cinder] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:37.329109 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d9dd63-111b-4a16-b70c-562cdbb3dc4f service cinder] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:37.329518 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d9dd63-111b-4a16-b70c-562cdbb3dc4f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:37.332590 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-29d9dd63-111b-4a16-b70c-562cdbb3dc4f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:37.339556 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2cc665-fe76-4abe-aaf5-d4bb0f5e40fe admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:37.346503 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba540185-a717-466c-b88b-47922747cd90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:37.347147 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba540185-a717-466c-b88b-47922747cd90 admin admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:37.347734 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba540185-a717-466c-b88b-47922747cd90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:37.348025 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba540185-a717-466c-b88b-47922747cd90 admin admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:37.348850 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba540185-a717-466c-b88b-47922747cd90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:37.350812 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba540185-a717-466c-b88b-47922747cd90 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:37.363578 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 957/1904] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:17:37 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:17:37.364481 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba540185-a717-466c-b88b-47922747cd90 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:37.379448 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba540185-a717-466c-b88b-47922747cd90 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:37.384186 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a792f9bd-0321-4998-aadb-25f051b07923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:37.384852 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a792f9bd-0321-4998-aadb-25f051b07923 admin admin] REQUEST_METHOD: `PUT` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:37.385234 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a792f9bd-0321-4998-aadb-25f051b07923 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:37.385560 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a792f9bd-0321-4998-aadb-25f051b07923 admin admin] PATH_INFO: `/v3/projects/97e068b5e2ff483d9da7eeb88ada9ea8/users/043bbc992a034e57b40965112f5696f7/roles/ed72181e1403401facb77dcf33644757` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:37.389176 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:37.403702 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a792f9bd-0321-4998-aadb-25f051b07923 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97e068b5e2ff483d9da7eeb88ada9ea8, user_id=043bbc992a034e57b40965112f5696f7, role_id=ed72181e1403401facb77dcf33644757)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:37.406898 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a792f9bd-0321-4998-aadb-25f051b07923 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:37.432837 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 958/1905] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 5 12:17:37 2022] PUT /identity/v3/projects/97e068b5e2ff483d9da7eeb88ada9ea8/users/043bbc992a034e57b40965112f5696f7/roles/ed72181e1403401facb77dcf33644757 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:17:37.432837 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a792f9bd-0321-4998-aadb-25f051b07923 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:37.440122 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d9dd63-111b-4a16-b70c-562cdbb3dc4f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:37.446216 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d9dd63-111b-4a16-b70c-562cdbb3dc4f service cinder] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:37.458767 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 948/1906] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:17:37 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:17:37.460273 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ad1394-9e78-4622-9cc0-aad743385034 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:37.460562 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ad1394-9e78-4622-9cc0-aad743385034 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:37.460843 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ad1394-9e78-4622-9cc0-aad743385034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:37.504107 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-c1ad1394-9e78-4622-9cc0-aad743385034 None None] MFA Rules not processed for user `043bbc992a034e57b40965112f5696f7`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:17:37.505345 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-c1ad1394-9e78-4622-9cc0-aad743385034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:37.516170 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a792f9bd-0321-4998-aadb-25f051b07923 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:37.522563 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c1e541-40b6-464d-a4dc-dbed20668389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:37.523182 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c1e541-40b6-464d-a4dc-dbed20668389 admin admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:37.523461 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c1e541-40b6-464d-a4dc-dbed20668389 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:37.523849 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c1e541-40b6-464d-a4dc-dbed20668389 admin admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:37.525094 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c1e541-40b6-464d-a4dc-dbed20668389 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:37.527642 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c1e541-40b6-464d-a4dc-dbed20668389 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:37.540392 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 959/1907] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:17:37 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:17:37.545350 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c1e541-40b6-464d-a4dc-dbed20668389 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:37.556112 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c1e541-40b6-464d-a4dc-dbed20668389 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:37.561276 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18074763-7295-4852-8e58-31f5e659330a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:37.562141 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18074763-7295-4852-8e58-31f5e659330a admin admin] REQUEST_METHOD: `PUT` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:37.562427 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18074763-7295-4852-8e58-31f5e659330a admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:37.563203 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18074763-7295-4852-8e58-31f5e659330a admin admin] PATH_INFO: `/v3/projects/dadedb975bca4859842e5730c4799a5e/users/3b9ccc88d0fa49c4baedf933bd5e4b78/roles/ed72181e1403401facb77dcf33644757` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:37.579113 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18074763-7295-4852-8e58-31f5e659330a admin admin] RBAC: Authorizing `identity:create_grant(project_id=dadedb975bca4859842e5730c4799a5e, user_id=3b9ccc88d0fa49c4baedf933bd5e4b78, role_id=ed72181e1403401facb77dcf33644757)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:37.581569 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 949/1908] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:17:37 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:17:37.585315 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18074763-7295-4852-8e58-31f5e659330a admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:37.586223 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ad1394-9e78-4622-9cc0-aad743385034 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:37.597893 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 960/1909] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 5 12:17:37 2022] PUT /identity/v3/projects/dadedb975bca4859842e5730c4799a5e/users/3b9ccc88d0fa49c4baedf933bd5e4b78/roles/ed72181e1403401facb77dcf33644757 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 12:17:37.599406 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ad1394-9e78-4622-9cc0-aad743385034 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:37.615548 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd7f7b6-46f4-429d-b3e8-d4b8d652df91 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:37.615548 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd7f7b6-46f4-429d-b3e8-d4b8d652df91 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:37.615548 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd7f7b6-46f4-429d-b3e8-d4b8d652df91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:37.647941 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-9bd7f7b6-46f4-429d-b3e8-d4b8d652df91 None None] MFA Rules not processed for user `3b9ccc88d0fa49c4baedf933bd5e4b78`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:17:37.649474 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-9bd7f7b6-46f4-429d-b3e8-d4b8d652df91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:37.677626 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:37.684430 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfeab78-b7c3-4d73-ba7d-d026bb723c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:37.685453 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfeab78-b7c3-4d73-ba7d-d026bb723c2d admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:37.686195 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfeab78-b7c3-4d73-ba7d-d026bb723c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:37.686626 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfeab78-b7c3-4d73-ba7d-d026bb723c2d admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:37.687471 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfeab78-b7c3-4d73-ba7d-d026bb723c2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:37.689996 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfeab78-b7c3-4d73-ba7d-d026bb723c2d admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:37.732445 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 950/1910] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 5 12:17:37 2022] POST /identity/v3/projects => generated 379 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 12:17:37.733518 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfeab78-b7c3-4d73-ba7d-d026bb723c2d admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:37.745542 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 961/1911] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:17:37 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:17:37.746594 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd7f7b6-46f4-429d-b3e8-d4b8d652df91 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:37.769145 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd7f7b6-46f4-429d-b3e8-d4b8d652df91 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:37.827930 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:37.846583 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f44f86-986f-4aac-b8fd-44f3c5c59a18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:37.847224 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f44f86-986f-4aac-b8fd-44f3c5c59a18 admin admin] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:37.847659 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f44f86-986f-4aac-b8fd-44f3c5c59a18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:37.847942 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f44f86-986f-4aac-b8fd-44f3c5c59a18 admin admin] PATH_INFO: `/v3/projects` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:37.848591 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfeab78-b7c3-4d73-ba7d-d026bb723c2d admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:37.848710 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f44f86-986f-4aac-b8fd-44f3c5c59a18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:37.850676 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f44f86-986f-4aac-b8fd-44f3c5c59a18 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:37.853485 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e687ec0-a29c-4644-bdaf-3d5ee891029e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:37.854368 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e687ec0-a29c-4644-bdaf-3d5ee891029e admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:37.854671 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e687ec0-a29c-4644-bdaf-3d5ee891029e admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:37.855509 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e687ec0-a29c-4644-bdaf-3d5ee891029e admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:37.856169 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e687ec0-a29c-4644-bdaf-3d5ee891029e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:37.858302 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e687ec0-a29c-4644-bdaf-3d5ee891029e admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:37.886922 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 962/1912] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 5 12:17:37 2022] POST /identity/v3/projects => generated 391 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:17:37.888928 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 951/1913] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 5 12:17:37 2022] POST /identity/v3/users => generated 296 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:17:37.891101 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f44f86-986f-4aac-b8fd-44f3c5c59a18 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:37.891218 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e687ec0-a29c-4644-bdaf-3d5ee891029e admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:37.903771 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e687ec0-a29c-4644-bdaf-3d5ee891029e admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:37.995456 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b786f780-f321-4c95-9d30-aa0b81a5a215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:37.996121 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b786f780-f321-4c95-9d30-aa0b81a5a215 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:37.996403 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b786f780-f321-4c95-9d30-aa0b81a5a215 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:37.996676 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b786f780-f321-4c95-9d30-aa0b81a5a215 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:37.997692 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b786f780-f321-4c95-9d30-aa0b81a5a215 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:37.999545 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b786f780-f321-4c95-9d30-aa0b81a5a215 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:38.019668 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 952/1914] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:17:37 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:17:38.020601 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b786f780-f321-4c95-9d30-aa0b81a5a215 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:38.033731 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b786f780-f321-4c95-9d30-aa0b81a5a215 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:38.035057 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f44f86-986f-4aac-b8fd-44f3c5c59a18 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:38.041533 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46da1e7b-f2ca-40ed-b0da-fdcdd510cfed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:38.042222 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46da1e7b-f2ca-40ed-b0da-fdcdd510cfed admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:38.042685 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46da1e7b-f2ca-40ed-b0da-fdcdd510cfed admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:38.042971 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46da1e7b-f2ca-40ed-b0da-fdcdd510cfed admin admin] PATH_INFO: `/v3/projects/2f14190efed24110b7f19acb3ac51cd0/users/91e3573d21624870a703640527b760d3/roles/16e2ccc8bd1b497d8cee780c1c7df0d2` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:38.051667 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9486a596-e7b2-417b-9ad0-bfea3a38580b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:38.052627 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9486a596-e7b2-417b-9ad0-bfea3a38580b admin admin] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:38.053191 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9486a596-e7b2-417b-9ad0-bfea3a38580b admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:38.053654 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9486a596-e7b2-417b-9ad0-bfea3a38580b admin admin] PATH_INFO: `/v3/users` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:38.058184 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9486a596-e7b2-417b-9ad0-bfea3a38580b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:38.060734 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9486a596-e7b2-417b-9ad0-bfea3a38580b admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:38.072501 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46da1e7b-f2ca-40ed-b0da-fdcdd510cfed admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f14190efed24110b7f19acb3ac51cd0, user_id=91e3573d21624870a703640527b760d3, role_id=16e2ccc8bd1b497d8cee780c1c7df0d2)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:38.082872 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46da1e7b-f2ca-40ed-b0da-fdcdd510cfed admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:38.116609 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 953/1915] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 5 12:17:38 2022] PUT /identity/v3/projects/2f14190efed24110b7f19acb3ac51cd0/users/91e3573d21624870a703640527b760d3/roles/16e2ccc8bd1b497d8cee780c1c7df0d2 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:17:38.119785 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 963/1916] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 5 12:17:37 2022] POST /identity/v3/users => generated 302 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:17:38.119937 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46da1e7b-f2ca-40ed-b0da-fdcdd510cfed admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:38.123722 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9486a596-e7b2-417b-9ad0-bfea3a38580b admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:38.145391 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9486a596-e7b2-417b-9ad0-bfea3a38580b admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:38.232775 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:38.274489 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46da1e7b-f2ca-40ed-b0da-fdcdd510cfed admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:38.277629 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7715660-7113-485f-99f7-52acbe365a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:38.278611 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7715660-7113-485f-99f7-52acbe365a90 admin admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:38.279847 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7715660-7113-485f-99f7-52acbe365a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:38.279847 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7715660-7113-485f-99f7-52acbe365a90 admin admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:38.280374 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7715660-7113-485f-99f7-52acbe365a90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:38.282324 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7715660-7113-485f-99f7-52acbe365a90 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:38.285703 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a644a2-1f58-43f5-b3d0-d47b91a80c2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:38.286350 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a644a2-1f58-43f5-b3d0-d47b91a80c2e admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:38.286635 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a644a2-1f58-43f5-b3d0-d47b91a80c2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:38.286917 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a644a2-1f58-43f5-b3d0-d47b91a80c2e admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:38.287575 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a644a2-1f58-43f5-b3d0-d47b91a80c2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:38.289325 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a644a2-1f58-43f5-b3d0-d47b91a80c2e admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:38.308026 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 964/1917] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:17:38 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:17:38.309518 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7715660-7113-485f-99f7-52acbe365a90 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:38.323656 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 954/1918] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:17:38 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:17:38.333250 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a644a2-1f58-43f5-b3d0-d47b91a80c2e admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:38.335835 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7715660-7113-485f-99f7-52acbe365a90 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:38.351585 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a644a2-1f58-43f5-b3d0-d47b91a80c2e admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:38.352692 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d5fd91-1d1a-415f-a0ef-b31178bea1fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:38.355819 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d5fd91-1d1a-415f-a0ef-b31178bea1fd admin admin] REQUEST_METHOD: `PUT` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:38.356263 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d5fd91-1d1a-415f-a0ef-b31178bea1fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:38.356726 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d5fd91-1d1a-415f-a0ef-b31178bea1fd admin admin] PATH_INFO: `/v3/projects/fdadb704487b4d1cb3949bb72679cbcf/users/a0255a229c494b04aca2072081002829/roles/16e2ccc8bd1b497d8cee780c1c7df0d2` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:38.376642 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98f9781-ed6f-441d-af6f-d75b6d83bde7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:38.377385 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f9781-ed6f-441d-af6f-d75b6d83bde7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:38.377671 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f9781-ed6f-441d-af6f-d75b6d83bde7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:38.378479 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f9781-ed6f-441d-af6f-d75b6d83bde7 admin admin] PATH_INFO: `/v3/projects/2f14190efed24110b7f19acb3ac51cd0/users/91e3573d21624870a703640527b760d3/roles/16e2ccc8bd1b497d8cee780c1c7df0d2` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:38.383646 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98f9781-ed6f-441d-af6f-d75b6d83bde7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f14190efed24110b7f19acb3ac51cd0, user_id=91e3573d21624870a703640527b760d3, role_id=16e2ccc8bd1b497d8cee780c1c7df0d2)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:38.385700 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98f9781-ed6f-441d-af6f-d75b6d83bde7 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:38.406005 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d5fd91-1d1a-415f-a0ef-b31178bea1fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdadb704487b4d1cb3949bb72679cbcf, user_id=a0255a229c494b04aca2072081002829, role_id=16e2ccc8bd1b497d8cee780c1c7df0d2)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:38.412145 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d5fd91-1d1a-415f-a0ef-b31178bea1fd admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:38.423058 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 955/1919] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 5 12:17:38 2022] PUT /identity/v3/projects/2f14190efed24110b7f19acb3ac51cd0/users/91e3573d21624870a703640527b760d3/roles/16e2ccc8bd1b497d8cee780c1c7df0d2 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:17:38.424596 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0a5eeb-77ba-45d6-a21c-19adab28995b None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:38.424917 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0a5eeb-77ba-45d6-a21c-19adab28995b None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:38.425256 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0a5eeb-77ba-45d6-a21c-19adab28995b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:38.482064 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 965/1920] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 5 12:17:38 2022] PUT /identity/v3/projects/fdadb704487b4d1cb3949bb72679cbcf/users/a0255a229c494b04aca2072081002829/roles/16e2ccc8bd1b497d8cee780c1c7df0d2 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:17:38.486055 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d5fd91-1d1a-415f-a0ef-b31178bea1fd admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:38.503265 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-7c0a5eeb-77ba-45d6-a21c-19adab28995b None None] MFA Rules not processed for user `91e3573d21624870a703640527b760d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:17:38.506479 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-7c0a5eeb-77ba-45d6-a21c-19adab28995b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:38.538685 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:38.572630 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d5fd91-1d1a-415f-a0ef-b31178bea1fd admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:38.579675 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0450c0d-b3f6-407f-98a7-594de46caacd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:38.580403 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0450c0d-b3f6-407f-98a7-594de46caacd admin admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:38.580687 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0450c0d-b3f6-407f-98a7-594de46caacd admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:38.581008 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0450c0d-b3f6-407f-98a7-594de46caacd admin admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:38.581797 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0450c0d-b3f6-407f-98a7-594de46caacd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:38.583516 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0450c0d-b3f6-407f-98a7-594de46caacd admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:38.598643 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 966/1921] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:17:38 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 12:17:38.601095 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0450c0d-b3f6-407f-98a7-594de46caacd admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:38.613493 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0450c0d-b3f6-407f-98a7-594de46caacd admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:38.622086 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d4499b-5d48-4402-9a4e-7aeac931b33f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:38.622753 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d4499b-5d48-4402-9a4e-7aeac931b33f admin admin] REQUEST_METHOD: `PUT` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:38.623040 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d4499b-5d48-4402-9a4e-7aeac931b33f admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:38.623321 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d4499b-5d48-4402-9a4e-7aeac931b33f admin admin] PATH_INFO: `/v3/projects/fdadb704487b4d1cb3949bb72679cbcf/users/a0255a229c494b04aca2072081002829/roles/16e2ccc8bd1b497d8cee780c1c7df0d2` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:38.626119 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d4499b-5d48-4402-9a4e-7aeac931b33f admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdadb704487b4d1cb3949bb72679cbcf, user_id=a0255a229c494b04aca2072081002829, role_id=16e2ccc8bd1b497d8cee780c1c7df0d2)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:38.630617 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d4499b-5d48-4402-9a4e-7aeac931b33f admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:38.660690 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 967/1922] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 5 12:17:38 2022] PUT /identity/v3/projects/fdadb704487b4d1cb3949bb72679cbcf/users/a0255a229c494b04aca2072081002829/roles/16e2ccc8bd1b497d8cee780c1c7df0d2 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:17:38.662804 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 956/1923] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:17:38 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:17:38.677665 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69d865d-991d-4d0b-9fba-a4cb8e5a2f29 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:38.678206 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69d865d-991d-4d0b-9fba-a4cb8e5a2f29 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:38.679821 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69d865d-991d-4d0b-9fba-a4cb8e5a2f29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:38.707505 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0a5eeb-77ba-45d6-a21c-19adab28995b None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:38.751755 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-a69d865d-991d-4d0b-9fba-a4cb8e5a2f29 None None] MFA Rules not processed for user `a0255a229c494b04aca2072081002829`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:17:38.758368 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-a69d865d-991d-4d0b-9fba-a4cb8e5a2f29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:38.834219 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0a5eeb-77ba-45d6-a21c-19adab28995b None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:38.928943 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 968/1924] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:17:38 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:17:38.930503 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfab100-d61a-4a76-99b6-74242ab63ae2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37633bbae0c2423c81ccd61ac3a17ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:38.931141 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfab100-d61a-4a76-99b6-74242ab63ae2 service cinder] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:38.935790 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfab100-d61a-4a76-99b6-74242ab63ae2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:38.936100 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfab100-d61a-4a76-99b6-74242ab63ae2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:38.976082 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:39.051736 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfab100-d61a-4a76-99b6-74242ab63ae2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:39.053387 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfab100-d61a-4a76-99b6-74242ab63ae2 service cinder] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:39.068434 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 957/1925] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:17:38 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:17:39.166037 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69d865d-991d-4d0b-9fba-a4cb8e5a2f29 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:39.178031 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69d865d-991d-4d0b-9fba-a4cb8e5a2f29 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:39.182301 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa51ea3-a582-40a2-8aee-142a90ed2d12 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37633bbae0c2423c81ccd61ac3a17ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:39.183458 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa51ea3-a582-40a2-8aee-142a90ed2d12 service cinder] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:39.184041 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa51ea3-a582-40a2-8aee-142a90ed2d12 service cinder] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:39.184204 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa51ea3-a582-40a2-8aee-142a90ed2d12 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:39.196087 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa51ea3-a582-40a2-8aee-142a90ed2d12 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:39.197751 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa51ea3-a582-40a2-8aee-142a90ed2d12 service cinder] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:39.221890 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 969/1926] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:17:39 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:17:39.364034 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfab100-d61a-4a76-99b6-74242ab63ae2 service cinder] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:39.374482 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfab100-d61a-4a76-99b6-74242ab63ae2 service cinder] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:39.378361 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416236b4-b80d-455b-9ffc-8386466b1d79 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37633bbae0c2423c81ccd61ac3a17ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:39.385153 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416236b4-b80d-455b-9ffc-8386466b1d79 service cinder] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:39.385153 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416236b4-b80d-455b-9ffc-8386466b1d79 service cinder] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:39.385153 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416236b4-b80d-455b-9ffc-8386466b1d79 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:39.456493 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416236b4-b80d-455b-9ffc-8386466b1d79 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:39.458787 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416236b4-b80d-455b-9ffc-8386466b1d79 service cinder] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:39.472583 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 958/1927] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:17:39 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:17:39.720928 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa51ea3-a582-40a2-8aee-142a90ed2d12 service cinder] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:39.743507 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa51ea3-a582-40a2-8aee-142a90ed2d12 service cinder] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:39.759930 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb03a3ac-6e34-4a1e-be75-94dccdd26582 tempest-VolumeQuotaClassesTest-952100801 tempest-VolumeQuotaClassesTest-952100801-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e3573d21624870a703640527b760d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f14190efed24110b7f19acb3ac51cd0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:39.760786 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb03a3ac-6e34-4a1e-be75-94dccdd26582 tempest-VolumeQuotaClassesTest-952100801 tempest-VolumeQuotaClassesTest-952100801-project-admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:39.761203 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb03a3ac-6e34-4a1e-be75-94dccdd26582 tempest-VolumeQuotaClassesTest-952100801 tempest-VolumeQuotaClassesTest-952100801-project-admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:39.761599 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb03a3ac-6e34-4a1e-be75-94dccdd26582 tempest-VolumeQuotaClassesTest-952100801 tempest-VolumeQuotaClassesTest-952100801-project-admin] PATH_INFO: `/v3/domains` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:39.762355 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb03a3ac-6e34-4a1e-be75-94dccdd26582 tempest-VolumeQuotaClassesTest-952100801 tempest-VolumeQuotaClassesTest-952100801-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:17:39.763190 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb03a3ac-6e34-4a1e-be75-94dccdd26582 tempest-VolumeQuotaClassesTest-952100801 tempest-VolumeQuotaClassesTest-952100801-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:39.764963 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb03a3ac-6e34-4a1e-be75-94dccdd26582 tempest-VolumeQuotaClassesTest-952100801 tempest-VolumeQuotaClassesTest-952100801-project-admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:39.783607 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 970/1928] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Sep 5 12:17:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:17:39.790598 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416236b4-b80d-455b-9ffc-8386466b1d79 service cinder] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:39.810241 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416236b4-b80d-455b-9ffc-8386466b1d79 service cinder] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:39.817263 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf21d6d3-5a5c-4e00-882a-1328babf6018 tempest-VolumeQuotaClassesTest-952100801 tempest-VolumeQuotaClassesTest-952100801-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e3573d21624870a703640527b760d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f14190efed24110b7f19acb3ac51cd0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:39.818050 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf21d6d3-5a5c-4e00-882a-1328babf6018 tempest-VolumeQuotaClassesTest-952100801 tempest-VolumeQuotaClassesTest-952100801-project-admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:39.818335 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf21d6d3-5a5c-4e00-882a-1328babf6018 tempest-VolumeQuotaClassesTest-952100801 tempest-VolumeQuotaClassesTest-952100801-project-admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:39.818729 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf21d6d3-5a5c-4e00-882a-1328babf6018 tempest-VolumeQuotaClassesTest-952100801 tempest-VolumeQuotaClassesTest-952100801-project-admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:39.819928 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf21d6d3-5a5c-4e00-882a-1328babf6018 tempest-VolumeQuotaClassesTest-952100801 tempest-VolumeQuotaClassesTest-952100801-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:39.822893 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf21d6d3-5a5c-4e00-882a-1328babf6018 tempest-VolumeQuotaClassesTest-952100801 tempest-VolumeQuotaClassesTest-952100801-project-admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:39.875838 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 959/1929] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 5 12:17:39 2022] POST /identity/v3/projects => generated 353 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:17:39.885083 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb03a3ac-6e34-4a1e-be75-94dccdd26582 tempest-VolumeQuotaClassesTest-952100801 tempest-VolumeQuotaClassesTest-952100801-project-admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:39.907939 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb03a3ac-6e34-4a1e-be75-94dccdd26582 tempest-VolumeQuotaClassesTest-952100801 tempest-VolumeQuotaClassesTest-952100801-project-admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:39.994693 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf21d6d3-5a5c-4e00-882a-1328babf6018 tempest-VolumeQuotaClassesTest-952100801 tempest-VolumeQuotaClassesTest-952100801-project-admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:39.999358 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-cf21d6d3-5a5c-4e00-882a-1328babf6018 tempest-VolumeQuotaClassesTest-952100801 tempest-VolumeQuotaClassesTest-952100801-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:40.061490 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2af3b0-03bc-41ae-b740-0a2c3d9b5d2f tempest-VolumeQuotaClassesTest-952100801 tempest-VolumeQuotaClassesTest-952100801-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e3573d21624870a703640527b760d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f14190efed24110b7f19acb3ac51cd0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:40.063628 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2af3b0-03bc-41ae-b740-0a2c3d9b5d2f tempest-VolumeQuotaClassesTest-952100801 tempest-VolumeQuotaClassesTest-952100801-project-admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:40.064502 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2af3b0-03bc-41ae-b740-0a2c3d9b5d2f tempest-VolumeQuotaClassesTest-952100801 tempest-VolumeQuotaClassesTest-952100801-project-admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:40.065347 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2af3b0-03bc-41ae-b740-0a2c3d9b5d2f tempest-VolumeQuotaClassesTest-952100801 tempest-VolumeQuotaClassesTest-952100801-project-admin] PATH_INFO: `/v3/domains` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:40.067375 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2af3b0-03bc-41ae-b740-0a2c3d9b5d2f tempest-VolumeQuotaClassesTest-952100801 tempest-VolumeQuotaClassesTest-952100801-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:17:40.068060 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2af3b0-03bc-41ae-b740-0a2c3d9b5d2f tempest-VolumeQuotaClassesTest-952100801 tempest-VolumeQuotaClassesTest-952100801-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:40.070149 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2af3b0-03bc-41ae-b740-0a2c3d9b5d2f tempest-VolumeQuotaClassesTest-952100801 tempest-VolumeQuotaClassesTest-952100801-project-admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:40.115222 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 971/1930] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Sep 5 12:17:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:17:40.133574 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf21d6d3-5a5c-4e00-882a-1328babf6018 tempest-VolumeQuotaClassesTest-952100801 tempest-VolumeQuotaClassesTest-952100801-project-admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:40.140477 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2af3b0-03bc-41ae-b740-0a2c3d9b5d2f tempest-VolumeQuotaClassesTest-952100801 tempest-VolumeQuotaClassesTest-952100801-project-admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:40.143864 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54efb800-e4c4-41f4-975f-c53245afc665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:40.144296 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-7f2af3b0-03bc-41ae-b740-0a2c3d9b5d2f tempest-VolumeQuotaClassesTest-952100801 tempest-VolumeQuotaClassesTest-952100801-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:40.145064 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54efb800-e4c4-41f4-975f-c53245afc665 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:40.145347 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54efb800-e4c4-41f4-975f-c53245afc665 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:40.145623 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54efb800-e4c4-41f4-975f-c53245afc665 admin admin] PATH_INFO: `/v3/users/6861bf8202de4606a286038224c21811` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:40.147350 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54efb800-e4c4-41f4-975f-c53245afc665 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6861bf8202de4606a286038224c21811)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:40.157199 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54efb800-e4c4-41f4-975f-c53245afc665 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:40.171814 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2af3b0-03bc-41ae-b740-0a2c3d9b5d2f tempest-VolumeQuotaClassesTest-952100801 tempest-VolumeQuotaClassesTest-952100801-project-admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:40.180543 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15e788c-f849-4edf-a42f-ec92b111bdb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:40.181604 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15e788c-f849-4edf-a42f-ec92b111bdb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:40.182076 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15e788c-f849-4edf-a42f-ec92b111bdb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:40.182679 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15e788c-f849-4edf-a42f-ec92b111bdb2 admin admin] PATH_INFO: `/v3/users/bc9d07543bd244aab7995cd4a4110775` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:40.185324 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15e788c-f849-4edf-a42f-ec92b111bdb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc9d07543bd244aab7995cd4a4110775)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:40.188571 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15e788c-f849-4edf-a42f-ec92b111bdb2 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:40.192639 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:40.223524 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:40.237577 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-54efb800-e4c4-41f4-975f-c53245afc665 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6861bf8202de4606a286038224c21811'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:40.238473 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-54efb800-e4c4-41f4-975f-c53245afc665 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6861bf8202de4606a286038224c21811'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:40.253228 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-54efb800-e4c4-41f4-975f-c53245afc665 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6861bf8202de4606a286038224c21811'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:40.254298 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-54efb800-e4c4-41f4-975f-c53245afc665 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6861bf8202de4606a286038224c21811'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:40.270558 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-d15e788c-f849-4edf-a42f-ec92b111bdb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc9d07543bd244aab7995cd4a4110775'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:40.271279 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-d15e788c-f849-4edf-a42f-ec92b111bdb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc9d07543bd244aab7995cd4a4110775'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:40.275341 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-54efb800-e4c4-41f4-975f-c53245afc665 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6861bf8202de4606a286038224c21811'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:40.283019 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-d15e788c-f849-4edf-a42f-ec92b111bdb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc9d07543bd244aab7995cd4a4110775'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:40.283768 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-d15e788c-f849-4edf-a42f-ec92b111bdb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc9d07543bd244aab7995cd4a4110775'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:40.303574 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 960/1931] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 5 12:17:39 2022] DELETE /identity/v3/users/6861bf8202de4606a286038224c21811 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:17:40.304555 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54efb800-e4c4-41f4-975f-c53245afc665 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:40.306330 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-54efb800-e4c4-41f4-975f-c53245afc665 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:40.307641 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-d15e788c-f849-4edf-a42f-ec92b111bdb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc9d07543bd244aab7995cd4a4110775'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:40.326530 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 972/1932] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 5 12:17:40 2022] DELETE /identity/v3/users/bc9d07543bd244aab7995cd4a4110775 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 12:17:40.328144 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa950c85-b764-4e32-8d39-6838b230da60 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:40.328428 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa950c85-b764-4e32-8d39-6838b230da60 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:40.328700 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa950c85-b764-4e32-8d39-6838b230da60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:40.355762 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-aa950c85-b764-4e32-8d39-6838b230da60 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:17:40.357175 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-aa950c85-b764-4e32-8d39-6838b230da60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:40.473759 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 973/1933] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:17:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:17:40.475654 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc94de84-01d2-4a5d-af73-3da5f472bb24 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:40.476123 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc94de84-01d2-4a5d-af73-3da5f472bb24 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:40.476579 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc94de84-01d2-4a5d-af73-3da5f472bb24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:40.477759 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54efb800-e4c4-41f4-975f-c53245afc665 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:40.501053 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-bc94de84-01d2-4a5d-af73-3da5f472bb24 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:17:40.502866 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-bc94de84-01d2-4a5d-af73-3da5f472bb24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:40.519963 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 974/1934] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:17:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:17:40.520667 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc94de84-01d2-4a5d-af73-3da5f472bb24 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:40.523821 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-bc94de84-01d2-4a5d-af73-3da5f472bb24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:40.585055 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e40c3ae-0738-4b0d-9c95-b5b4da88d31a tempest-VolumeQuotaClassesTest-952100801 tempest-VolumeQuotaClassesTest-952100801-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91e3573d21624870a703640527b760d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f14190efed24110b7f19acb3ac51cd0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:40.585808 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e40c3ae-0738-4b0d-9c95-b5b4da88d31a tempest-VolumeQuotaClassesTest-952100801 tempest-VolumeQuotaClassesTest-952100801-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:40.586162 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e40c3ae-0738-4b0d-9c95-b5b4da88d31a tempest-VolumeQuotaClassesTest-952100801 tempest-VolumeQuotaClassesTest-952100801-project-admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:40.586510 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e40c3ae-0738-4b0d-9c95-b5b4da88d31a tempest-VolumeQuotaClassesTest-952100801 tempest-VolumeQuotaClassesTest-952100801-project-admin] PATH_INFO: `/v3/projects/b29425afcf5c439691bfc7b34d0aaa8e` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:40.587743 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e40c3ae-0738-4b0d-9c95-b5b4da88d31a tempest-VolumeQuotaClassesTest-952100801 tempest-VolumeQuotaClassesTest-952100801-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b29425afcf5c439691bfc7b34d0aaa8e)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:40.589870 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e40c3ae-0738-4b0d-9c95-b5b4da88d31a tempest-VolumeQuotaClassesTest-952100801 tempest-VolumeQuotaClassesTest-952100801-project-admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:40.626502 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc94de84-01d2-4a5d-af73-3da5f472bb24 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:40.631140 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fa16b9-570a-4f2d-ac8e-3d7e4250314b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4994b4faa4ec4aa088f3dc32c9c5614d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:40.632288 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fa16b9-570a-4f2d-ac8e-3d7e4250314b service neutron] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:40.632577 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fa16b9-570a-4f2d-ac8e-3d7e4250314b service neutron] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:40.633399 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fa16b9-570a-4f2d-ac8e-3d7e4250314b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:40.658128 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fa16b9-570a-4f2d-ac8e-3d7e4250314b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:40.660730 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fa16b9-570a-4f2d-ac8e-3d7e4250314b service neutron] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:40.675947 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 975/1935] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:17:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:17:40.677104 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fa16b9-570a-4f2d-ac8e-3d7e4250314b service neutron] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:40.679375 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-5e40c3ae-0738-4b0d-9c95-b5b4da88d31a tempest-VolumeQuotaClassesTest-952100801 tempest-VolumeQuotaClassesTest-952100801-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b29425afcf5c439691bfc7b34d0aaa8e', 'request_id': 'req-5e40c3ae-0738-4b0d-9c95-b5b4da88d31a'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:40.689822 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fa16b9-570a-4f2d-ac8e-3d7e4250314b service neutron] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:40.694459 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-5e40c3ae-0738-4b0d-9c95-b5b4da88d31a tempest-VolumeQuotaClassesTest-952100801 tempest-VolumeQuotaClassesTest-952100801-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b29425afcf5c439691bfc7b34d0aaa8e', 'request_id': 'req-5e40c3ae-0738-4b0d-9c95-b5b4da88d31a'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:40.704189 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-5e40c3ae-0738-4b0d-9c95-b5b4da88d31a tempest-VolumeQuotaClassesTest-952100801 tempest-VolumeQuotaClassesTest-952100801-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b29425afcf5c439691bfc7b34d0aaa8e', 'request_id': 'req-5e40c3ae-0738-4b0d-9c95-b5b4da88d31a'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:40.707324 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:40.708704 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:40.723119 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-5e40c3ae-0738-4b0d-9c95-b5b4da88d31a tempest-VolumeQuotaClassesTest-952100801 tempest-VolumeQuotaClassesTest-952100801-project-admin] The token cache is being invalidate because project b29425afcf5c439691bfc7b34d0aaa8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:17:40.723848 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-5e40c3ae-0738-4b0d-9c95-b5b4da88d31a tempest-VolumeQuotaClassesTest-952100801 tempest-VolumeQuotaClassesTest-952100801-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:40.739816 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-5e40c3ae-0738-4b0d-9c95-b5b4da88d31a tempest-VolumeQuotaClassesTest-952100801 tempest-VolumeQuotaClassesTest-952100801-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:40.742443 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 961/1936] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 5 12:17:40 2022] DELETE /identity/v3/projects/b29425afcf5c439691bfc7b34d0aaa8e => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:17:40.747719 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b918d77-ef19-452d-8f7e-452a7102c016 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:40.766182 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b918d77-ef19-452d-8f7e-452a7102c016 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:40.766530 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b918d77-ef19-452d-8f7e-452a7102c016 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:40.768496 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 962/1937] 10.222.0.50 () {54 vars in 921 bytes} [Mon Sep 5 12:17:40 2022] GET /identity => generated 270 bytes in 25 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:17:40.801069 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfc578a-7763-4928-9a68-a3ad70878c6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4994b4faa4ec4aa088f3dc32c9c5614d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:40.805081 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfc578a-7763-4928-9a68-a3ad70878c6c service neutron] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:40.805587 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfc578a-7763-4928-9a68-a3ad70878c6c service neutron] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:40.806043 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfc578a-7763-4928-9a68-a3ad70878c6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:40.811126 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-6cfc578a-7763-4928-9a68-a3ad70878c6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:40.813027 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216c8948-1f43-4b9a-be41-b2a93d3699ad None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:40.813445 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216c8948-1f43-4b9a-be41-b2a93d3699ad None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:40.813724 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216c8948-1f43-4b9a-be41-b2a93d3699ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:40.850399 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-216c8948-1f43-4b9a-be41-b2a93d3699ad None None] MFA Rules not processed for user `cb060ff495bc4abb83ff88992fb7be09`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:17:40.851645 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-216c8948-1f43-4b9a-be41-b2a93d3699ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:40.953029 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 963/1938] 10.222.0.50 () {58 vars in 1018 bytes} [Mon Sep 5 12:17:40 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:17:40.954665 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfc578a-7763-4928-9a68-a3ad70878c6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:40.955242 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfc578a-7763-4928-9a68-a3ad70878c6c service neutron] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:40.990138 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216c8948-1f43-4b9a-be41-b2a93d3699ad None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:40.990138 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-216c8948-1f43-4b9a-be41-b2a93d3699ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:40.990509 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 976/1939] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:17:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:17:41.020427 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216c8948-1f43-4b9a-be41-b2a93d3699ad None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:41.029089 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346a98fd-df3e-4dfa-ae27-49097aaa99af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb060ff495bc4abb83ff88992fb7be09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:41.035255 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346a98fd-df3e-4dfa-ae27-49097aaa99af service nova] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:41.035787 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346a98fd-df3e-4dfa-ae27-49097aaa99af service nova] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:41.036729 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346a98fd-df3e-4dfa-ae27-49097aaa99af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:41.052397 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346a98fd-df3e-4dfa-ae27-49097aaa99af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:41.055046 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346a98fd-df3e-4dfa-ae27-49097aaa99af service nova] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:41.088633 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 964/1940] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:17:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 12:17:41.256570 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfc578a-7763-4928-9a68-a3ad70878c6c service neutron] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:41.259007 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-6cfc578a-7763-4928-9a68-a3ad70878c6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:41.296684 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfc578a-7763-4928-9a68-a3ad70878c6c service neutron] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:41.316956 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c3e0ed-5e21-44ae-9f82-7460a9db7171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:41.317632 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c3e0ed-5e21-44ae-9f82-7460a9db7171 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:41.317915 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c3e0ed-5e21-44ae-9f82-7460a9db7171 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:41.318639 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c3e0ed-5e21-44ae-9f82-7460a9db7171 admin admin] PATH_INFO: `/v3/projects/2d8271c8507944a888d04bce281dd895` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:41.324783 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c3e0ed-5e21-44ae-9f82-7460a9db7171 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d8271c8507944a888d04bce281dd895)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:41.324783 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c3e0ed-5e21-44ae-9f82-7460a9db7171 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:41.342666 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346a98fd-df3e-4dfa-ae27-49097aaa99af service nova] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:41.344254 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-346a98fd-df3e-4dfa-ae27-49097aaa99af service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:41.368658 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346a98fd-df3e-4dfa-ae27-49097aaa99af service nova] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:41.374316 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1d7e94-4322-4dad-84e7-62606618e73b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:41.375491 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1d7e94-4322-4dad-84e7-62606618e73b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:41.375879 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1d7e94-4322-4dad-84e7-62606618e73b admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:41.376297 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1d7e94-4322-4dad-84e7-62606618e73b admin admin] PATH_INFO: `/v3/users/043bbc992a034e57b40965112f5696f7` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:41.377771 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1d7e94-4322-4dad-84e7-62606618e73b admin admin] RBAC: Authorizing `identity:delete_user(user_id=043bbc992a034e57b40965112f5696f7)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:41.381286 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1d7e94-4322-4dad-84e7-62606618e73b admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:41.452041 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-19c3e0ed-5e21-44ae-9f82-7460a9db7171 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d8271c8507944a888d04bce281dd895', 'request_id': 'req-19c3e0ed-5e21-44ae-9f82-7460a9db7171'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:41.466252 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-19c3e0ed-5e21-44ae-9f82-7460a9db7171 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d8271c8507944a888d04bce281dd895', 'request_id': 'req-19c3e0ed-5e21-44ae-9f82-7460a9db7171'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:41.469436 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-7a1d7e94-4322-4dad-84e7-62606618e73b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '043bbc992a034e57b40965112f5696f7'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:41.470466 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-7a1d7e94-4322-4dad-84e7-62606618e73b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '043bbc992a034e57b40965112f5696f7'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:41.477022 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-19c3e0ed-5e21-44ae-9f82-7460a9db7171 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d8271c8507944a888d04bce281dd895', 'request_id': 'req-19c3e0ed-5e21-44ae-9f82-7460a9db7171'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:41.482967 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-7a1d7e94-4322-4dad-84e7-62606618e73b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '043bbc992a034e57b40965112f5696f7'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:41.483707 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-7a1d7e94-4322-4dad-84e7-62606618e73b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '043bbc992a034e57b40965112f5696f7'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:41.502576 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-7a1d7e94-4322-4dad-84e7-62606618e73b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '043bbc992a034e57b40965112f5696f7'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:41.503544 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-19c3e0ed-5e21-44ae-9f82-7460a9db7171 admin admin] The token cache is being invalidate because project 2d8271c8507944a888d04bce281dd895 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:17:41.504613 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-19c3e0ed-5e21-44ae-9f82-7460a9db7171 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:41.506505 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-19c3e0ed-5e21-44ae-9f82-7460a9db7171 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:41.512796 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 977/1941] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 5 12:17:41 2022] DELETE /identity/v3/projects/2d8271c8507944a888d04bce281dd895 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 12:17:41.516525 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c3e0ed-5e21-44ae-9f82-7460a9db7171 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:41.520273 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-19c3e0ed-5e21-44ae-9f82-7460a9db7171 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:41.521633 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 965/1942] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 5 12:17:41 2022] DELETE /identity/v3/users/043bbc992a034e57b40965112f5696f7 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 12:17:41.529745 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76bac9b-27ed-45fb-9494-48ab71dfd673 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:41.530030 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76bac9b-27ed-45fb-9494-48ab71dfd673 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:41.531535 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76bac9b-27ed-45fb-9494-48ab71dfd673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:41.585682 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-f76bac9b-27ed-45fb-9494-48ab71dfd673 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:17:41.588723 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-f76bac9b-27ed-45fb-9494-48ab71dfd673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:41.673371 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:41.690759 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:41.705810 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c3e0ed-5e21-44ae-9f82-7460a9db7171 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:41.758884 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 966/1943] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:17:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:17:41.772054 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76bac9b-27ed-45fb-9494-48ab71dfd673 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:41.773483 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-f76bac9b-27ed-45fb-9494-48ab71dfd673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:41.862353 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f48be7-a630-4c7a-8b54-e1113176fda4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:41.863009 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f48be7-a630-4c7a-8b54-e1113176fda4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:41.863290 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f48be7-a630-4c7a-8b54-e1113176fda4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:41.863569 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f48be7-a630-4c7a-8b54-e1113176fda4 admin admin] PATH_INFO: `/v3/users/579590fb8e184836a2c3526a031bc83c` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:41.868260 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f48be7-a630-4c7a-8b54-e1113176fda4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=579590fb8e184836a2c3526a031bc83c)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:41.870203 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f48be7-a630-4c7a-8b54-e1113176fda4 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:41.899200 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76bac9b-27ed-45fb-9494-48ab71dfd673 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:41.910373 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87293228-e583-4ea9-a243-8ae56cc92ec2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4994b4faa4ec4aa088f3dc32c9c5614d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:41.911181 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87293228-e583-4ea9-a243-8ae56cc92ec2 service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:41.915379 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87293228-e583-4ea9-a243-8ae56cc92ec2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:41.915752 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87293228-e583-4ea9-a243-8ae56cc92ec2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:41.939988 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87293228-e583-4ea9-a243-8ae56cc92ec2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:41.942061 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87293228-e583-4ea9-a243-8ae56cc92ec2 service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:41.990394 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 967/1944] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:17:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:17:41.990394 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87293228-e583-4ea9-a243-8ae56cc92ec2 service neutron] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:41.999878 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-87293228-e583-4ea9-a243-8ae56cc92ec2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:42.006971 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-52f48be7-a630-4c7a-8b54-e1113176fda4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '579590fb8e184836a2c3526a031bc83c'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:42.007979 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-52f48be7-a630-4c7a-8b54-e1113176fda4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '579590fb8e184836a2c3526a031bc83c'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:42.029495 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-52f48be7-a630-4c7a-8b54-e1113176fda4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '579590fb8e184836a2c3526a031bc83c'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:42.030213 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-52f48be7-a630-4c7a-8b54-e1113176fda4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '579590fb8e184836a2c3526a031bc83c'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:42.035968 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87293228-e583-4ea9-a243-8ae56cc92ec2 service neutron] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:42.050064 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ba3e8b-0ee8-45ee-9e5f-2be07ecf5921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:42.050738 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ba3e8b-0ee8-45ee-9e5f-2be07ecf5921 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:42.051037 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ba3e8b-0ee8-45ee-9e5f-2be07ecf5921 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:42.051311 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ba3e8b-0ee8-45ee-9e5f-2be07ecf5921 admin admin] PATH_INFO: `/v3/projects/d410ae718ff44838833d66347af8ef05` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:42.055273 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ba3e8b-0ee8-45ee-9e5f-2be07ecf5921 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d410ae718ff44838833d66347af8ef05)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:42.057304 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ba3e8b-0ee8-45ee-9e5f-2be07ecf5921 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:42.060490 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-52f48be7-a630-4c7a-8b54-e1113176fda4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '579590fb8e184836a2c3526a031bc83c'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:42.088522 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 978/1945] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 5 12:17:41 2022] DELETE /identity/v3/users/579590fb8e184836a2c3526a031bc83c => generated 0 bytes in 572 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:17:42.216160 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-18ba3e8b-0ee8-45ee-9e5f-2be07ecf5921 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd410ae718ff44838833d66347af8ef05', 'request_id': 'req-18ba3e8b-0ee8-45ee-9e5f-2be07ecf5921'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:42.236031 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-18ba3e8b-0ee8-45ee-9e5f-2be07ecf5921 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd410ae718ff44838833d66347af8ef05', 'request_id': 'req-18ba3e8b-0ee8-45ee-9e5f-2be07ecf5921'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:42.250390 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-18ba3e8b-0ee8-45ee-9e5f-2be07ecf5921 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd410ae718ff44838833d66347af8ef05', 'request_id': 'req-18ba3e8b-0ee8-45ee-9e5f-2be07ecf5921'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:42.269660 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-18ba3e8b-0ee8-45ee-9e5f-2be07ecf5921 admin admin] The token cache is being invalidate because project d410ae718ff44838833d66347af8ef05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:17:42.270135 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-18ba3e8b-0ee8-45ee-9e5f-2be07ecf5921 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:42.271820 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-18ba3e8b-0ee8-45ee-9e5f-2be07ecf5921 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:42.275598 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 968/1946] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 5 12:17:41 2022] DELETE /identity/v3/projects/d410ae718ff44838833d66347af8ef05 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:17:42.279778 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f48be7-a630-4c7a-8b54-e1113176fda4 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:42.282500 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-52f48be7-a630-4c7a-8b54-e1113176fda4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:42.454001 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f48be7-a630-4c7a-8b54-e1113176fda4 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:42.490900 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:42.597433 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ca4322-4a5d-45e5-8fbb-d9c3e428f348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:42.598517 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ca4322-4a5d-45e5-8fbb-d9c3e428f348 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:42.599032 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ca4322-4a5d-45e5-8fbb-d9c3e428f348 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:42.600043 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ca4322-4a5d-45e5-8fbb-d9c3e428f348 admin admin] PATH_INFO: `/v3/users/18e722161d214cb1b5e1c7b2dc752d95` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:42.602508 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ca4322-4a5d-45e5-8fbb-d9c3e428f348 admin admin] RBAC: Authorizing `identity:delete_user(user_id=18e722161d214cb1b5e1c7b2dc752d95)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:42.606167 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ca4322-4a5d-45e5-8fbb-d9c3e428f348 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:42.657233 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ba3e8b-0ee8-45ee-9e5f-2be07ecf5921 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:42.659970 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-18ba3e8b-0ee8-45ee-9e5f-2be07ecf5921 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:42.685426 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ba3e8b-0ee8-45ee-9e5f-2be07ecf5921 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:42.699448 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d1e957-64d1-4e91-9cde-cca47787cb5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:42.700115 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d1e957-64d1-4e91-9cde-cca47787cb5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:42.700448 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d1e957-64d1-4e91-9cde-cca47787cb5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:42.701933 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d1e957-64d1-4e91-9cde-cca47787cb5c admin admin] PATH_INFO: `/v3/projects/1178f5f9038143489c06038500c6cb99` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:42.703762 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d1e957-64d1-4e91-9cde-cca47787cb5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1178f5f9038143489c06038500c6cb99)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:42.706004 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d1e957-64d1-4e91-9cde-cca47787cb5c admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:42.710806 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-49ca4322-4a5d-45e5-8fbb-d9c3e428f348 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18e722161d214cb1b5e1c7b2dc752d95'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:42.711561 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-49ca4322-4a5d-45e5-8fbb-d9c3e428f348 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18e722161d214cb1b5e1c7b2dc752d95'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:42.743168 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-49ca4322-4a5d-45e5-8fbb-d9c3e428f348 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18e722161d214cb1b5e1c7b2dc752d95'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:42.743915 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-49ca4322-4a5d-45e5-8fbb-d9c3e428f348 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18e722161d214cb1b5e1c7b2dc752d95'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:42.774528 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-53d1e957-64d1-4e91-9cde-cca47787cb5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1178f5f9038143489c06038500c6cb99', 'request_id': 'req-53d1e957-64d1-4e91-9cde-cca47787cb5c'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:42.779634 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-49ca4322-4a5d-45e5-8fbb-d9c3e428f348 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18e722161d214cb1b5e1c7b2dc752d95'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:42.786611 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-53d1e957-64d1-4e91-9cde-cca47787cb5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1178f5f9038143489c06038500c6cb99', 'request_id': 'req-53d1e957-64d1-4e91-9cde-cca47787cb5c'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:42.802663 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-53d1e957-64d1-4e91-9cde-cca47787cb5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1178f5f9038143489c06038500c6cb99', 'request_id': 'req-53d1e957-64d1-4e91-9cde-cca47787cb5c'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:42.808839 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 979/1947] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 5 12:17:42 2022] DELETE /identity/v3/users/18e722161d214cb1b5e1c7b2dc752d95 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:17:42.809045 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:42.811551 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ca4322-4a5d-45e5-8fbb-d9c3e428f348 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:42.813354 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-49ca4322-4a5d-45e5-8fbb-d9c3e428f348 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:42.847494 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-53d1e957-64d1-4e91-9cde-cca47787cb5c admin admin] The token cache is being invalidate because project 1178f5f9038143489c06038500c6cb99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:17:42.847845 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-53d1e957-64d1-4e91-9cde-cca47787cb5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:42.848915 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-53d1e957-64d1-4e91-9cde-cca47787cb5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:42.853403 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 969/1948] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 5 12:17:42 2022] DELETE /identity/v3/projects/1178f5f9038143489c06038500c6cb99 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 12:17:42.860570 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cca7327-818f-4c14-b2ab-9b8cb593696f None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:42.860857 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cca7327-818f-4c14-b2ab-9b8cb593696f None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:42.861275 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cca7327-818f-4c14-b2ab-9b8cb593696f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:42.911898 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-1cca7327-818f-4c14-b2ab-9b8cb593696f None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:17:42.916485 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-1cca7327-818f-4c14-b2ab-9b8cb593696f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:42.944363 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ca4322-4a5d-45e5-8fbb-d9c3e428f348 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:42.950960 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 970/1949] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:17:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:17:42.965476 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52981148-4c44-4ddd-a20c-b2b5097ff14b None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:42.965834 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52981148-4c44-4ddd-a20c-b2b5097ff14b None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:42.966091 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52981148-4c44-4ddd-a20c-b2b5097ff14b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:42.971513 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b87f13-af82-4353-aa5e-8928c4df7ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:42.973253 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b87f13-af82-4353-aa5e-8928c4df7ca0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:42.973573 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b87f13-af82-4353-aa5e-8928c4df7ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:42.974279 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b87f13-af82-4353-aa5e-8928c4df7ca0 admin admin] PATH_INFO: `/v3/projects/97e068b5e2ff483d9da7eeb88ada9ea8` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:42.975474 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b87f13-af82-4353-aa5e-8928c4df7ca0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97e068b5e2ff483d9da7eeb88ada9ea8)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:42.977528 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b87f13-af82-4353-aa5e-8928c4df7ca0 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:43.002631 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-52981148-4c44-4ddd-a20c-b2b5097ff14b None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:17:43.004140 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-52981148-4c44-4ddd-a20c-b2b5097ff14b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:43.015126 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 971/1950] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:17:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:17:43.020264 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52981148-4c44-4ddd-a20c-b2b5097ff14b None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:43.030680 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52981148-4c44-4ddd-a20c-b2b5097ff14b None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:43.051344 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:43.058457 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-d6b87f13-af82-4353-aa5e-8928c4df7ca0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97e068b5e2ff483d9da7eeb88ada9ea8', 'request_id': 'req-d6b87f13-af82-4353-aa5e-8928c4df7ca0'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:43.071061 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-d6b87f13-af82-4353-aa5e-8928c4df7ca0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97e068b5e2ff483d9da7eeb88ada9ea8', 'request_id': 'req-d6b87f13-af82-4353-aa5e-8928c4df7ca0'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:43.082754 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-d6b87f13-af82-4353-aa5e-8928c4df7ca0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97e068b5e2ff483d9da7eeb88ada9ea8', 'request_id': 'req-d6b87f13-af82-4353-aa5e-8928c4df7ca0'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:43.098607 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-d6b87f13-af82-4353-aa5e-8928c4df7ca0 admin admin] The token cache is being invalidate because project 97e068b5e2ff483d9da7eeb88ada9ea8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:17:43.099239 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-d6b87f13-af82-4353-aa5e-8928c4df7ca0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:43.100136 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-d6b87f13-af82-4353-aa5e-8928c4df7ca0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:43.102613 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 980/1951] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 5 12:17:42 2022] DELETE /identity/v3/projects/97e068b5e2ff483d9da7eeb88ada9ea8 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:17:43.107780 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b87f13-af82-4353-aa5e-8928c4df7ca0 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:43.109563 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-d6b87f13-af82-4353-aa5e-8928c4df7ca0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:43.123174 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c0dff6-2f3b-4816-96a7-a6948ac5d78b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:43.123997 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c0dff6-2f3b-4816-96a7-a6948ac5d78b admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:43.124430 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c0dff6-2f3b-4816-96a7-a6948ac5d78b admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:43.124726 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c0dff6-2f3b-4816-96a7-a6948ac5d78b admin admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:43.125390 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c0dff6-2f3b-4816-96a7-a6948ac5d78b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:17:43.125824 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c0dff6-2f3b-4816-96a7-a6948ac5d78b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:43.127942 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c0dff6-2f3b-4816-96a7-a6948ac5d78b admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:43.142944 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 972/1952] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Sep 5 12:17:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:17:43.147190 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c0dff6-2f3b-4816-96a7-a6948ac5d78b admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:43.149139 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-71c0dff6-2f3b-4816-96a7-a6948ac5d78b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:43.161520 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c0dff6-2f3b-4816-96a7-a6948ac5d78b admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:43.168194 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d98c69f-e0c6-4e0e-b118-46920da4009f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:43.168838 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d98c69f-e0c6-4e0e-b118-46920da4009f admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:43.169387 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d98c69f-e0c6-4e0e-b118-46920da4009f admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:43.169693 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d98c69f-e0c6-4e0e-b118-46920da4009f admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:43.170337 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d98c69f-e0c6-4e0e-b118-46920da4009f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:43.172291 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d98c69f-e0c6-4e0e-b118-46920da4009f admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:43.198301 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b87f13-af82-4353-aa5e-8928c4df7ca0 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:43.209373 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577c757d-818d-494a-8c3c-6cf03c1b112a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:43.210053 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577c757d-818d-494a-8c3c-6cf03c1b112a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:43.210401 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577c757d-818d-494a-8c3c-6cf03c1b112a admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:43.210609 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577c757d-818d-494a-8c3c-6cf03c1b112a admin admin] PATH_INFO: `/v3/users/91e3573d21624870a703640527b760d3` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:43.211427 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 973/1953] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 5 12:17:43 2022] POST /identity/v3/projects => generated 377 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 12:17:43.212866 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d98c69f-e0c6-4e0e-b118-46920da4009f admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:43.215105 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577c757d-818d-494a-8c3c-6cf03c1b112a admin admin] RBAC: Authorizing `identity:delete_user(user_id=91e3573d21624870a703640527b760d3)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:43.217109 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577c757d-818d-494a-8c3c-6cf03c1b112a admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:43.219605 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-9d98c69f-e0c6-4e0e-b118-46920da4009f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:43.275331 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-577c757d-818d-494a-8c3c-6cf03c1b112a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91e3573d21624870a703640527b760d3'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:43.276016 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-577c757d-818d-494a-8c3c-6cf03c1b112a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91e3573d21624870a703640527b760d3'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:43.284071 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-577c757d-818d-494a-8c3c-6cf03c1b112a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91e3573d21624870a703640527b760d3'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:43.284706 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-577c757d-818d-494a-8c3c-6cf03c1b112a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91e3573d21624870a703640527b760d3'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:43.296487 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d98c69f-e0c6-4e0e-b118-46920da4009f admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:43.297951 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-577c757d-818d-494a-8c3c-6cf03c1b112a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91e3573d21624870a703640527b760d3'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:43.302191 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0eb3db-b26a-47f2-b07d-fda8f4d31f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:43.302849 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0eb3db-b26a-47f2-b07d-fda8f4d31f59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:43.303135 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0eb3db-b26a-47f2-b07d-fda8f4d31f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:43.303413 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0eb3db-b26a-47f2-b07d-fda8f4d31f59 admin admin] PATH_INFO: `/v3/projects/28c43658f3254eb0b215b1dff7966538` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:43.304688 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0eb3db-b26a-47f2-b07d-fda8f4d31f59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=28c43658f3254eb0b215b1dff7966538)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:43.306679 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0eb3db-b26a-47f2-b07d-fda8f4d31f59 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:43.313518 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 981/1954] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 5 12:17:43 2022] DELETE /identity/v3/users/91e3573d21624870a703640527b760d3 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 12:17:43.314404 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577c757d-818d-494a-8c3c-6cf03c1b112a admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:43.315941 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-577c757d-818d-494a-8c3c-6cf03c1b112a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:43.386450 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-5a0eb3db-b26a-47f2-b07d-fda8f4d31f59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28c43658f3254eb0b215b1dff7966538', 'request_id': 'req-5a0eb3db-b26a-47f2-b07d-fda8f4d31f59'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:43.390834 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:43.396317 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:43.400638 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-5a0eb3db-b26a-47f2-b07d-fda8f4d31f59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28c43658f3254eb0b215b1dff7966538', 'request_id': 'req-5a0eb3db-b26a-47f2-b07d-fda8f4d31f59'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:43.411336 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-5a0eb3db-b26a-47f2-b07d-fda8f4d31f59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28c43658f3254eb0b215b1dff7966538', 'request_id': 'req-5a0eb3db-b26a-47f2-b07d-fda8f4d31f59'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:43.421069 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577c757d-818d-494a-8c3c-6cf03c1b112a admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:43.429846 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-5a0eb3db-b26a-47f2-b07d-fda8f4d31f59 admin admin] The token cache is being invalidate because project 28c43658f3254eb0b215b1dff7966538 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:17:43.430141 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-5a0eb3db-b26a-47f2-b07d-fda8f4d31f59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:43.430816 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-5a0eb3db-b26a-47f2-b07d-fda8f4d31f59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:43.433562 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 974/1955] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 5 12:17:43 2022] DELETE /identity/v3/projects/28c43658f3254eb0b215b1dff7966538 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:17:43.438579 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdb6d9f-4fda-4360-ab08-46d051826912 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:43.439327 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdb6d9f-4fda-4360-ab08-46d051826912 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:43.439671 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdb6d9f-4fda-4360-ab08-46d051826912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:43.466044 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-8cdb6d9f-4fda-4360-ab08-46d051826912 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:17:43.467269 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-8cdb6d9f-4fda-4360-ab08-46d051826912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:43.517315 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b25a17e-1087-4f15-ac05-a51796f1d1b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:43.518117 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b25a17e-1087-4f15-ac05-a51796f1d1b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:43.524837 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b25a17e-1087-4f15-ac05-a51796f1d1b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:43.533232 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b25a17e-1087-4f15-ac05-a51796f1d1b8 admin admin] PATH_INFO: `/v3/users` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:43.534348 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b25a17e-1087-4f15-ac05-a51796f1d1b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:43.536444 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b25a17e-1087-4f15-ac05-a51796f1d1b8 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:43.569238 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 975/1956] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:17:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:17:43.585709 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 982/1957] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 5 12:17:43 2022] POST /identity/v3/users => generated 289 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:17:43.585931 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c952b0bc-bf62-4a31-97d4-1726fcd1d82b None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:43.585931 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c952b0bc-bf62-4a31-97d4-1726fcd1d82b None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:43.585931 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c952b0bc-bf62-4a31-97d4-1726fcd1d82b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:43.587787 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b25a17e-1087-4f15-ac05-a51796f1d1b8 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:43.592300 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-2b25a17e-1087-4f15-ac05-a51796f1d1b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:43.617304 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b25a17e-1087-4f15-ac05-a51796f1d1b8 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:43.629868 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f7a7c0-09f7-4be0-b4e8-0e678e175751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:43.630496 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f7a7c0-09f7-4be0-b4e8-0e678e175751 admin admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:43.630778 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f7a7c0-09f7-4be0-b4e8-0e678e175751 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:43.631112 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f7a7c0-09f7-4be0-b4e8-0e678e175751 admin admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:43.631760 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f7a7c0-09f7-4be0-b4e8-0e678e175751 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:43.634991 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-c952b0bc-bf62-4a31-97d4-1726fcd1d82b None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:17:43.636270 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-c952b0bc-bf62-4a31-97d4-1726fcd1d82b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:43.641209 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f7a7c0-09f7-4be0-b4e8-0e678e175751 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:43.656249 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 976/1958] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:17:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:17:43.660803 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c952b0bc-bf62-4a31-97d4-1726fcd1d82b None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:43.669319 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 983/1959] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:17:43 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:17:43.670743 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f7a7c0-09f7-4be0-b4e8-0e678e175751 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:43.672677 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c952b0bc-bf62-4a31-97d4-1726fcd1d82b None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:43.678310 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5828ac-d670-40fb-aafa-9da65eb053ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:43.679111 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5828ac-d670-40fb-aafa-9da65eb053ac admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:43.679484 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5828ac-d670-40fb-aafa-9da65eb053ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:43.679846 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5828ac-d670-40fb-aafa-9da65eb053ac admin admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:43.680595 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5828ac-d670-40fb-aafa-9da65eb053ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:17:43.681004 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5828ac-d670-40fb-aafa-9da65eb053ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:43.684007 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5828ac-d670-40fb-aafa-9da65eb053ac admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:43.687557 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f7a7c0-09f7-4be0-b4e8-0e678e175751 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:43.701328 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 977/1960] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Sep 5 12:17:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:17:43.702447 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737332e8-98d1-4cfe-b344-89e1e4ee225b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:43.703103 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737332e8-98d1-4cfe-b344-89e1e4ee225b admin admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:43.703392 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737332e8-98d1-4cfe-b344-89e1e4ee225b admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:43.703671 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737332e8-98d1-4cfe-b344-89e1e4ee225b admin admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:43.706225 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737332e8-98d1-4cfe-b344-89e1e4ee225b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:43.706381 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5828ac-d670-40fb-aafa-9da65eb053ac admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:43.715143 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737332e8-98d1-4cfe-b344-89e1e4ee225b admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:43.719316 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5828ac-d670-40fb-aafa-9da65eb053ac admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:43.727052 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6f3f91-12a6-40cb-92aa-8af5ba6c55d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:43.727763 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6f3f91-12a6-40cb-92aa-8af5ba6c55d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:43.728553 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6f3f91-12a6-40cb-92aa-8af5ba6c55d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:43.728963 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6f3f91-12a6-40cb-92aa-8af5ba6c55d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:43.729681 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6f3f91-12a6-40cb-92aa-8af5ba6c55d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:43.732428 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6f3f91-12a6-40cb-92aa-8af5ba6c55d5 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:43.739077 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 984/1961] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:17:43 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:17:43.749981 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737332e8-98d1-4cfe-b344-89e1e4ee225b admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:43.777196 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737332e8-98d1-4cfe-b344-89e1e4ee225b admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:43.784366 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 978/1962] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 5 12:17:43 2022] POST /identity/v3/projects => generated 377 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:17:43.785272 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6f3f91-12a6-40cb-92aa-8af5ba6c55d5 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:43.789357 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c62a12-18ab-48ee-9750-eee8f2056608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:43.790041 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c62a12-18ab-48ee-9750-eee8f2056608 admin admin] REQUEST_METHOD: `PUT` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:43.790574 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c62a12-18ab-48ee-9750-eee8f2056608 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:43.791421 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c62a12-18ab-48ee-9750-eee8f2056608 admin admin] PATH_INFO: `/v3/projects/d8643c648d0c4193b1206794742a4ad0/users/454de62c6aaf4f6c85ddecc5c8cd6924/roles/ed72181e1403401facb77dcf33644757` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:43.817776 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c62a12-18ab-48ee-9750-eee8f2056608 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8643c648d0c4193b1206794742a4ad0, user_id=454de62c6aaf4f6c85ddecc5c8cd6924, role_id=ed72181e1403401facb77dcf33644757)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:43.820493 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c62a12-18ab-48ee-9750-eee8f2056608 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:43.848943 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 985/1963] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 5 12:17:43 2022] PUT /identity/v3/projects/d8643c648d0c4193b1206794742a4ad0/users/454de62c6aaf4f6c85ddecc5c8cd6924/roles/ed72181e1403401facb77dcf33644757 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:17:43.860190 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e95a336-3340-4ac8-861e-457ada3b64ce None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:43.860940 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e95a336-3340-4ac8-861e-457ada3b64ce None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:43.864954 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e95a336-3340-4ac8-861e-457ada3b64ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:43.903819 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-1e95a336-3340-4ac8-861e-457ada3b64ce None None] MFA Rules not processed for user `454de62c6aaf4f6c85ddecc5c8cd6924`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:17:43.905465 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-1e95a336-3340-4ac8-861e-457ada3b64ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:43.921152 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6f3f91-12a6-40cb-92aa-8af5ba6c55d5 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:44.038676 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 986/1964] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:17:43 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:17:44.039694 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e95a336-3340-4ac8-861e-457ada3b64ce None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:44.079361 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:44.115767 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52c4c3f-0e25-4bf8-b402-36d99714a49a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:44.116957 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52c4c3f-0e25-4bf8-b402-36d99714a49a admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:44.116957 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52c4c3f-0e25-4bf8-b402-36d99714a49a admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:44.116957 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52c4c3f-0e25-4bf8-b402-36d99714a49a admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:44.117773 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52c4c3f-0e25-4bf8-b402-36d99714a49a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:44.121142 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52c4c3f-0e25-4bf8-b402-36d99714a49a admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:44.127663 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:44.157342 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 979/1965] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 5 12:17:43 2022] POST /identity/v3/users => generated 289 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:17:44.157342 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52c4c3f-0e25-4bf8-b402-36d99714a49a admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:44.157342 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-c52c4c3f-0e25-4bf8-b402-36d99714a49a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:44.170682 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52c4c3f-0e25-4bf8-b402-36d99714a49a admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:44.175813 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e95a336-3340-4ac8-861e-457ada3b64ce None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:44.176263 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1534d37e-2151-4ea2-9dfd-6daa9e9cb1b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:44.177670 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1534d37e-2151-4ea2-9dfd-6daa9e9cb1b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:44.178093 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1534d37e-2151-4ea2-9dfd-6daa9e9cb1b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:44.178306 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1534d37e-2151-4ea2-9dfd-6daa9e9cb1b7 admin admin] PATH_INFO: `/v3/projects/2f14190efed24110b7f19acb3ac51cd0` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:44.181254 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1534d37e-2151-4ea2-9dfd-6daa9e9cb1b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f14190efed24110b7f19acb3ac51cd0)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:44.183456 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1534d37e-2151-4ea2-9dfd-6daa9e9cb1b7 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:44.184820 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050c982e-3491-4ce5-93b1-0bb93ee2df0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:44.186605 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050c982e-3491-4ce5-93b1-0bb93ee2df0e admin admin] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:44.187120 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050c982e-3491-4ce5-93b1-0bb93ee2df0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:44.187696 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050c982e-3491-4ce5-93b1-0bb93ee2df0e admin admin] PATH_INFO: `/v3/projects` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:44.188409 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050c982e-3491-4ce5-93b1-0bb93ee2df0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:44.190589 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050c982e-3491-4ce5-93b1-0bb93ee2df0e admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:44.225377 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 987/1966] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 5 12:17:44 2022] POST /identity/v3/projects => generated 377 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:17:44.226219 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050c982e-3491-4ce5-93b1-0bb93ee2df0e admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:44.238917 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-1534d37e-2151-4ea2-9dfd-6daa9e9cb1b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f14190efed24110b7f19acb3ac51cd0', 'request_id': 'req-1534d37e-2151-4ea2-9dfd-6daa9e9cb1b7'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:44.248268 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-1534d37e-2151-4ea2-9dfd-6daa9e9cb1b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f14190efed24110b7f19acb3ac51cd0', 'request_id': 'req-1534d37e-2151-4ea2-9dfd-6daa9e9cb1b7'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:44.256981 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-1534d37e-2151-4ea2-9dfd-6daa9e9cb1b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f14190efed24110b7f19acb3ac51cd0', 'request_id': 'req-1534d37e-2151-4ea2-9dfd-6daa9e9cb1b7'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:44.270725 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-1534d37e-2151-4ea2-9dfd-6daa9e9cb1b7 admin admin] The token cache is being invalidate because project 2f14190efed24110b7f19acb3ac51cd0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:17:44.271123 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-1534d37e-2151-4ea2-9dfd-6daa9e9cb1b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:44.271811 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-1534d37e-2151-4ea2-9dfd-6daa9e9cb1b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:44.273516 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 980/1967] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 5 12:17:44 2022] DELETE /identity/v3/projects/2f14190efed24110b7f19acb3ac51cd0 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:17:44.274268 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1534d37e-2151-4ea2-9dfd-6daa9e9cb1b7 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:44.275571 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-1534d37e-2151-4ea2-9dfd-6daa9e9cb1b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:44.306304 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050c982e-3491-4ce5-93b1-0bb93ee2df0e admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:44.311502 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2a0ef9-adbf-419b-aa0b-0268e346196c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:44.312109 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2a0ef9-adbf-419b-aa0b-0268e346196c admin admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:44.312389 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2a0ef9-adbf-419b-aa0b-0268e346196c admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:44.312659 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2a0ef9-adbf-419b-aa0b-0268e346196c admin admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:44.313335 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2a0ef9-adbf-419b-aa0b-0268e346196c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:44.314920 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2a0ef9-adbf-419b-aa0b-0268e346196c admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:44.326765 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 988/1968] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:17:44 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:17:44.328286 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faaf173-ed5b-400a-8bb5-899aa1363319 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:44.328562 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faaf173-ed5b-400a-8bb5-899aa1363319 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:44.329026 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faaf173-ed5b-400a-8bb5-899aa1363319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:44.348446 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1534d37e-2151-4ea2-9dfd-6daa9e9cb1b7 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:44.348837 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-8faaf173-ed5b-400a-8bb5-899aa1363319 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:17:44.350155 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-8faaf173-ed5b-400a-8bb5-899aa1363319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:44.353134 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34d64a6-a801-4acc-a3f3-fbad3ad3b3ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:44.353740 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34d64a6-a801-4acc-a3f3-fbad3ad3b3ab admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:44.354017 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34d64a6-a801-4acc-a3f3-fbad3ad3b3ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:44.354291 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34d64a6-a801-4acc-a3f3-fbad3ad3b3ab admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:44.354942 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34d64a6-a801-4acc-a3f3-fbad3ad3b3ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:44.356868 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34d64a6-a801-4acc-a3f3-fbad3ad3b3ab admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:44.366533 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 989/1969] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:17:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:17:44.366533 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faaf173-ed5b-400a-8bb5-899aa1363319 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:44.366533 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-8faaf173-ed5b-400a-8bb5-899aa1363319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:44.379022 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faaf173-ed5b-400a-8bb5-899aa1363319 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:44.384034 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41930a3-c725-42b7-b58b-e17c2ac2b3dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:44.384666 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41930a3-c725-42b7-b58b-e17c2ac2b3dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:44.384980 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41930a3-c725-42b7-b58b-e17c2ac2b3dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:44.385256 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41930a3-c725-42b7-b58b-e17c2ac2b3dd admin admin] PATH_INFO: `/v3/users/3b9ccc88d0fa49c4baedf933bd5e4b78` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:44.386956 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41930a3-c725-42b7-b58b-e17c2ac2b3dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b9ccc88d0fa49c4baedf933bd5e4b78)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:44.387681 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 981/1970] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 5 12:17:44 2022] POST /identity/v3/users => generated 295 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:17:44.388508 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34d64a6-a801-4acc-a3f3-fbad3ad3b3ab admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:44.388868 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41930a3-c725-42b7-b58b-e17c2ac2b3dd admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:44.390102 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-f34d64a6-a801-4acc-a3f3-fbad3ad3b3ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:44.406296 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34d64a6-a801-4acc-a3f3-fbad3ad3b3ab admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:44.412692 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59a7ca2-eaac-4f0a-8bb7-5d9fd10661d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:44.413365 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59a7ca2-eaac-4f0a-8bb7-5d9fd10661d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:44.413648 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59a7ca2-eaac-4f0a-8bb7-5d9fd10661d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:44.413926 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59a7ca2-eaac-4f0a-8bb7-5d9fd10661d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:44.414582 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59a7ca2-eaac-4f0a-8bb7-5d9fd10661d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:44.416218 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59a7ca2-eaac-4f0a-8bb7-5d9fd10661d3 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:44.431474 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 982/1971] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:17:44 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:17:44.431474 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16809534-2815-4a39-9bd8-cb6d041b2407 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:44.431474 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16809534-2815-4a39-9bd8-cb6d041b2407 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:44.431474 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16809534-2815-4a39-9bd8-cb6d041b2407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:44.456670 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-16809534-2815-4a39-9bd8-cb6d041b2407 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:17:44.458564 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-16809534-2815-4a39-9bd8-cb6d041b2407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:44.463187 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-e41930a3-c725-42b7-b58b-e17c2ac2b3dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b9ccc88d0fa49c4baedf933bd5e4b78'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:44.464056 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-e41930a3-c725-42b7-b58b-e17c2ac2b3dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b9ccc88d0fa49c4baedf933bd5e4b78'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:44.469490 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 983/1972] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:17:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:17:44.471506 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16809534-2815-4a39-9bd8-cb6d041b2407 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:44.473383 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-16809534-2815-4a39-9bd8-cb6d041b2407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:44.475205 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-e41930a3-c725-42b7-b58b-e17c2ac2b3dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b9ccc88d0fa49c4baedf933bd5e4b78'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:44.475909 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-e41930a3-c725-42b7-b58b-e17c2ac2b3dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b9ccc88d0fa49c4baedf933bd5e4b78'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:44.485953 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16809534-2815-4a39-9bd8-cb6d041b2407 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:44.494154 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8770073d-dd78-465d-b0a4-61e9aa4ee5ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:44.494774 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8770073d-dd78-465d-b0a4-61e9aa4ee5ab admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:44.495051 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8770073d-dd78-465d-b0a4-61e9aa4ee5ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:44.495314 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8770073d-dd78-465d-b0a4-61e9aa4ee5ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:44.496520 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8770073d-dd78-465d-b0a4-61e9aa4ee5ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:44.498410 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8770073d-dd78-465d-b0a4-61e9aa4ee5ab admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:44.500051 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-e41930a3-c725-42b7-b58b-e17c2ac2b3dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b9ccc88d0fa49c4baedf933bd5e4b78'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:44.512580 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 984/1973] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:17:44 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:17:44.513466 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8770073d-dd78-465d-b0a4-61e9aa4ee5ab admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:44.515184 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-8770073d-dd78-465d-b0a4-61e9aa4ee5ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:44.521414 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 990/1974] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 5 12:17:44 2022] DELETE /identity/v3/users/3b9ccc88d0fa49c4baedf933bd5e4b78 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:17:44.522591 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41930a3-c725-42b7-b58b-e17c2ac2b3dd admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:44.532051 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8770073d-dd78-465d-b0a4-61e9aa4ee5ab admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:44.553531 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:44.556262 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=86,keystone:INSERT=7,keystone:DELETE=7 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:44.618506 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b047941-726f-4fc9-8c4a-18587e04276e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:44.619442 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b047941-726f-4fc9-8c4a-18587e04276e admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:44.619727 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b047941-726f-4fc9-8c4a-18587e04276e admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:44.620163 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b047941-726f-4fc9-8c4a-18587e04276e admin admin] PATH_INFO: `/v3/projects/4b2186fd152249009e585cd59c58d510/users/a7203ec90eb04025a8d39395f9fa2cb0/roles/ed72181e1403401facb77dcf33644757` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:44.624860 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41930a3-c725-42b7-b58b-e17c2ac2b3dd admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:44.638371 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b047941-726f-4fc9-8c4a-18587e04276e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b2186fd152249009e585cd59c58d510, user_id=a7203ec90eb04025a8d39395f9fa2cb0, role_id=ed72181e1403401facb77dcf33644757)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:44.643035 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b047941-726f-4fc9-8c4a-18587e04276e admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:44.646067 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4f5856-0e9d-4e1b-aae4-6b3980ed18c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:44.646949 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4f5856-0e9d-4e1b-aae4-6b3980ed18c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:44.647667 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4f5856-0e9d-4e1b-aae4-6b3980ed18c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:44.647989 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4f5856-0e9d-4e1b-aae4-6b3980ed18c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:44.648801 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4f5856-0e9d-4e1b-aae4-6b3980ed18c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:17:44.649143 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4f5856-0e9d-4e1b-aae4-6b3980ed18c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:44.652395 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4f5856-0e9d-4e1b-aae4-6b3980ed18c3 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:44.667148 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 985/1975] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 5 12:17:44 2022] PUT /identity/v3/projects/4b2186fd152249009e585cd59c58d510/users/a7203ec90eb04025a8d39395f9fa2cb0/roles/ed72181e1403401facb77dcf33644757 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:17:44.669414 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b047941-726f-4fc9-8c4a-18587e04276e admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:44.672259 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 991/1976] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Sep 5 12:17:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:17:44.673675 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab75748-0bfd-4311-a5db-91cfeca98374 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:44.674692 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab75748-0bfd-4311-a5db-91cfeca98374 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:44.674985 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab75748-0bfd-4311-a5db-91cfeca98374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:44.696692 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-3ab75748-0bfd-4311-a5db-91cfeca98374 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:17:44.696692 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-3ab75748-0bfd-4311-a5db-91cfeca98374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:44.777957 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b047941-726f-4fc9-8c4a-18587e04276e admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:44.785065 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ee70b8-d68d-4397-b7d3-5963b39f4fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:44.786437 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ee70b8-d68d-4397-b7d3-5963b39f4fe8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:44.786926 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ee70b8-d68d-4397-b7d3-5963b39f4fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:44.787529 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ee70b8-d68d-4397-b7d3-5963b39f4fe8 admin admin] PATH_INFO: `/v3/projects/c95966d652054b9492ddbad6074bad33/users/80743778674e45afb166b6fa42b5c1d5/roles/16e2ccc8bd1b497d8cee780c1c7df0d2` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:44.796287 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 992/1977] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:17:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:17:44.797270 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab75748-0bfd-4311-a5db-91cfeca98374 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:44.812707 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ee70b8-d68d-4397-b7d3-5963b39f4fe8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c95966d652054b9492ddbad6074bad33, user_id=80743778674e45afb166b6fa42b5c1d5, role_id=16e2ccc8bd1b497d8cee780c1c7df0d2)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:44.815409 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ee70b8-d68d-4397-b7d3-5963b39f4fe8 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:44.815527 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab75748-0bfd-4311-a5db-91cfeca98374 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:44.828836 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b54d1c8-ea92-4fdc-9d71-7cb4f4b966ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:44.829634 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b54d1c8-ea92-4fdc-9d71-7cb4f4b966ef admin admin] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:44.833305 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b54d1c8-ea92-4fdc-9d71-7cb4f4b966ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:44.834616 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b54d1c8-ea92-4fdc-9d71-7cb4f4b966ef admin admin] PATH_INFO: `/v3/projects` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:44.838168 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b54d1c8-ea92-4fdc-9d71-7cb4f4b966ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:44.843755 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b54d1c8-ea92-4fdc-9d71-7cb4f4b966ef admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:44.848519 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 986/1978] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 5 12:17:44 2022] PUT /identity/v3/projects/c95966d652054b9492ddbad6074bad33/users/80743778674e45afb166b6fa42b5c1d5/roles/16e2ccc8bd1b497d8cee780c1c7df0d2 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:17:44.848519 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486a13be-3a76-486e-8d82-803e6a9d341b None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:44.848519 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486a13be-3a76-486e-8d82-803e6a9d341b None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:44.848519 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486a13be-3a76-486e-8d82-803e6a9d341b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:44.892559 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-486a13be-3a76-486e-8d82-803e6a9d341b None None] MFA Rules not processed for user `a7203ec90eb04025a8d39395f9fa2cb0`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:17:44.894030 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-486a13be-3a76-486e-8d82-803e6a9d341b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:44.894492 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 993/1979] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 5 12:17:44 2022] POST /identity/v3/projects => generated 373 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:17:44.896447 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b54d1c8-ea92-4fdc-9d71-7cb4f4b966ef admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:44.899029 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-7b54d1c8-ea92-4fdc-9d71-7cb4f4b966ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:45.013425 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 987/1980] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:17:44 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:17:45.013425 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486a13be-3a76-486e-8d82-803e6a9d341b None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:45.024390 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b54d1c8-ea92-4fdc-9d71-7cb4f4b966ef admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:45.033869 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02152cb6-9209-43e0-a242-0fedd7634aef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4994b4faa4ec4aa088f3dc32c9c5614d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:45.034517 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02152cb6-9209-43e0-a242-0fedd7634aef service neutron] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:45.034840 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02152cb6-9209-43e0-a242-0fedd7634aef service neutron] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:45.035079 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02152cb6-9209-43e0-a242-0fedd7634aef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:45.045695 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:45.147752 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:45.183724 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02152cb6-9209-43e0-a242-0fedd7634aef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:45.185675 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02152cb6-9209-43e0-a242-0fedd7634aef service neutron] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:45.197590 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 994/1981] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:17:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:17:45.198647 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02152cb6-9209-43e0-a242-0fedd7634aef service neutron] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:45.206162 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486a13be-3a76-486e-8d82-803e6a9d341b None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:45.213311 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02152cb6-9209-43e0-a242-0fedd7634aef service neutron] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:45.218841 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711150a7-092a-4196-a623-e9bdb2f6c43f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:45.219658 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711150a7-092a-4196-a623-e9bdb2f6c43f admin admin] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:45.219784 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3c2841-0b36-4e9c-ba75-2af23c42bc36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:45.220224 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711150a7-092a-4196-a623-e9bdb2f6c43f admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:45.220660 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711150a7-092a-4196-a623-e9bdb2f6c43f admin admin] PATH_INFO: `/v3/users` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:45.221398 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3c2841-0b36-4e9c-ba75-2af23c42bc36 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:45.221640 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711150a7-092a-4196-a623-e9bdb2f6c43f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:45.221865 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3c2841-0b36-4e9c-ba75-2af23c42bc36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:45.223037 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3c2841-0b36-4e9c-ba75-2af23c42bc36 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:45.223854 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3c2841-0b36-4e9c-ba75-2af23c42bc36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:45.224694 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711150a7-092a-4196-a623-e9bdb2f6c43f admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:45.226173 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3c2841-0b36-4e9c-ba75-2af23c42bc36 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:45.246426 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 988/1982] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:17:45 2022] GET /identity/v3/roles => generated 1420 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:17:45.247329 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3c2841-0b36-4e9c-ba75-2af23c42bc36 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:45.259284 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 995/1983] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 5 12:17:45 2022] POST /identity/v3/users => generated 287 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:17:45.259970 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711150a7-092a-4196-a623-e9bdb2f6c43f admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:45.263908 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-711150a7-092a-4196-a623-e9bdb2f6c43f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:45.273207 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3c2841-0b36-4e9c-ba75-2af23c42bc36 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:45.279122 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711150a7-092a-4196-a623-e9bdb2f6c43f admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:45.280985 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105c1ced-753a-4da0-b820-3cb98cf282d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:45.282715 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105c1ced-753a-4da0-b820-3cb98cf282d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:45.283147 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105c1ced-753a-4da0-b820-3cb98cf282d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:45.284339 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105c1ced-753a-4da0-b820-3cb98cf282d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:45.284567 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66dbc4a-2654-4c71-ab03-d25595261652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:45.285254 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66dbc4a-2654-4c71-ab03-d25595261652 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:45.285888 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66dbc4a-2654-4c71-ab03-d25595261652 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:45.285888 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66dbc4a-2654-4c71-ab03-d25595261652 admin admin] PATH_INFO: `/v3/users/5c4bd324c2bd4a37b7304856095b2dfe` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:45.286226 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105c1ced-753a-4da0-b820-3cb98cf282d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:45.288141 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66dbc4a-2654-4c71-ab03-d25595261652 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c4bd324c2bd4a37b7304856095b2dfe)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:45.288611 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105c1ced-753a-4da0-b820-3cb98cf282d0 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:45.290372 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66dbc4a-2654-4c71-ab03-d25595261652 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:45.341133 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 989/1984] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 5 12:17:45 2022] POST /identity/v3/projects => generated 377 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:17:45.343041 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105c1ced-753a-4da0-b820-3cb98cf282d0 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:45.356641 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-e66dbc4a-2654-4c71-ab03-d25595261652 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c4bd324c2bd4a37b7304856095b2dfe'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:45.357426 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-e66dbc4a-2654-4c71-ab03-d25595261652 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c4bd324c2bd4a37b7304856095b2dfe'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:45.368395 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-e66dbc4a-2654-4c71-ab03-d25595261652 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c4bd324c2bd4a37b7304856095b2dfe'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:45.369357 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-e66dbc4a-2654-4c71-ab03-d25595261652 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c4bd324c2bd4a37b7304856095b2dfe'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:45.402942 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-e66dbc4a-2654-4c71-ab03-d25595261652 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c4bd324c2bd4a37b7304856095b2dfe'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:45.420591 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 996/1985] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 5 12:17:45 2022] DELETE /identity/v3/users/5c4bd324c2bd4a37b7304856095b2dfe => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:17:45.421674 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66dbc4a-2654-4c71-ab03-d25595261652 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:45.424560 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-e66dbc4a-2654-4c71-ab03-d25595261652 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:45.429706 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105c1ced-753a-4da0-b820-3cb98cf282d0 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:45.507304 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b67574-d6b6-4b26-a242-ea9422e6c0f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:45.508225 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b67574-d6b6-4b26-a242-ea9422e6c0f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:45.508581 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b67574-d6b6-4b26-a242-ea9422e6c0f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:45.509067 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b67574-d6b6-4b26-a242-ea9422e6c0f9 admin admin] PATH_INFO: `/v3/projects/c95966d652054b9492ddbad6074bad33/users/80743778674e45afb166b6fa42b5c1d5/roles/16e2ccc8bd1b497d8cee780c1c7df0d2` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:45.512679 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b67574-d6b6-4b26-a242-ea9422e6c0f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c95966d652054b9492ddbad6074bad33, user_id=80743778674e45afb166b6fa42b5c1d5, role_id=16e2ccc8bd1b497d8cee780c1c7df0d2)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:45.515002 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b67574-d6b6-4b26-a242-ea9422e6c0f9 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:45.532847 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66dbc4a-2654-4c71-ab03-d25595261652 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:45.535002 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 990/1986] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 5 12:17:45 2022] PUT /identity/v3/projects/c95966d652054b9492ddbad6074bad33/users/80743778674e45afb166b6fa42b5c1d5/roles/16e2ccc8bd1b497d8cee780c1c7df0d2 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:17:45.536083 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b67574-d6b6-4b26-a242-ea9422e6c0f9 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:45.538167 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-76b67574-d6b6-4b26-a242-ea9422e6c0f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:45.592706 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:45.609347 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:45.634248 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b67574-d6b6-4b26-a242-ea9422e6c0f9 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:45.635596 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf06ceeb-5081-4f83-99f2-02bef01dcf88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:45.636833 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf06ceeb-5081-4f83-99f2-02bef01dcf88 admin admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:45.637226 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf06ceeb-5081-4f83-99f2-02bef01dcf88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:45.637562 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf06ceeb-5081-4f83-99f2-02bef01dcf88 admin admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:45.638287 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf06ceeb-5081-4f83-99f2-02bef01dcf88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:45.640010 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf06ceeb-5081-4f83-99f2-02bef01dcf88 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:45.640319 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aab0fcd-143f-4329-b016-36a3a5e7c1ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:45.640967 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aab0fcd-143f-4329-b016-36a3a5e7c1ce admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:45.641249 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aab0fcd-143f-4329-b016-36a3a5e7c1ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:45.641895 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aab0fcd-143f-4329-b016-36a3a5e7c1ce admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:45.645351 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aab0fcd-143f-4329-b016-36a3a5e7c1ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:45.645732 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aab0fcd-143f-4329-b016-36a3a5e7c1ce admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:45.655441 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 997/1987] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:17:45 2022] GET /identity/v3/roles => generated 1420 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:17:45.655441 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ae5f6b-5110-44a7-a7f6-91ae0f51da26 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:45.655441 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ae5f6b-5110-44a7-a7f6-91ae0f51da26 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:45.655441 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ae5f6b-5110-44a7-a7f6-91ae0f51da26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:45.673201 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 991/1988] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 5 12:17:45 2022] POST /identity/v3/users => generated 289 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:17:45.673201 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b486891e-fc6d-486c-84fe-70dfbd38f5fa None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:45.673201 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b486891e-fc6d-486c-84fe-70dfbd38f5fa None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:45.673201 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b486891e-fc6d-486c-84fe-70dfbd38f5fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:45.682387 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-17ae5f6b-5110-44a7-a7f6-91ae0f51da26 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:17:45.683790 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-17ae5f6b-5110-44a7-a7f6-91ae0f51da26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:45.694396 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 998/1989] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:17:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:17:45.695355 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ae5f6b-5110-44a7-a7f6-91ae0f51da26 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:45.708195 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ae5f6b-5110-44a7-a7f6-91ae0f51da26 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:45.720575 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9ecf49-b238-4418-9526-4a741b982ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:45.721342 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9ecf49-b238-4418-9526-4a741b982ce2 admin admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:45.721723 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9ecf49-b238-4418-9526-4a741b982ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:45.722011 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9ecf49-b238-4418-9526-4a741b982ce2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:45.722678 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9ecf49-b238-4418-9526-4a741b982ce2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:45.724363 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9ecf49-b238-4418-9526-4a741b982ce2 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:45.726448 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-b486891e-fc6d-486c-84fe-70dfbd38f5fa None None] MFA Rules not processed for user `80743778674e45afb166b6fa42b5c1d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:17:45.730032 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-b486891e-fc6d-486c-84fe-70dfbd38f5fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:45.736282 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 999/1990] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:17:45 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:17:45.736537 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9ecf49-b238-4418-9526-4a741b982ce2 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:45.750696 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9ecf49-b238-4418-9526-4a741b982ce2 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:45.755663 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b20da25-584a-4f4e-8338-a77e102d7482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:45.756283 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b20da25-584a-4f4e-8338-a77e102d7482 admin admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:45.756642 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b20da25-584a-4f4e-8338-a77e102d7482 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:45.757089 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b20da25-584a-4f4e-8338-a77e102d7482 admin admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:45.757755 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b20da25-584a-4f4e-8338-a77e102d7482 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:45.759420 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b20da25-584a-4f4e-8338-a77e102d7482 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:45.772271 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1000/1991] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:17:45 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:17:45.773166 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b20da25-584a-4f4e-8338-a77e102d7482 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:45.776695 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-0b20da25-584a-4f4e-8338-a77e102d7482 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:45.843119 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 992/1992] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:17:45 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:17:45.844273 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b486891e-fc6d-486c-84fe-70dfbd38f5fa None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:45.845612 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-b486891e-fc6d-486c-84fe-70dfbd38f5fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:45.852220 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b20da25-584a-4f4e-8338-a77e102d7482 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:45.856142 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f99039-fb29-4c7a-861a-5c1a3f50f23d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4994b4faa4ec4aa088f3dc32c9c5614d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:45.857051 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f99039-fb29-4c7a-861a-5c1a3f50f23d service neutron] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:45.857408 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f99039-fb29-4c7a-861a-5c1a3f50f23d service neutron] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:45.857751 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f99039-fb29-4c7a-861a-5c1a3f50f23d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:45.861334 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b486891e-fc6d-486c-84fe-70dfbd38f5fa None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:45.866177 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8145d1d9-0930-4532-983b-1a3d72b7d97d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:45.866823 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8145d1d9-0930-4532-983b-1a3d72b7d97d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:45.867099 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8145d1d9-0930-4532-983b-1a3d72b7d97d admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:45.867409 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8145d1d9-0930-4532-983b-1a3d72b7d97d admin admin] PATH_INFO: `/v3/projects/dadedb975bca4859842e5730c4799a5e` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:45.868485 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f99039-fb29-4c7a-861a-5c1a3f50f23d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:45.868667 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8145d1d9-0930-4532-983b-1a3d72b7d97d admin admin] RBAC: Authorizing `identity:delete_project(project_id=dadedb975bca4859842e5730c4799a5e)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:45.870080 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f99039-fb29-4c7a-861a-5c1a3f50f23d service neutron] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:45.871368 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8145d1d9-0930-4532-983b-1a3d72b7d97d admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:45.881742 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1001/1993] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:17:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:17:45.882853 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f99039-fb29-4c7a-861a-5c1a3f50f23d service neutron] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:45.893663 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f99039-fb29-4c7a-861a-5c1a3f50f23d service neutron] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:45.898770 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a5526f-f85f-4741-875d-6ba2e4efef1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:45.899223 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a5526f-f85f-4741-875d-6ba2e4efef1e admin admin] REQUEST_METHOD: `PUT` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:45.899586 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a5526f-f85f-4741-875d-6ba2e4efef1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:45.899863 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a5526f-f85f-4741-875d-6ba2e4efef1e admin admin] PATH_INFO: `/v3/projects/f7f230b525a14679b117b5d660ee628c/users/813c5d4c636f4fa3900f4430a2418a91/roles/ed72181e1403401facb77dcf33644757` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:45.917798 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a5526f-f85f-4741-875d-6ba2e4efef1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7f230b525a14679b117b5d660ee628c, user_id=813c5d4c636f4fa3900f4430a2418a91, role_id=ed72181e1403401facb77dcf33644757)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:45.920599 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a5526f-f85f-4741-875d-6ba2e4efef1e admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:45.928659 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-8145d1d9-0930-4532-983b-1a3d72b7d97d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dadedb975bca4859842e5730c4799a5e', 'request_id': 'req-8145d1d9-0930-4532-983b-1a3d72b7d97d'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:45.937850 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-8145d1d9-0930-4532-983b-1a3d72b7d97d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dadedb975bca4859842e5730c4799a5e', 'request_id': 'req-8145d1d9-0930-4532-983b-1a3d72b7d97d'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:45.938060 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1002/1994] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 5 12:17:45 2022] PUT /identity/v3/projects/f7f230b525a14679b117b5d660ee628c/users/813c5d4c636f4fa3900f4430a2418a91/roles/ed72181e1403401facb77dcf33644757 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:17:45.938858 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a5526f-f85f-4741-875d-6ba2e4efef1e admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:45.956939 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-8145d1d9-0930-4532-983b-1a3d72b7d97d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dadedb975bca4859842e5730c4799a5e', 'request_id': 'req-8145d1d9-0930-4532-983b-1a3d72b7d97d'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:45.971452 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-8145d1d9-0930-4532-983b-1a3d72b7d97d admin admin] The token cache is being invalidate because project dadedb975bca4859842e5730c4799a5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:17:45.971765 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-8145d1d9-0930-4532-983b-1a3d72b7d97d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:45.972419 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-8145d1d9-0930-4532-983b-1a3d72b7d97d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:45.975377 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 993/1995] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 5 12:17:45 2022] DELETE /identity/v3/projects/dadedb975bca4859842e5730c4799a5e => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:17:45.975599 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8145d1d9-0930-4532-983b-1a3d72b7d97d admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:45.977410 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-8145d1d9-0930-4532-983b-1a3d72b7d97d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:46.019699 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:46.050559 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8145d1d9-0930-4532-983b-1a3d72b7d97d admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:46.054523 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a5526f-f85f-4741-875d-6ba2e4efef1e admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:46.060871 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51971a38-e01a-4c03-90eb-50830fa50db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:46.061618 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51971a38-e01a-4c03-90eb-50830fa50db9 admin admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:46.061892 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51971a38-e01a-4c03-90eb-50830fa50db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:46.062248 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51971a38-e01a-4c03-90eb-50830fa50db9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:46.062849 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51971a38-e01a-4c03-90eb-50830fa50db9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:46.064472 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51971a38-e01a-4c03-90eb-50830fa50db9 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:46.081531 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1003/1996] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:17:45 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:17:46.081531 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a01c75-fc7c-4f1b-89c6-7c4076c2d73a None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:46.081531 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a01c75-fc7c-4f1b-89c6-7c4076c2d73a None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:46.081531 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a01c75-fc7c-4f1b-89c6-7c4076c2d73a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:46.114728 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2152ae4-84dd-4c5b-b3d3-5246098187c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37633bbae0c2423c81ccd61ac3a17ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:46.115042 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2152ae4-84dd-4c5b-b3d3-5246098187c0 service cinder] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:46.115435 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2152ae4-84dd-4c5b-b3d3-5246098187c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:46.115822 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2152ae4-84dd-4c5b-b3d3-5246098187c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:46.118042 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-f2152ae4-84dd-4c5b-b3d3-5246098187c0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:46.118590 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-38a01c75-fc7c-4f1b-89c6-7c4076c2d73a None None] MFA Rules not processed for user `813c5d4c636f4fa3900f4430a2418a91`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:17:46.119891 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-38a01c75-fc7c-4f1b-89c6-7c4076c2d73a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:46.143861 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:46.209185 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2152ae4-84dd-4c5b-b3d3-5246098187c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:46.211440 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2152ae4-84dd-4c5b-b3d3-5246098187c0 service cinder] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:46.224239 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 994/1997] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:17:45 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:17:46.225676 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2152ae4-84dd-4c5b-b3d3-5246098187c0 service cinder] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:46.226301 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1004/1998] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:17:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:17:46.227231 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a01c75-fc7c-4f1b-89c6-7c4076c2d73a None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:46.227812 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-f2152ae4-84dd-4c5b-b3d3-5246098187c0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:46.228810 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-38a01c75-fc7c-4f1b-89c6-7c4076c2d73a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:46.247097 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2152ae4-84dd-4c5b-b3d3-5246098187c0 service cinder] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:46.251087 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a01c75-fc7c-4f1b-89c6-7c4076c2d73a None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:46.252840 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397c2bd7-dcb8-40d5-b4ab-ea49ce8807b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:46.253078 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397c2bd7-dcb8-40d5-b4ab-ea49ce8807b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:46.253559 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397c2bd7-dcb8-40d5-b4ab-ea49ce8807b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:46.254508 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397c2bd7-dcb8-40d5-b4ab-ea49ce8807b7 admin admin] PATH_INFO: `/v3/users/a0255a229c494b04aca2072081002829` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:46.255759 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397c2bd7-dcb8-40d5-b4ab-ea49ce8807b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0255a229c494b04aca2072081002829)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:46.257895 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da18fa6c-d46b-42e4-8c6a-e3427f702aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:46.258950 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397c2bd7-dcb8-40d5-b4ab-ea49ce8807b7 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:46.259085 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da18fa6c-d46b-42e4-8c6a-e3427f702aa8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:46.259341 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da18fa6c-d46b-42e4-8c6a-e3427f702aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:46.259867 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da18fa6c-d46b-42e4-8c6a-e3427f702aa8 admin admin] PATH_INFO: `/v3/projects/e453a265c97545499833506eb090cd3e/users/024b138a684b418cbc3af7881fd55c84/roles/ed72181e1403401facb77dcf33644757` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:46.283526 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da18fa6c-d46b-42e4-8c6a-e3427f702aa8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e453a265c97545499833506eb090cd3e, user_id=024b138a684b418cbc3af7881fd55c84, role_id=ed72181e1403401facb77dcf33644757)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:46.287239 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da18fa6c-d46b-42e4-8c6a-e3427f702aa8 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:46.316946 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1005/1999] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 5 12:17:46 2022] PUT /identity/v3/projects/e453a265c97545499833506eb090cd3e/users/024b138a684b418cbc3af7881fd55c84/roles/ed72181e1403401facb77dcf33644757 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:17:46.316946 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da18fa6c-d46b-42e4-8c6a-e3427f702aa8 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:46.321982 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-da18fa6c-d46b-42e4-8c6a-e3427f702aa8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:46.387342 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-397c2bd7-dcb8-40d5-b4ab-ea49ce8807b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0255a229c494b04aca2072081002829'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:46.389410 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-397c2bd7-dcb8-40d5-b4ab-ea49ce8807b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0255a229c494b04aca2072081002829'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:46.404429 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-397c2bd7-dcb8-40d5-b4ab-ea49ce8807b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0255a229c494b04aca2072081002829'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:46.406040 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-397c2bd7-dcb8-40d5-b4ab-ea49ce8807b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0255a229c494b04aca2072081002829'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:46.426286 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da18fa6c-d46b-42e4-8c6a-e3427f702aa8 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:46.430543 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028b9984-0e21-471b-a950-498b05e7faa8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37633bbae0c2423c81ccd61ac3a17ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:46.431170 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028b9984-0e21-471b-a950-498b05e7faa8 service cinder] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:46.431776 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028b9984-0e21-471b-a950-498b05e7faa8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:46.432023 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028b9984-0e21-471b-a950-498b05e7faa8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:46.434428 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-028b9984-0e21-471b-a950-498b05e7faa8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:46.435908 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-397c2bd7-dcb8-40d5-b4ab-ea49ce8807b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0255a229c494b04aca2072081002829'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:46.465525 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 995/2000] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 5 12:17:46 2022] DELETE /identity/v3/users/a0255a229c494b04aca2072081002829 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:17:46.465525 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb79b74-e202-4eaf-b9f8-b020e32004cf None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:46.465525 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb79b74-e202-4eaf-b9f8-b020e32004cf None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:46.465525 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb79b74-e202-4eaf-b9f8-b020e32004cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:46.518123 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:46.531080 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-cdb79b74-e202-4eaf-b9f8-b020e32004cf None None] MFA Rules not processed for user `024b138a684b418cbc3af7881fd55c84`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:17:46.532628 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-cdb79b74-e202-4eaf-b9f8-b020e32004cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:46.551258 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028b9984-0e21-471b-a950-498b05e7faa8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:46.555225 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028b9984-0e21-471b-a950-498b05e7faa8 service cinder] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:46.583125 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1006/2001] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:17:46 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:17:46.647067 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 996/2002] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:17:46 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:17:46.651161 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028b9984-0e21-471b-a950-498b05e7faa8 service cinder] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:46.653680 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-028b9984-0e21-471b-a950-498b05e7faa8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:46.844311 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:46.910289 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028b9984-0e21-471b-a950-498b05e7faa8 service cinder] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:47.065886 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bff2e6-cab8-45a7-9165-44db6850d63a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:47.066822 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bff2e6-cab8-45a7-9165-44db6850d63a admin admin] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:47.068817 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bff2e6-cab8-45a7-9165-44db6850d63a admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:47.069233 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bff2e6-cab8-45a7-9165-44db6850d63a admin admin] PATH_INFO: `/v3/projects` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:47.070850 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bff2e6-cab8-45a7-9165-44db6850d63a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:47.075550 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bff2e6-cab8-45a7-9165-44db6850d63a admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:47.145596 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb79b74-e202-4eaf-b9f8-b020e32004cf None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:47.147245 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-cdb79b74-e202-4eaf-b9f8-b020e32004cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:47.155109 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1007/2003] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 5 12:17:46 2022] POST /identity/v3/projects => generated 377 bytes in 505 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:17:47.159183 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bff2e6-cab8-45a7-9165-44db6850d63a admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:47.193946 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb79b74-e202-4eaf-b9f8-b020e32004cf None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:47.359520 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bff2e6-cab8-45a7-9165-44db6850d63a admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:47.374544 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52f6a39-b948-4e27-82db-0f3b0818225c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:47.375189 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f6a39-b948-4e27-82db-0f3b0818225c admin admin] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:47.375769 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f6a39-b948-4e27-82db-0f3b0818225c admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:47.375769 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f6a39-b948-4e27-82db-0f3b0818225c admin admin] PATH_INFO: `/v3/users` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:47.377291 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52f6a39-b948-4e27-82db-0f3b0818225c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:47.379569 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52f6a39-b948-4e27-82db-0f3b0818225c admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:47.391593 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdfe641-f446-4aba-8db8-369e47d6488e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:47.392513 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdfe641-f446-4aba-8db8-369e47d6488e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:47.392793 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdfe641-f446-4aba-8db8-369e47d6488e admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:47.393093 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdfe641-f446-4aba-8db8-369e47d6488e admin admin] PATH_INFO: `/v3/projects/627f2a945a4a4903b8320befa43f3aa3` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:47.394434 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdfe641-f446-4aba-8db8-369e47d6488e admin admin] RBAC: Authorizing `identity:delete_project(project_id=627f2a945a4a4903b8320befa43f3aa3)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:47.400656 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdfe641-f446-4aba-8db8-369e47d6488e admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:47.474306 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1008/2004] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 5 12:17:47 2022] POST /identity/v3/users => generated 295 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:17:47.475674 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52f6a39-b948-4e27-82db-0f3b0818225c admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:47.482136 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-e52f6a39-b948-4e27-82db-0f3b0818225c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:47.496278 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-ecdfe641-f446-4aba-8db8-369e47d6488e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '627f2a945a4a4903b8320befa43f3aa3', 'request_id': 'req-ecdfe641-f446-4aba-8db8-369e47d6488e'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:47.506822 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-ecdfe641-f446-4aba-8db8-369e47d6488e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '627f2a945a4a4903b8320befa43f3aa3', 'request_id': 'req-ecdfe641-f446-4aba-8db8-369e47d6488e'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:47.517325 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-ecdfe641-f446-4aba-8db8-369e47d6488e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '627f2a945a4a4903b8320befa43f3aa3', 'request_id': 'req-ecdfe641-f446-4aba-8db8-369e47d6488e'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:47.531529 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-ecdfe641-f446-4aba-8db8-369e47d6488e admin admin] The token cache is being invalidate because project 627f2a945a4a4903b8320befa43f3aa3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:17:47.532003 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-ecdfe641-f446-4aba-8db8-369e47d6488e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:47.533418 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-ecdfe641-f446-4aba-8db8-369e47d6488e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:47.538265 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 997/2005] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 5 12:17:47 2022] DELETE /identity/v3/projects/627f2a945a4a4903b8320befa43f3aa3 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 12:17:47.539364 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdfe641-f446-4aba-8db8-369e47d6488e admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:47.541247 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-ecdfe641-f446-4aba-8db8-369e47d6488e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:47.615865 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:47.690961 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52f6a39-b948-4e27-82db-0f3b0818225c admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:47.696054 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdfe641-f446-4aba-8db8-369e47d6488e admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:47.701612 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7adb7cd-6c93-4a9c-9f3f-63c0ad0893e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:47.702281 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7adb7cd-6c93-4a9c-9f3f-63c0ad0893e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:47.702564 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7adb7cd-6c93-4a9c-9f3f-63c0ad0893e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:47.702834 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7adb7cd-6c93-4a9c-9f3f-63c0ad0893e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:47.703621 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7adb7cd-6c93-4a9c-9f3f-63c0ad0893e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:47.705302 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7adb7cd-6c93-4a9c-9f3f-63c0ad0893e3 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:47.713316 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:47.718549 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 998/2006] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:17:47 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:17:47.718858 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7adb7cd-6c93-4a9c-9f3f-63c0ad0893e3 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:47.721648 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-b7adb7cd-6c93-4a9c-9f3f-63c0ad0893e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:47.750052 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7adb7cd-6c93-4a9c-9f3f-63c0ad0893e3 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:47.755039 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a43294f-8eb0-4ebf-87b5-94af85f6f1d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:47.755696 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a43294f-8eb0-4ebf-87b5-94af85f6f1d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:47.756143 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a43294f-8eb0-4ebf-87b5-94af85f6f1d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:47.756431 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a43294f-8eb0-4ebf-87b5-94af85f6f1d3 admin admin] PATH_INFO: `/v3/users/d2548eb3bc2b47fd8ccf09821ab8132b` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:47.757787 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a43294f-8eb0-4ebf-87b5-94af85f6f1d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2548eb3bc2b47fd8ccf09821ab8132b)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:47.759652 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a43294f-8eb0-4ebf-87b5-94af85f6f1d3 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:47.763684 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cca46bd-de9b-4fbf-ac91-f8d0f404821f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37633bbae0c2423c81ccd61ac3a17ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:47.764324 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cca46bd-de9b-4fbf-ac91-f8d0f404821f service cinder] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:47.764604 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cca46bd-de9b-4fbf-ac91-f8d0f404821f service cinder] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:47.764877 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cca46bd-de9b-4fbf-ac91-f8d0f404821f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:47.766921 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-1cca46bd-de9b-4fbf-ac91-f8d0f404821f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:47.840009 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-1a43294f-8eb0-4ebf-87b5-94af85f6f1d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2548eb3bc2b47fd8ccf09821ab8132b'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:47.841267 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-1a43294f-8eb0-4ebf-87b5-94af85f6f1d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2548eb3bc2b47fd8ccf09821ab8132b'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:47.851342 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-1a43294f-8eb0-4ebf-87b5-94af85f6f1d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2548eb3bc2b47fd8ccf09821ab8132b'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:47.852069 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-1a43294f-8eb0-4ebf-87b5-94af85f6f1d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2548eb3bc2b47fd8ccf09821ab8132b'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:47.862351 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cca46bd-de9b-4fbf-ac91-f8d0f404821f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:47.864759 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cca46bd-de9b-4fbf-ac91-f8d0f404821f service cinder] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:47.869277 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-1a43294f-8eb0-4ebf-87b5-94af85f6f1d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2548eb3bc2b47fd8ccf09821ab8132b'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:47.881474 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1009/2007] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:17:47 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:17:47.885076 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cca46bd-de9b-4fbf-ac91-f8d0f404821f service cinder] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:47.888018 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-1cca46bd-de9b-4fbf-ac91-f8d0f404821f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:47.891339 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 999/2008] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 5 12:17:47 2022] DELETE /identity/v3/users/d2548eb3bc2b47fd8ccf09821ab8132b => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:17:47.891339 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a43294f-8eb0-4ebf-87b5-94af85f6f1d3 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:47.891339 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-1a43294f-8eb0-4ebf-87b5-94af85f6f1d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:47.960098 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cca46bd-de9b-4fbf-ac91-f8d0f404821f service cinder] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:47.993798 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a43294f-8eb0-4ebf-87b5-94af85f6f1d3 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:48.010521 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0561835-9bea-4c8b-b778-55263f3e63dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:48.015199 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0561835-9bea-4c8b-b778-55263f3e63dd admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:48.016330 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0561835-9bea-4c8b-b778-55263f3e63dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:48.017235 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0561835-9bea-4c8b-b778-55263f3e63dd admin admin] PATH_INFO: `/v3/projects/a9ec20558cca4cd68c7a1bdecde24343/users/15d12da0f73f454cb3ed6c7e03733ea0/roles/16e2ccc8bd1b497d8cee780c1c7df0d2` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:48.057685 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0561835-9bea-4c8b-b778-55263f3e63dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9ec20558cca4cd68c7a1bdecde24343, user_id=15d12da0f73f454cb3ed6c7e03733ea0, role_id=16e2ccc8bd1b497d8cee780c1c7df0d2)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:48.060845 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0561835-9bea-4c8b-b778-55263f3e63dd admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:48.085062 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1000/2009] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 5 12:17:47 2022] PUT /identity/v3/projects/a9ec20558cca4cd68c7a1bdecde24343/users/15d12da0f73f454cb3ed6c7e03733ea0/roles/16e2ccc8bd1b497d8cee780c1c7df0d2 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:17:48.089204 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0561835-9bea-4c8b-b778-55263f3e63dd admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:48.089528 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56162a1-8d1a-45ca-a055-723e76235585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:48.090172 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56162a1-8d1a-45ca-a055-723e76235585 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:48.090456 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56162a1-8d1a-45ca-a055-723e76235585 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:48.090730 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56162a1-8d1a-45ca-a055-723e76235585 admin admin] PATH_INFO: `/v3/projects/fdadb704487b4d1cb3949bb72679cbcf` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:48.091901 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56162a1-8d1a-45ca-a055-723e76235585 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fdadb704487b4d1cb3949bb72679cbcf)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:48.094149 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56162a1-8d1a-45ca-a055-723e76235585 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:48.140980 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:48.192218 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-e56162a1-8d1a-45ca-a055-723e76235585 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fdadb704487b4d1cb3949bb72679cbcf', 'request_id': 'req-e56162a1-8d1a-45ca-a055-723e76235585'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:48.203837 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-e56162a1-8d1a-45ca-a055-723e76235585 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fdadb704487b4d1cb3949bb72679cbcf', 'request_id': 'req-e56162a1-8d1a-45ca-a055-723e76235585'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:48.211672 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-e56162a1-8d1a-45ca-a055-723e76235585 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fdadb704487b4d1cb3949bb72679cbcf', 'request_id': 'req-e56162a1-8d1a-45ca-a055-723e76235585'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:48.230880 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-e56162a1-8d1a-45ca-a055-723e76235585 admin admin] The token cache is being invalidate because project fdadb704487b4d1cb3949bb72679cbcf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:17:48.231058 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-e56162a1-8d1a-45ca-a055-723e76235585 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:48.231722 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-e56162a1-8d1a-45ca-a055-723e76235585 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:48.233754 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1010/2010] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 5 12:17:47 2022] DELETE /identity/v3/projects/fdadb704487b4d1cb3949bb72679cbcf => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:17:48.238803 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b270809-a910-4faf-9d4c-c6203104c71e None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:48.239152 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b270809-a910-4faf-9d4c-c6203104c71e None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:48.239602 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b270809-a910-4faf-9d4c-c6203104c71e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:48.240754 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0561835-9bea-4c8b-b778-55263f3e63dd admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:48.251266 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:48.268199 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-2b270809-a910-4faf-9d4c-c6203104c71e None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:17:48.270754 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-2b270809-a910-4faf-9d4c-c6203104c71e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:48.361444 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1011/2011] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:17:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:17:48.365880 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e298579-9407-4b3f-8f9c-59b422151ad5 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:48.366262 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e298579-9407-4b3f-8f9c-59b422151ad5 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:48.366446 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e298579-9407-4b3f-8f9c-59b422151ad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:48.377164 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1900ab34-aaf9-479e-b41f-29a3e7069e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:48.377871 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1900ab34-aaf9-479e-b41f-29a3e7069e6a admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:48.378119 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1900ab34-aaf9-479e-b41f-29a3e7069e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:48.378442 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1900ab34-aaf9-479e-b41f-29a3e7069e6a admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:48.379158 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1900ab34-aaf9-479e-b41f-29a3e7069e6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:48.381563 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1900ab34-aaf9-479e-b41f-29a3e7069e6a admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:48.395745 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1001/2012] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:17:48 2022] GET /identity/v3/roles => generated 1420 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 12:17:48.399399 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1900ab34-aaf9-479e-b41f-29a3e7069e6a admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:48.404944 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-1900ab34-aaf9-479e-b41f-29a3e7069e6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:48.410531 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-5e298579-9407-4b3f-8f9c-59b422151ad5 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:17:48.413066 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-5e298579-9407-4b3f-8f9c-59b422151ad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:48.423305 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1900ab34-aaf9-479e-b41f-29a3e7069e6a admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:48.427978 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1012/2013] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:17:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:17:48.429613 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e298579-9407-4b3f-8f9c-59b422151ad5 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:48.435312 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995eaa08-03a3-468a-9aab-ae216804af41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:48.436175 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995eaa08-03a3-468a-9aab-ae216804af41 admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:48.436493 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995eaa08-03a3-468a-9aab-ae216804af41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:48.436837 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995eaa08-03a3-468a-9aab-ae216804af41 admin admin] PATH_INFO: `/v3/projects/a9ec20558cca4cd68c7a1bdecde24343/users/15d12da0f73f454cb3ed6c7e03733ea0/roles/16e2ccc8bd1b497d8cee780c1c7df0d2` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:48.439306 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995eaa08-03a3-468a-9aab-ae216804af41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9ec20558cca4cd68c7a1bdecde24343, user_id=15d12da0f73f454cb3ed6c7e03733ea0, role_id=16e2ccc8bd1b497d8cee780c1c7df0d2)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:48.442439 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995eaa08-03a3-468a-9aab-ae216804af41 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:48.443692 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e298579-9407-4b3f-8f9c-59b422151ad5 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:48.449303 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3782864a-02e3-43f2-9b0b-60699afa37ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:48.450533 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3782864a-02e3-43f2-9b0b-60699afa37ca admin admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:48.450818 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3782864a-02e3-43f2-9b0b-60699afa37ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:48.451085 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3782864a-02e3-43f2-9b0b-60699afa37ca admin admin] PATH_INFO: `/v3/domains` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:48.451743 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3782864a-02e3-43f2-9b0b-60699afa37ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:17:48.452031 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3782864a-02e3-43f2-9b0b-60699afa37ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:48.453654 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3782864a-02e3-43f2-9b0b-60699afa37ca admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:48.459267 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1002/2014] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 5 12:17:48 2022] PUT /identity/v3/projects/a9ec20558cca4cd68c7a1bdecde24343/users/15d12da0f73f454cb3ed6c7e03733ea0/roles/16e2ccc8bd1b497d8cee780c1c7df0d2 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 12:17:48.471065 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1013/2015] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Sep 5 12:17:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:17:48.471254 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995eaa08-03a3-468a-9aab-ae216804af41 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:48.471336 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb28c8c-d9aa-4b6d-952b-cbf94018b0bb None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:48.471336 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb28c8c-d9aa-4b6d-952b-cbf94018b0bb None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:48.471336 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb28c8c-d9aa-4b6d-952b-cbf94018b0bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:48.473142 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-995eaa08-03a3-468a-9aab-ae216804af41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:48.504514 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-0bb28c8c-d9aa-4b6d-952b-cbf94018b0bb None None] MFA Rules not processed for user `15d12da0f73f454cb3ed6c7e03733ea0`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:17:48.505924 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-0bb28c8c-d9aa-4b6d-952b-cbf94018b0bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:48.558747 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995eaa08-03a3-468a-9aab-ae216804af41 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:48.565152 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce14f5e-19ad-4bd2-8281-5a3aa4f46a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:48.565801 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce14f5e-19ad-4bd2-8281-5a3aa4f46a93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:48.566207 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce14f5e-19ad-4bd2-8281-5a3aa4f46a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:48.566484 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce14f5e-19ad-4bd2-8281-5a3aa4f46a93 admin admin] PATH_INFO: `/v3/projects/93a23e96f5804b11b54d46e3c6b63b1a` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:48.567652 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce14f5e-19ad-4bd2-8281-5a3aa4f46a93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=93a23e96f5804b11b54d46e3c6b63b1a)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:48.569759 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce14f5e-19ad-4bd2-8281-5a3aa4f46a93 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:48.588810 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1014/2016] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:17:48 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:17:48.589938 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb28c8c-d9aa-4b6d-952b-cbf94018b0bb None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:48.609494 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb28c8c-d9aa-4b6d-952b-cbf94018b0bb None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:48.615061 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69a3ea2-5a67-4c84-a260-9faea80822be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:48.616036 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69a3ea2-5a67-4c84-a260-9faea80822be admin admin] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:48.616317 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69a3ea2-5a67-4c84-a260-9faea80822be admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:48.616586 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69a3ea2-5a67-4c84-a260-9faea80822be admin admin] PATH_INFO: `/v3/projects` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:48.617265 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69a3ea2-5a67-4c84-a260-9faea80822be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:48.619195 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69a3ea2-5a67-4c84-a260-9faea80822be admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:48.635646 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-7ce14f5e-19ad-4bd2-8281-5a3aa4f46a93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93a23e96f5804b11b54d46e3c6b63b1a', 'request_id': 'req-7ce14f5e-19ad-4bd2-8281-5a3aa4f46a93'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:48.641357 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:48.648129 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-7ce14f5e-19ad-4bd2-8281-5a3aa4f46a93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93a23e96f5804b11b54d46e3c6b63b1a', 'request_id': 'req-7ce14f5e-19ad-4bd2-8281-5a3aa4f46a93'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:48.658141 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-7ce14f5e-19ad-4bd2-8281-5a3aa4f46a93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93a23e96f5804b11b54d46e3c6b63b1a', 'request_id': 'req-7ce14f5e-19ad-4bd2-8281-5a3aa4f46a93'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:48.684462 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1015/2017] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 5 12:17:48 2022] POST /identity/v3/projects => generated 389 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:17:48.686898 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69a3ea2-5a67-4c84-a260-9faea80822be admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:48.689025 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-f69a3ea2-5a67-4c84-a260-9faea80822be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:48.694952 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-7ce14f5e-19ad-4bd2-8281-5a3aa4f46a93 admin admin] The token cache is being invalidate because project 93a23e96f5804b11b54d46e3c6b63b1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:17:48.695249 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-7ce14f5e-19ad-4bd2-8281-5a3aa4f46a93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:48.697907 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-7ce14f5e-19ad-4bd2-8281-5a3aa4f46a93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:48.703267 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1003/2018] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 5 12:17:48 2022] DELETE /identity/v3/projects/93a23e96f5804b11b54d46e3c6b63b1a => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:17:48.704440 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce14f5e-19ad-4bd2-8281-5a3aa4f46a93 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:48.709996 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-7ce14f5e-19ad-4bd2-8281-5a3aa4f46a93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:48.797655 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:48.802474 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69a3ea2-5a67-4c84-a260-9faea80822be admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:48.811223 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446c4bf7-f0f7-49fe-8d11-ffbdf042003b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37633bbae0c2423c81ccd61ac3a17ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:48.812192 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446c4bf7-f0f7-49fe-8d11-ffbdf042003b service cinder] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:48.812438 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446c4bf7-f0f7-49fe-8d11-ffbdf042003b service cinder] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:48.813113 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446c4bf7-f0f7-49fe-8d11-ffbdf042003b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:48.815076 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-446c4bf7-f0f7-49fe-8d11-ffbdf042003b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:48.863349 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce14f5e-19ad-4bd2-8281-5a3aa4f46a93 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:48.923847 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446c4bf7-f0f7-49fe-8d11-ffbdf042003b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:48.923847 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446c4bf7-f0f7-49fe-8d11-ffbdf042003b service cinder] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:48.943661 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1016/2019] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:17:48 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:17:48.946679 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83760d78-1582-4d9e-8f22-882bd7dcecd9 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:48.946906 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83760d78-1582-4d9e-8f22-882bd7dcecd9 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:48.947191 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83760d78-1582-4d9e-8f22-882bd7dcecd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:48.950456 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c091697a-d561-42ea-9a3f-83aa99a1fa81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:48.951439 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c091697a-d561-42ea-9a3f-83aa99a1fa81 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:48.951915 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c091697a-d561-42ea-9a3f-83aa99a1fa81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:48.952387 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c091697a-d561-42ea-9a3f-83aa99a1fa81 admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:48.953426 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c091697a-d561-42ea-9a3f-83aa99a1fa81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:48.956084 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c091697a-d561-42ea-9a3f-83aa99a1fa81 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:49.000308 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1004/2020] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 5 12:17:48 2022] POST /identity/v3/users => generated 295 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:17:49.004687 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c091697a-d561-42ea-9a3f-83aa99a1fa81 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:49.012413 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-83760d78-1582-4d9e-8f22-882bd7dcecd9 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:17:49.013703 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-83760d78-1582-4d9e-8f22-882bd7dcecd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:49.016565 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c091697a-d561-42ea-9a3f-83aa99a1fa81 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:49.033799 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd21fec6-5b35-457a-a180-ad0897b6ae16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:49.033799 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd21fec6-5b35-457a-a180-ad0897b6ae16 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:49.033799 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd21fec6-5b35-457a-a180-ad0897b6ae16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:49.033799 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd21fec6-5b35-457a-a180-ad0897b6ae16 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:49.034113 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd21fec6-5b35-457a-a180-ad0897b6ae16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:49.034191 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1017/2021] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:17:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:17:49.034191 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83760d78-1582-4d9e-8f22-882bd7dcecd9 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:49.034336 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd21fec6-5b35-457a-a180-ad0897b6ae16 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:49.034625 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-83760d78-1582-4d9e-8f22-882bd7dcecd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:49.046891 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1005/2022] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:17:49 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:17:49.048642 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56635f0-cc93-4b4e-8b44-884e78fbcefe None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:49.048962 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56635f0-cc93-4b4e-8b44-884e78fbcefe None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:49.049539 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56635f0-cc93-4b4e-8b44-884e78fbcefe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:49.054827 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83760d78-1582-4d9e-8f22-882bd7dcecd9 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:49.059000 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998d8059-191d-46d2-a622-53e6c1fb8676 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37633bbae0c2423c81ccd61ac3a17ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:49.060165 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998d8059-191d-46d2-a622-53e6c1fb8676 service cinder] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:49.061509 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998d8059-191d-46d2-a622-53e6c1fb8676 service cinder] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:49.061961 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998d8059-191d-46d2-a622-53e6c1fb8676 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:49.063947 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-998d8059-191d-46d2-a622-53e6c1fb8676 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:49.075122 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-c56635f0-cc93-4b4e-8b44-884e78fbcefe None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:17:49.077112 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-c56635f0-cc93-4b4e-8b44-884e78fbcefe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:49.086066 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1006/2023] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:17:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:17:49.086952 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56635f0-cc93-4b4e-8b44-884e78fbcefe None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:49.100261 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56635f0-cc93-4b4e-8b44-884e78fbcefe None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:49.108710 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8241dd3d-ea3e-4356-acee-c7b602c9d2b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:49.109455 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8241dd3d-ea3e-4356-acee-c7b602c9d2b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:49.109799 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8241dd3d-ea3e-4356-acee-c7b602c9d2b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:49.115047 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8241dd3d-ea3e-4356-acee-c7b602c9d2b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:49.115929 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8241dd3d-ea3e-4356-acee-c7b602c9d2b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:49.117625 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8241dd3d-ea3e-4356-acee-c7b602c9d2b4 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:49.131429 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1007/2024] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:17:49 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:17:49.132431 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8241dd3d-ea3e-4356-acee-c7b602c9d2b4 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:49.146640 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8241dd3d-ea3e-4356-acee-c7b602c9d2b4 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:49.157092 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998d8059-191d-46d2-a622-53e6c1fb8676 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:49.158734 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998d8059-191d-46d2-a622-53e6c1fb8676 service cinder] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:49.160261 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6755d4e2-fb40-4bc9-9ed7-46f7fbec719b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:49.161209 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6755d4e2-fb40-4bc9-9ed7-46f7fbec719b admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:49.162249 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6755d4e2-fb40-4bc9-9ed7-46f7fbec719b admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:49.162541 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6755d4e2-fb40-4bc9-9ed7-46f7fbec719b admin admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:49.164198 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6755d4e2-fb40-4bc9-9ed7-46f7fbec719b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:17:49.164606 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6755d4e2-fb40-4bc9-9ed7-46f7fbec719b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:49.172074 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6755d4e2-fb40-4bc9-9ed7-46f7fbec719b admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:49.176395 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1018/2025] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:17:49 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:17:49.177506 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998d8059-191d-46d2-a622-53e6c1fb8676 service cinder] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:49.192096 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1008/2026] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Sep 5 12:17:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:17:49.194111 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6755d4e2-fb40-4bc9-9ed7-46f7fbec719b admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:49.197540 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998d8059-191d-46d2-a622-53e6c1fb8676 service cinder] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:49.204169 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b72d06-e972-4409-9e94-1e224cd3e1bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:49.206408 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b72d06-e972-4409-9e94-1e224cd3e1bc admin admin] REQUEST_METHOD: `PUT` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:49.206771 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b72d06-e972-4409-9e94-1e224cd3e1bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:49.207225 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b72d06-e972-4409-9e94-1e224cd3e1bc admin admin] PATH_INFO: `/v3/projects/9c7a4d678b3e46f4840051a25a3a10b6/users/1311e12a19d14b45b5249bde712ee4ab/roles/ed72181e1403401facb77dcf33644757` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:49.229573 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b72d06-e972-4409-9e94-1e224cd3e1bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c7a4d678b3e46f4840051a25a3a10b6, user_id=1311e12a19d14b45b5249bde712ee4ab, role_id=ed72181e1403401facb77dcf33644757)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:49.232824 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6755d4e2-fb40-4bc9-9ed7-46f7fbec719b admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:49.233644 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b72d06-e972-4409-9e94-1e224cd3e1bc admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:49.245614 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a4add9-c7ae-487a-8c40-ce80bdb8c872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:49.246486 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a4add9-c7ae-487a-8c40-ce80bdb8c872 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:49.248516 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a4add9-c7ae-487a-8c40-ce80bdb8c872 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:49.248805 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a4add9-c7ae-487a-8c40-ce80bdb8c872 admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:49.252148 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a4add9-c7ae-487a-8c40-ce80bdb8c872 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:49.258603 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a4add9-c7ae-487a-8c40-ce80bdb8c872 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:49.271630 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1019/2027] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 5 12:17:49 2022] PUT /identity/v3/projects/9c7a4d678b3e46f4840051a25a3a10b6/users/1311e12a19d14b45b5249bde712ee4ab/roles/ed72181e1403401facb77dcf33644757 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:17:49.275982 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3e3bb1-3192-4079-97ad-59edd19a20ca None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:49.276354 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3e3bb1-3192-4079-97ad-59edd19a20ca None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:49.276863 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3e3bb1-3192-4079-97ad-59edd19a20ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:49.314416 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-8e3e3bb1-3192-4079-97ad-59edd19a20ca None None] MFA Rules not processed for user `1311e12a19d14b45b5249bde712ee4ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:17:49.316039 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-8e3e3bb1-3192-4079-97ad-59edd19a20ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:49.368436 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1009/2028] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 5 12:17:49 2022] POST /identity/v3/projects => generated 361 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:17:49.373427 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a4add9-c7ae-487a-8c40-ce80bdb8c872 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:49.423700 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:49.430878 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:49.488793 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1020/2029] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:17:49 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:17:49.493735 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3e3bb1-3192-4079-97ad-59edd19a20ca None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:49.540306 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a4add9-c7ae-487a-8c40-ce80bdb8c872 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:49.556142 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e54c023-4a80-4854-9ec7-63feeaf831d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:49.557898 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e54c023-4a80-4854-9ec7-63feeaf831d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:49.559003 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e54c023-4a80-4854-9ec7-63feeaf831d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:49.559507 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e54c023-4a80-4854-9ec7-63feeaf831d8 admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:49.561353 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e54c023-4a80-4854-9ec7-63feeaf831d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:49.564543 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e54c023-4a80-4854-9ec7-63feeaf831d8 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:49.610842 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1010/2030] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 5 12:17:49 2022] POST /identity/v3/users => generated 281 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:17:49.612045 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e54c023-4a80-4854-9ec7-63feeaf831d8 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:49.628721 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e54c023-4a80-4854-9ec7-63feeaf831d8 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:49.644548 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe84ad50-d493-4cda-9a80-33af26893272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:49.645207 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe84ad50-d493-4cda-9a80-33af26893272 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:49.645327 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3e3bb1-3192-4079-97ad-59edd19a20ca None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:49.645848 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe84ad50-d493-4cda-9a80-33af26893272 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:49.645848 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe84ad50-d493-4cda-9a80-33af26893272 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:49.646384 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe84ad50-d493-4cda-9a80-33af26893272 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:49.648012 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe84ad50-d493-4cda-9a80-33af26893272 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:49.655313 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8fd613-b38c-4e2e-a932-e1142503c5b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:49.656467 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8fd613-b38c-4e2e-a932-e1142503c5b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:49.656830 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8fd613-b38c-4e2e-a932-e1142503c5b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:49.657396 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8fd613-b38c-4e2e-a932-e1142503c5b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:49.658940 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8fd613-b38c-4e2e-a932-e1142503c5b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:49.662997 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8fd613-b38c-4e2e-a932-e1142503c5b3 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:49.678341 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1011/2031] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:17:49 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 12:17:49.687869 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe84ad50-d493-4cda-9a80-33af26893272 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:49.712251 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe84ad50-d493-4cda-9a80-33af26893272 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:49.714549 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1021/2032] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 5 12:17:49 2022] POST /identity/v3/projects => generated 389 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:17:49.717853 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8fd613-b38c-4e2e-a932-e1142503c5b3 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:49.796248 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f449c40a-e60f-497a-b5b0-3b12d5059bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:49.798614 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f449c40a-e60f-497a-b5b0-3b12d5059bc5 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:49.799667 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f449c40a-e60f-497a-b5b0-3b12d5059bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:49.799667 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f449c40a-e60f-497a-b5b0-3b12d5059bc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:49.799930 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f449c40a-e60f-497a-b5b0-3b12d5059bc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:49.802620 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f449c40a-e60f-497a-b5b0-3b12d5059bc5 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:49.828951 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1012/2033] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:17:49 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:17:49.830970 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f449c40a-e60f-497a-b5b0-3b12d5059bc5 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:49.845158 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f449c40a-e60f-497a-b5b0-3b12d5059bc5 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:49.851576 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3248f8e-6986-49f8-afa4-82e86c6cdbb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:49.853004 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8fd613-b38c-4e2e-a932-e1142503c5b3 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:49.853449 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3248f8e-6986-49f8-afa4-82e86c6cdbb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:49.853918 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3248f8e-6986-49f8-afa4-82e86c6cdbb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:49.855702 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3248f8e-6986-49f8-afa4-82e86c6cdbb5 admin admin] PATH_INFO: `/v3/projects/6a5b87b0125b4aae91485f7177eba28f/users/d7087e46c8bb43b182bc311cf3b02024/roles/ed72181e1403401facb77dcf33644757` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:49.858548 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403460fe-e869-492a-9e42-896b3e6f40e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:49.859157 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403460fe-e869-492a-9e42-896b3e6f40e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:49.859436 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403460fe-e869-492a-9e42-896b3e6f40e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:49.859715 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403460fe-e869-492a-9e42-896b3e6f40e0 admin admin] PATH_INFO: `/v3/users` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:49.860545 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403460fe-e869-492a-9e42-896b3e6f40e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:49.862690 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403460fe-e869-492a-9e42-896b3e6f40e0 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:49.894806 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1022/2034] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 5 12:17:49 2022] POST /identity/v3/users => generated 301 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:17:49.898102 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3248f8e-6986-49f8-afa4-82e86c6cdbb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a5b87b0125b4aae91485f7177eba28f, user_id=d7087e46c8bb43b182bc311cf3b02024, role_id=ed72181e1403401facb77dcf33644757)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:49.898872 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403460fe-e869-492a-9e42-896b3e6f40e0 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:49.902913 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3248f8e-6986-49f8-afa4-82e86c6cdbb5 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:49.930440 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403460fe-e869-492a-9e42-896b3e6f40e0 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:49.930654 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1013/2035] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 5 12:17:49 2022] PUT /identity/v3/projects/6a5b87b0125b4aae91485f7177eba28f/users/d7087e46c8bb43b182bc311cf3b02024/roles/ed72181e1403401facb77dcf33644757 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:17:49.934547 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc49708-3c81-4630-b4c1-e1d4cb754cdc None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:49.935057 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc49708-3c81-4630-b4c1-e1d4cb754cdc None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:49.935179 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc49708-3c81-4630-b4c1-e1d4cb754cdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:49.981960 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-3cc49708-3c81-4630-b4c1-e1d4cb754cdc None None] MFA Rules not processed for user `d7087e46c8bb43b182bc311cf3b02024`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:17:49.983733 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-3cc49708-3c81-4630-b4c1-e1d4cb754cdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:50.090358 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b985d79-5c0c-4876-b890-e796e4211f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:50.091459 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b985d79-5c0c-4876-b890-e796e4211f82 admin admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:50.092091 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b985d79-5c0c-4876-b890-e796e4211f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:50.092805 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b985d79-5c0c-4876-b890-e796e4211f82 admin admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:50.094200 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b985d79-5c0c-4876-b890-e796e4211f82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:50.096473 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b985d79-5c0c-4876-b890-e796e4211f82 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:50.111721 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1023/2036] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:17:49 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:17:50.118550 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b985d79-5c0c-4876-b890-e796e4211f82 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:50.120680 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:50.133025 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b985d79-5c0c-4876-b890-e796e4211f82 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:50.140859 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecee636f-400e-4636-aa38-8bc444dd3ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:50.142960 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecee636f-400e-4636-aa38-8bc444dd3ac4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:50.143338 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecee636f-400e-4636-aa38-8bc444dd3ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:50.143796 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecee636f-400e-4636-aa38-8bc444dd3ac4 admin admin] PATH_INFO: `/v3/projects/198d46d67d63499e975633871fd1aa3b/users/0147e91c83ce435e8c773e0121b11a3e/roles/16e2ccc8bd1b497d8cee780c1c7df0d2` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:50.150354 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1014/2037] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:17:49 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 12:17:50.155315 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:50.164150 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecee636f-400e-4636-aa38-8bc444dd3ac4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=198d46d67d63499e975633871fd1aa3b, user_id=0147e91c83ce435e8c773e0121b11a3e, role_id=16e2ccc8bd1b497d8cee780c1c7df0d2)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:50.168936 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecee636f-400e-4636-aa38-8bc444dd3ac4 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:50.216473 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1024/2038] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 5 12:17:50 2022] PUT /identity/v3/projects/198d46d67d63499e975633871fd1aa3b/users/0147e91c83ce435e8c773e0121b11a3e/roles/16e2ccc8bd1b497d8cee780c1c7df0d2 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:17:50.220622 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc49708-3c81-4630-b4c1-e1d4cb754cdc None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:50.236164 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc49708-3c81-4630-b4c1-e1d4cb754cdc None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:50.346224 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecee636f-400e-4636-aa38-8bc444dd3ac4 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:50.348540 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-ecee636f-400e-4636-aa38-8bc444dd3ac4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:50.401940 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e58dadd-a159-4e73-bdb0-6eeb919e7cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:50.403240 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e58dadd-a159-4e73-bdb0-6eeb919e7cbd admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:50.403737 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e58dadd-a159-4e73-bdb0-6eeb919e7cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:50.404231 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e58dadd-a159-4e73-bdb0-6eeb919e7cbd admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:50.405153 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e58dadd-a159-4e73-bdb0-6eeb919e7cbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:50.407507 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e58dadd-a159-4e73-bdb0-6eeb919e7cbd admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:50.421349 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1015/2039] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:17:50 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:17:50.425520 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e58dadd-a159-4e73-bdb0-6eeb919e7cbd admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:50.439725 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e58dadd-a159-4e73-bdb0-6eeb919e7cbd admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:50.447751 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecee636f-400e-4636-aa38-8bc444dd3ac4 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:50.451320 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33016543-52bd-45d4-983f-87bcf3f103ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:50.453886 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33016543-52bd-45d4-983f-87bcf3f103ac admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:50.453886 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33016543-52bd-45d4-983f-87bcf3f103ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:50.454123 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9854d833-71bc-4034-9fa4-fccdfce860eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37633bbae0c2423c81ccd61ac3a17ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:50.454225 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33016543-52bd-45d4-983f-87bcf3f103ac admin admin] PATH_INFO: `/v3/projects/198d46d67d63499e975633871fd1aa3b/users/0147e91c83ce435e8c773e0121b11a3e/roles/16e2ccc8bd1b497d8cee780c1c7df0d2` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:50.454552 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9854d833-71bc-4034-9fa4-fccdfce860eb service cinder] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:50.454835 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9854d833-71bc-4034-9fa4-fccdfce860eb service cinder] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:50.455203 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9854d833-71bc-4034-9fa4-fccdfce860eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:50.459471 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33016543-52bd-45d4-983f-87bcf3f103ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=198d46d67d63499e975633871fd1aa3b, user_id=0147e91c83ce435e8c773e0121b11a3e, role_id=16e2ccc8bd1b497d8cee780c1c7df0d2)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:50.463409 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33016543-52bd-45d4-983f-87bcf3f103ac admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:50.491190 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1016/2040] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 5 12:17:50 2022] PUT /identity/v3/projects/198d46d67d63499e975633871fd1aa3b/users/0147e91c83ce435e8c773e0121b11a3e/roles/16e2ccc8bd1b497d8cee780c1c7df0d2 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 12:17:50.502490 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06858b7b-a49a-45a2-965c-c550a0f01b9e None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:50.502809 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06858b7b-a49a-45a2-965c-c550a0f01b9e None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:50.503057 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06858b7b-a49a-45a2-965c-c550a0f01b9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:50.548828 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-06858b7b-a49a-45a2-965c-c550a0f01b9e None None] MFA Rules not processed for user `0147e91c83ce435e8c773e0121b11a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:17:50.550281 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-06858b7b-a49a-45a2-965c-c550a0f01b9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:50.577493 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9854d833-71bc-4034-9fa4-fccdfce860eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:50.579092 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9854d833-71bc-4034-9fa4-fccdfce860eb service cinder] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:50.606545 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1025/2041] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:17:50 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 12:17:50.608027 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9854d833-71bc-4034-9fa4-fccdfce860eb service cinder] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:50.626064 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9854d833-71bc-4034-9fa4-fccdfce860eb service cinder] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:50.646233 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1017/2042] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:17:50 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:17:50.660697 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06858b7b-a49a-45a2-965c-c550a0f01b9e None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:50.715460 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fd45f1-cf4a-4c02-bf55-0be49a1f9914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:50.716325 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fd45f1-cf4a-4c02-bf55-0be49a1f9914 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:50.716622 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fd45f1-cf4a-4c02-bf55-0be49a1f9914 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:50.716960 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fd45f1-cf4a-4c02-bf55-0be49a1f9914 admin admin] PATH_INFO: `/v3/users/d7087e46c8bb43b182bc311cf3b02024` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:50.718807 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fd45f1-cf4a-4c02-bf55-0be49a1f9914 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7087e46c8bb43b182bc311cf3b02024)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:50.721551 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fd45f1-cf4a-4c02-bf55-0be49a1f9914 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:50.735144 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06858b7b-a49a-45a2-965c-c550a0f01b9e None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:50.738882 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e6517c-8bcf-40c4-b9fe-d92e33993c0a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37633bbae0c2423c81ccd61ac3a17ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:50.739578 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e6517c-8bcf-40c4-b9fe-d92e33993c0a service cinder] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:50.739807 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e6517c-8bcf-40c4-b9fe-d92e33993c0a service cinder] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:50.740067 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e6517c-8bcf-40c4-b9fe-d92e33993c0a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:50.753580 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e6517c-8bcf-40c4-b9fe-d92e33993c0a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:50.755750 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e6517c-8bcf-40c4-b9fe-d92e33993c0a service cinder] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:50.767752 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1018/2043] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:17:50 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 12:17:50.785321 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:50.797252 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-a6fd45f1-cf4a-4c02-bf55-0be49a1f9914 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7087e46c8bb43b182bc311cf3b02024'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:50.801692 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-a6fd45f1-cf4a-4c02-bf55-0be49a1f9914 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7087e46c8bb43b182bc311cf3b02024'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:50.811301 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-a6fd45f1-cf4a-4c02-bf55-0be49a1f9914 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7087e46c8bb43b182bc311cf3b02024'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:50.812211 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-a6fd45f1-cf4a-4c02-bf55-0be49a1f9914 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7087e46c8bb43b182bc311cf3b02024'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:50.831506 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-a6fd45f1-cf4a-4c02-bf55-0be49a1f9914 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7087e46c8bb43b182bc311cf3b02024'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:50.857307 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1026/2044] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 5 12:17:50 2022] DELETE /identity/v3/users/d7087e46c8bb43b182bc311cf3b02024 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:17:50.859459 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23776c53-f19d-45fb-a4cd-5e6545280eda None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:50.860045 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23776c53-f19d-45fb-a4cd-5e6545280eda None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:50.860517 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23776c53-f19d-45fb-a4cd-5e6545280eda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:50.876068 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:50.884198 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-23776c53-f19d-45fb-a4cd-5e6545280eda None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:17:50.886683 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-23776c53-f19d-45fb-a4cd-5e6545280eda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:50.964668 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fd45f1-cf4a-4c02-bf55-0be49a1f9914 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:50.966263 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1019/2045] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:17:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:17:50.966662 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-a6fd45f1-cf4a-4c02-bf55-0be49a1f9914 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:50.976618 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23776c53-f19d-45fb-a4cd-5e6545280eda None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:50.978732 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-23776c53-f19d-45fb-a4cd-5e6545280eda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:50.982663 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fd45f1-cf4a-4c02-bf55-0be49a1f9914 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:50.988368 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775ef7ed-6f38-4026-b425-67a24ffda633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:50.989130 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775ef7ed-6f38-4026-b425-67a24ffda633 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:50.989532 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775ef7ed-6f38-4026-b425-67a24ffda633 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:50.989874 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775ef7ed-6f38-4026-b425-67a24ffda633 admin admin] PATH_INFO: `/v3/users/1311e12a19d14b45b5249bde712ee4ab` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:50.991333 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775ef7ed-6f38-4026-b425-67a24ffda633 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1311e12a19d14b45b5249bde712ee4ab)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:50.993423 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775ef7ed-6f38-4026-b425-67a24ffda633 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:51.062794 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23776c53-f19d-45fb-a4cd-5e6545280eda None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:51.069392 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3a246d-afbe-4c67-baec-980e6f4d693e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4994b4faa4ec4aa088f3dc32c9c5614d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:51.070567 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3a246d-afbe-4c67-baec-980e6f4d693e service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:51.071073 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3a246d-afbe-4c67-baec-980e6f4d693e service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:51.071725 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3a246d-afbe-4c67-baec-980e6f4d693e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:51.098318 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-775ef7ed-6f38-4026-b425-67a24ffda633 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1311e12a19d14b45b5249bde712ee4ab'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:51.099219 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-775ef7ed-6f38-4026-b425-67a24ffda633 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1311e12a19d14b45b5249bde712ee4ab'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:51.102508 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3a246d-afbe-4c67-baec-980e6f4d693e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:51.106341 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3a246d-afbe-4c67-baec-980e6f4d693e service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:51.117147 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-775ef7ed-6f38-4026-b425-67a24ffda633 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1311e12a19d14b45b5249bde712ee4ab'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:51.117819 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-775ef7ed-6f38-4026-b425-67a24ffda633 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1311e12a19d14b45b5249bde712ee4ab'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:51.140281 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-775ef7ed-6f38-4026-b425-67a24ffda633 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1311e12a19d14b45b5249bde712ee4ab'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:51.142515 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1020/2046] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:17:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:17:51.161889 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1027/2047] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 5 12:17:50 2022] DELETE /identity/v3/users/1311e12a19d14b45b5249bde712ee4ab => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 12:17:51.162005 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512879e9-6048-49f0-92e7-7e002c1d3257 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:51.162005 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512879e9-6048-49f0-92e7-7e002c1d3257 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:51.162452 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512879e9-6048-49f0-92e7-7e002c1d3257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:51.190775 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-512879e9-6048-49f0-92e7-7e002c1d3257 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:17:51.192124 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-512879e9-6048-49f0-92e7-7e002c1d3257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:51.297942 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1021/2048] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:17:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:17:51.309221 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775ef7ed-6f38-4026-b425-67a24ffda633 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:51.310966 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-775ef7ed-6f38-4026-b425-67a24ffda633 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:51.397061 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775ef7ed-6f38-4026-b425-67a24ffda633 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:51.405757 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fdb1f4-0a25-4061-85c5-2d05428dac6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4994b4faa4ec4aa088f3dc32c9c5614d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:51.407099 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fdb1f4-0a25-4061-85c5-2d05428dac6a service neutron] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:51.408602 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fdb1f4-0a25-4061-85c5-2d05428dac6a service neutron] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:51.409042 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fdb1f4-0a25-4061-85c5-2d05428dac6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:51.425718 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fdb1f4-0a25-4061-85c5-2d05428dac6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:51.428592 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fdb1f4-0a25-4061-85c5-2d05428dac6a service neutron] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:51.443327 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1028/2049] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:17:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:17:51.633021 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512879e9-6048-49f0-92e7-7e002c1d3257 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:51.637260 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-512879e9-6048-49f0-92e7-7e002c1d3257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:51.674275 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512879e9-6048-49f0-92e7-7e002c1d3257 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:51.682375 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e4966e-9c8e-4cac-8f61-1d3dae2f924e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:51.683295 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e4966e-9c8e-4cac-8f61-1d3dae2f924e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:51.684844 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e4966e-9c8e-4cac-8f61-1d3dae2f924e admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:51.684844 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e4966e-9c8e-4cac-8f61-1d3dae2f924e admin admin] PATH_INFO: `/v3/projects/6a5b87b0125b4aae91485f7177eba28f` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:51.688953 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e4966e-9c8e-4cac-8f61-1d3dae2f924e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a5b87b0125b4aae91485f7177eba28f)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:51.691138 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e4966e-9c8e-4cac-8f61-1d3dae2f924e admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:51.709860 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fdb1f4-0a25-4061-85c5-2d05428dac6a service neutron] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:51.711375 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-24fdb1f4-0a25-4061-85c5-2d05428dac6a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:51.728780 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fdb1f4-0a25-4061-85c5-2d05428dac6a service neutron] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:51.735580 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52244cd-45fd-4827-97da-dcab7902903e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:51.746761 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52244cd-45fd-4827-97da-dcab7902903e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:51.747558 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52244cd-45fd-4827-97da-dcab7902903e admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:51.748181 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52244cd-45fd-4827-97da-dcab7902903e admin admin] PATH_INFO: `/v3/users/813c5d4c636f4fa3900f4430a2418a91` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:51.750649 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52244cd-45fd-4827-97da-dcab7902903e admin admin] RBAC: Authorizing `identity:delete_user(user_id=813c5d4c636f4fa3900f4430a2418a91)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:51.755240 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52244cd-45fd-4827-97da-dcab7902903e admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:51.769464 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:51.776887 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-05e4966e-9c8e-4cac-8f61-1d3dae2f924e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a5b87b0125b4aae91485f7177eba28f', 'request_id': 'req-05e4966e-9c8e-4cac-8f61-1d3dae2f924e'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:51.802821 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-05e4966e-9c8e-4cac-8f61-1d3dae2f924e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a5b87b0125b4aae91485f7177eba28f', 'request_id': 'req-05e4966e-9c8e-4cac-8f61-1d3dae2f924e'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:51.811450 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-05e4966e-9c8e-4cac-8f61-1d3dae2f924e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a5b87b0125b4aae91485f7177eba28f', 'request_id': 'req-05e4966e-9c8e-4cac-8f61-1d3dae2f924e'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:51.818891 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:DELETE=19,keystone:SELECT=79,keystone:INSERT=2 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:51.838456 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-05e4966e-9c8e-4cac-8f61-1d3dae2f924e admin admin] The token cache is being invalidate because project 6a5b87b0125b4aae91485f7177eba28f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:17:51.839617 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-05e4966e-9c8e-4cac-8f61-1d3dae2f924e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:51.841181 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-05e4966e-9c8e-4cac-8f61-1d3dae2f924e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:51.844971 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1022/2050] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 5 12:17:51 2022] DELETE /identity/v3/projects/6a5b87b0125b4aae91485f7177eba28f => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:17:51.850116 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718035b9-df4f-4437-a2ca-ad1739d78abd None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:51.850505 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718035b9-df4f-4437-a2ca-ad1739d78abd None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:51.850740 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718035b9-df4f-4437-a2ca-ad1739d78abd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:51.851118 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-f52244cd-45fd-4827-97da-dcab7902903e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '813c5d4c636f4fa3900f4430a2418a91'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:51.852325 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-f52244cd-45fd-4827-97da-dcab7902903e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '813c5d4c636f4fa3900f4430a2418a91'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:51.862164 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-f52244cd-45fd-4827-97da-dcab7902903e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '813c5d4c636f4fa3900f4430a2418a91'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:51.863114 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-f52244cd-45fd-4827-97da-dcab7902903e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '813c5d4c636f4fa3900f4430a2418a91'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:51.879631 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-718035b9-df4f-4437-a2ca-ad1739d78abd None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:17:51.882850 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-718035b9-df4f-4437-a2ca-ad1739d78abd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:51.889390 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-f52244cd-45fd-4827-97da-dcab7902903e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '813c5d4c636f4fa3900f4430a2418a91'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:51.919472 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1029/2051] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 5 12:17:51 2022] DELETE /identity/v3/users/813c5d4c636f4fa3900f4430a2418a91 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 12:17:51.919472 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52244cd-45fd-4827-97da-dcab7902903e admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:51.919472 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-f52244cd-45fd-4827-97da-dcab7902903e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:51.993103 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1023/2052] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:17:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:17:51.996183 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8763a1-bf24-44c3-b798-522319988882 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:51.997004 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8763a1-bf24-44c3-b798-522319988882 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:51.997560 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8763a1-bf24-44c3-b798-522319988882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:52.029004 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52244cd-45fd-4827-97da-dcab7902903e admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:52.044001 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04795a82-4874-4e9e-be58-16243f359979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:52.045647 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04795a82-4874-4e9e-be58-16243f359979 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:52.046075 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04795a82-4874-4e9e-be58-16243f359979 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:52.046549 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04795a82-4874-4e9e-be58-16243f359979 admin admin] PATH_INFO: `/v3/projects/9c7a4d678b3e46f4840051a25a3a10b6` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:52.047359 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-7e8763a1-bf24-44c3-b798-522319988882 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:17:52.048085 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04795a82-4874-4e9e-be58-16243f359979 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c7a4d678b3e46f4840051a25a3a10b6)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:52.048608 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-7e8763a1-bf24-44c3-b798-522319988882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:52.050775 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04795a82-4874-4e9e-be58-16243f359979 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:52.060389 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1024/2053] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:17:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:17:52.062879 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a03747-5a34-49ff-9975-35bde05467b3 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:52.062879 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a03747-5a34-49ff-9975-35bde05467b3 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:52.062879 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a03747-5a34-49ff-9975-35bde05467b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:52.100203 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-43a03747-5a34-49ff-9975-35bde05467b3 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:17:52.102129 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-43a03747-5a34-49ff-9975-35bde05467b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:52.144800 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-04795a82-4874-4e9e-be58-16243f359979 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c7a4d678b3e46f4840051a25a3a10b6', 'request_id': 'req-04795a82-4874-4e9e-be58-16243f359979'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:52.158047 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-04795a82-4874-4e9e-be58-16243f359979 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c7a4d678b3e46f4840051a25a3a10b6', 'request_id': 'req-04795a82-4874-4e9e-be58-16243f359979'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:52.167453 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-04795a82-4874-4e9e-be58-16243f359979 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c7a4d678b3e46f4840051a25a3a10b6', 'request_id': 'req-04795a82-4874-4e9e-be58-16243f359979'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:52.185309 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-04795a82-4874-4e9e-be58-16243f359979 admin admin] The token cache is being invalidate because project 9c7a4d678b3e46f4840051a25a3a10b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:17:52.185929 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-04795a82-4874-4e9e-be58-16243f359979 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:52.186984 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-04795a82-4874-4e9e-be58-16243f359979 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:52.189144 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1030/2054] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 5 12:17:51 2022] DELETE /identity/v3/projects/9c7a4d678b3e46f4840051a25a3a10b6 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:17:52.189984 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04795a82-4874-4e9e-be58-16243f359979 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:52.191421 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-04795a82-4874-4e9e-be58-16243f359979 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:52.211284 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1025/2055] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:17:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:17:52.213178 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a03747-5a34-49ff-9975-35bde05467b3 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:52.216572 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-43a03747-5a34-49ff-9975-35bde05467b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:52.237827 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a03747-5a34-49ff-9975-35bde05467b3 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:52.238763 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:52.244695 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23d0e8a-becf-4074-b6db-4c75a8416352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:52.245422 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23d0e8a-becf-4074-b6db-4c75a8416352 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:52.245702 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23d0e8a-becf-4074-b6db-4c75a8416352 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:52.245976 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23d0e8a-becf-4074-b6db-4c75a8416352 admin admin] PATH_INFO: `/v3/users/0147e91c83ce435e8c773e0121b11a3e` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:52.247655 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23d0e8a-becf-4074-b6db-4c75a8416352 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0147e91c83ce435e8c773e0121b11a3e)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:52.249764 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23d0e8a-becf-4074-b6db-4c75a8416352 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:52.275853 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04795a82-4874-4e9e-be58-16243f359979 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:52.281353 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1112de-72b4-4842-8bd8-70b90894f596 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4994b4faa4ec4aa088f3dc32c9c5614d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:52.282064 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1112de-72b4-4842-8bd8-70b90894f596 service neutron] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:52.282432 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1112de-72b4-4842-8bd8-70b90894f596 service neutron] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:52.282562 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1112de-72b4-4842-8bd8-70b90894f596 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:52.284574 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-0a1112de-72b4-4842-8bd8-70b90894f596 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:52.298237 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1112de-72b4-4842-8bd8-70b90894f596 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:52.299689 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1112de-72b4-4842-8bd8-70b90894f596 service neutron] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:52.306804 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-a23d0e8a-becf-4074-b6db-4c75a8416352 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0147e91c83ce435e8c773e0121b11a3e'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:52.310741 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1031/2056] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:17:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:17:52.311425 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1112de-72b4-4842-8bd8-70b90894f596 service neutron] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:52.311543 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-a23d0e8a-becf-4074-b6db-4c75a8416352 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0147e91c83ce435e8c773e0121b11a3e'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:52.322460 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1112de-72b4-4842-8bd8-70b90894f596 service neutron] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:52.322871 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-a23d0e8a-becf-4074-b6db-4c75a8416352 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0147e91c83ce435e8c773e0121b11a3e'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:52.324545 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-a23d0e8a-becf-4074-b6db-4c75a8416352 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0147e91c83ce435e8c773e0121b11a3e'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:52.328117 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09b6011-25b2-4b5f-90ab-f1919988efb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:52.329474 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09b6011-25b2-4b5f-90ab-f1919988efb8 admin admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:52.329753 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09b6011-25b2-4b5f-90ab-f1919988efb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:52.330032 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09b6011-25b2-4b5f-90ab-f1919988efb8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:52.330707 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09b6011-25b2-4b5f-90ab-f1919988efb8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:17:52.330996 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09b6011-25b2-4b5f-90ab-f1919988efb8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:52.332775 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09b6011-25b2-4b5f-90ab-f1919988efb8 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:52.338290 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:52.351476 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1032/2057] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Sep 5 12:17:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:17:52.351693 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-a23d0e8a-becf-4074-b6db-4c75a8416352 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0147e91c83ce435e8c773e0121b11a3e'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:52.354862 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09b6011-25b2-4b5f-90ab-f1919988efb8 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:52.357900 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-a09b6011-25b2-4b5f-90ab-f1919988efb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:52.371102 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1026/2058] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 5 12:17:52 2022] DELETE /identity/v3/users/0147e91c83ce435e8c773e0121b11a3e => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:17:52.377120 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09b6011-25b2-4b5f-90ab-f1919988efb8 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:52.419374 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23d0e8a-becf-4074-b6db-4c75a8416352 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:52.420710 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-a23d0e8a-becf-4074-b6db-4c75a8416352 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:52.479424 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641c5062-838a-411a-9ba4-0c0836db678c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:52.481140 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641c5062-838a-411a-9ba4-0c0836db678c admin admin] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:52.481574 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641c5062-838a-411a-9ba4-0c0836db678c admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:52.482829 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641c5062-838a-411a-9ba4-0c0836db678c admin admin] PATH_INFO: `/v3/projects` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:52.483755 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641c5062-838a-411a-9ba4-0c0836db678c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:52.487447 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641c5062-838a-411a-9ba4-0c0836db678c admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:52.543643 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23d0e8a-becf-4074-b6db-4c75a8416352 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:52.547830 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1033/2059] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 5 12:17:52 2022] POST /identity/v3/projects => generated 369 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:17:52.550186 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641c5062-838a-411a-9ba4-0c0836db678c admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:52.637848 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7f90bd-9808-4e06-b9e7-df92586834ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:52.638955 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7f90bd-9808-4e06-b9e7-df92586834ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:52.639266 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7f90bd-9808-4e06-b9e7-df92586834ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:52.639615 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7f90bd-9808-4e06-b9e7-df92586834ec admin admin] PATH_INFO: `/v3/users/454de62c6aaf4f6c85ddecc5c8cd6924` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:52.642631 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7f90bd-9808-4e06-b9e7-df92586834ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=454de62c6aaf4f6c85ddecc5c8cd6924)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:52.644961 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7f90bd-9808-4e06-b9e7-df92586834ec admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:52.694168 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641c5062-838a-411a-9ba4-0c0836db678c admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:52.702436 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203a0f48-3ce1-4933-939b-0ed30a926ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:52.702436 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203a0f48-3ce1-4933-939b-0ed30a926ae4 admin admin] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:52.702436 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203a0f48-3ce1-4933-939b-0ed30a926ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:52.702782 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203a0f48-3ce1-4933-939b-0ed30a926ae4 admin admin] PATH_INFO: `/v3/users` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:52.703675 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203a0f48-3ce1-4933-939b-0ed30a926ae4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:52.706869 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203a0f48-3ce1-4933-939b-0ed30a926ae4 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:52.744990 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1034/2060] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 5 12:17:52 2022] POST /identity/v3/users => generated 285 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:17:52.744990 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203a0f48-3ce1-4933-939b-0ed30a926ae4 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:52.746265 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-203a0f48-3ce1-4933-939b-0ed30a926ae4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:52.753406 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-1c7f90bd-9808-4e06-b9e7-df92586834ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '454de62c6aaf4f6c85ddecc5c8cd6924'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:52.754238 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-1c7f90bd-9808-4e06-b9e7-df92586834ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '454de62c6aaf4f6c85ddecc5c8cd6924'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:52.776886 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-1c7f90bd-9808-4e06-b9e7-df92586834ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '454de62c6aaf4f6c85ddecc5c8cd6924'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:52.778200 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-1c7f90bd-9808-4e06-b9e7-df92586834ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '454de62c6aaf4f6c85ddecc5c8cd6924'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:52.800770 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203a0f48-3ce1-4933-939b-0ed30a926ae4 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:52.809825 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-1c7f90bd-9808-4e06-b9e7-df92586834ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '454de62c6aaf4f6c85ddecc5c8cd6924'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:52.812826 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f8f113-844b-42cd-9393-95a56aff8eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:52.814086 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f8f113-844b-42cd-9393-95a56aff8eba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:52.814471 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f8f113-844b-42cd-9393-95a56aff8eba admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:52.814860 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f8f113-844b-42cd-9393-95a56aff8eba admin admin] PATH_INFO: `/v3/projects/f7f230b525a14679b117b5d660ee628c` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:52.816279 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f8f113-844b-42cd-9393-95a56aff8eba admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7f230b525a14679b117b5d660ee628c)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:52.818827 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f8f113-844b-42cd-9393-95a56aff8eba admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:52.865202 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1027/2061] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 5 12:17:52 2022] DELETE /identity/v3/users/454de62c6aaf4f6c85ddecc5c8cd6924 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 12:17:52.865202 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7f90bd-9808-4e06-b9e7-df92586834ec admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:52.871026 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-1c7f90bd-9808-4e06-b9e7-df92586834ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:52.897544 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:52.911615 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:52.932547 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-a5f8f113-844b-42cd-9393-95a56aff8eba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7f230b525a14679b117b5d660ee628c', 'request_id': 'req-a5f8f113-844b-42cd-9393-95a56aff8eba'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:52.949554 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-a5f8f113-844b-42cd-9393-95a56aff8eba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7f230b525a14679b117b5d660ee628c', 'request_id': 'req-a5f8f113-844b-42cd-9393-95a56aff8eba'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:52.964425 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-a5f8f113-844b-42cd-9393-95a56aff8eba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7f230b525a14679b117b5d660ee628c', 'request_id': 'req-a5f8f113-844b-42cd-9393-95a56aff8eba'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:52.985503 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-a5f8f113-844b-42cd-9393-95a56aff8eba admin admin] The token cache is being invalidate because project f7f230b525a14679b117b5d660ee628c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:17:52.986145 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-a5f8f113-844b-42cd-9393-95a56aff8eba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:52.986981 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-a5f8f113-844b-42cd-9393-95a56aff8eba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:52.989255 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1035/2062] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 5 12:17:52 2022] DELETE /identity/v3/projects/f7f230b525a14679b117b5d660ee628c => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:17:52.992603 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d956d6-0841-407b-ac4b-d182e808f830 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:52.992992 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d956d6-0841-407b-ac4b-d182e808f830 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:52.993549 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d956d6-0841-407b-ac4b-d182e808f830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:52.994780 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7f90bd-9808-4e06-b9e7-df92586834ec admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:53.033245 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-c5d956d6-0841-407b-ac4b-d182e808f830 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:17:53.034525 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-c5d956d6-0841-407b-ac4b-d182e808f830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:53.070567 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39952b9-31b0-49f2-ad6b-d605c8397a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:53.071269 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39952b9-31b0-49f2-ad6b-d605c8397a36 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:53.071616 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39952b9-31b0-49f2-ad6b-d605c8397a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:53.071961 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39952b9-31b0-49f2-ad6b-d605c8397a36 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:53.072713 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39952b9-31b0-49f2-ad6b-d605c8397a36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:53.074746 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39952b9-31b0-49f2-ad6b-d605c8397a36 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:53.090673 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1028/2063] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:17:52 2022] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:17:53.090673 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39952b9-31b0-49f2-ad6b-d605c8397a36 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:53.092516 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-b39952b9-31b0-49f2-ad6b-d605c8397a36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:53.107544 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39952b9-31b0-49f2-ad6b-d605c8397a36 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:53.112267 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aab825-0506-4693-8452-0472eec8cb27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:53.113214 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aab825-0506-4693-8452-0472eec8cb27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:53.113589 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aab825-0506-4693-8452-0472eec8cb27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:53.113963 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aab825-0506-4693-8452-0472eec8cb27 admin admin] PATH_INFO: `/v3/projects/198d46d67d63499e975633871fd1aa3b` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:53.115299 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aab825-0506-4693-8452-0472eec8cb27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=198d46d67d63499e975633871fd1aa3b)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:53.118100 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aab825-0506-4693-8452-0472eec8cb27 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:53.140954 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1036/2064] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:17:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:17:53.143519 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bff4da-51f1-40c8-9466-de5ae7e3d181 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:53.144001 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bff4da-51f1-40c8-9466-de5ae7e3d181 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:53.162527 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bff4da-51f1-40c8-9466-de5ae7e3d181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:53.183471 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-d6aab825-0506-4693-8452-0472eec8cb27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '198d46d67d63499e975633871fd1aa3b', 'request_id': 'req-d6aab825-0506-4693-8452-0472eec8cb27'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:53.195615 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-83bff4da-51f1-40c8-9466-de5ae7e3d181 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:17:53.197186 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-83bff4da-51f1-40c8-9466-de5ae7e3d181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:53.198404 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-d6aab825-0506-4693-8452-0472eec8cb27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '198d46d67d63499e975633871fd1aa3b', 'request_id': 'req-d6aab825-0506-4693-8452-0472eec8cb27'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:53.210386 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-d6aab825-0506-4693-8452-0472eec8cb27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '198d46d67d63499e975633871fd1aa3b', 'request_id': 'req-d6aab825-0506-4693-8452-0472eec8cb27'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:53.223078 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-d6aab825-0506-4693-8452-0472eec8cb27 admin admin] The token cache is being invalidate because project 198d46d67d63499e975633871fd1aa3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:17:53.223421 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-d6aab825-0506-4693-8452-0472eec8cb27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:53.224470 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-d6aab825-0506-4693-8452-0472eec8cb27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:53.226243 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1029/2065] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 5 12:17:53 2022] DELETE /identity/v3/projects/198d46d67d63499e975633871fd1aa3b => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:17:53.227192 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aab825-0506-4693-8452-0472eec8cb27 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:53.231456 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-d6aab825-0506-4693-8452-0472eec8cb27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:53.280503 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:53.291380 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1037/2066] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:17:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:17:53.293096 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bff4da-51f1-40c8-9466-de5ae7e3d181 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:53.296017 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-83bff4da-51f1-40c8-9466-de5ae7e3d181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:53.320185 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aab825-0506-4693-8452-0472eec8cb27 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:53.325661 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89293fa5-3dfb-4687-895b-6f935bc17e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:53.326275 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89293fa5-3dfb-4687-895b-6f935bc17e85 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:53.326558 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89293fa5-3dfb-4687-895b-6f935bc17e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:53.326854 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89293fa5-3dfb-4687-895b-6f935bc17e85 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:53.327808 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89293fa5-3dfb-4687-895b-6f935bc17e85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:53.330289 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89293fa5-3dfb-4687-895b-6f935bc17e85 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:53.346204 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1030/2067] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:17:53 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:17:53.348236 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7225f94-9525-48e3-8637-bcca99e6f5c3 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:53.348582 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7225f94-9525-48e3-8637-bcca99e6f5c3 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:53.349166 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7225f94-9525-48e3-8637-bcca99e6f5c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:53.366187 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bff4da-51f1-40c8-9466-de5ae7e3d181 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:53.370263 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd995e64-4199-4f33-ad98-fef681f2d5dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4994b4faa4ec4aa088f3dc32c9c5614d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:53.371103 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd995e64-4199-4f33-ad98-fef681f2d5dd service neutron] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:53.371407 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd995e64-4199-4f33-ad98-fef681f2d5dd service neutron] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:53.371705 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd995e64-4199-4f33-ad98-fef681f2d5dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:53.373580 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-cd995e64-4199-4f33-ad98-fef681f2d5dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:53.375406 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-a7225f94-9525-48e3-8637-bcca99e6f5c3 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:17:53.376883 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-a7225f94-9525-48e3-8637-bcca99e6f5c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:53.385834 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1031/2068] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:17:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:17:53.387009 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7225f94-9525-48e3-8637-bcca99e6f5c3 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:53.388337 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-a7225f94-9525-48e3-8637-bcca99e6f5c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:53.389874 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd995e64-4199-4f33-ad98-fef681f2d5dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:53.392281 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd995e64-4199-4f33-ad98-fef681f2d5dd service neutron] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:53.403431 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7225f94-9525-48e3-8637-bcca99e6f5c3 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:53.405991 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1038/2069] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:17:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:17:53.407555 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59e1135-4bc3-4ce7-abe0-198077432e8e None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:53.407846 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59e1135-4bc3-4ce7-abe0-198077432e8e None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:53.408125 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59e1135-4bc3-4ce7-abe0-198077432e8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:53.408348 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c82b5c6-7355-4de6-8eb2-4f587b398cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:53.409091 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c82b5c6-7355-4de6-8eb2-4f587b398cc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:53.409471 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c82b5c6-7355-4de6-8eb2-4f587b398cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:53.409964 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c82b5c6-7355-4de6-8eb2-4f587b398cc9 admin admin] PATH_INFO: `/v3/users/a7203ec90eb04025a8d39395f9fa2cb0` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:53.411133 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c82b5c6-7355-4de6-8eb2-4f587b398cc9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7203ec90eb04025a8d39395f9fa2cb0)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:53.413205 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c82b5c6-7355-4de6-8eb2-4f587b398cc9 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:53.418883 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:53.436827 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-d59e1135-4bc3-4ce7-abe0-198077432e8e None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:17:53.437716 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-d59e1135-4bc3-4ce7-abe0-198077432e8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:53.448009 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1039/2070] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:17:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:17:53.452310 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59e1135-4bc3-4ce7-abe0-198077432e8e None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:53.462608 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59e1135-4bc3-4ce7-abe0-198077432e8e None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:53.468676 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d90cdd7-ce48-459c-920d-eef5144407cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:53.469569 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d90cdd7-ce48-459c-920d-eef5144407cd admin admin] REQUEST_METHOD: `PUT` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:53.470000 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d90cdd7-ce48-459c-920d-eef5144407cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:53.470454 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d90cdd7-ce48-459c-920d-eef5144407cd admin admin] PATH_INFO: `/v3/projects/8e8fd40c5e54486297b6c1dcc0f34ffe/users/45ecf27899e84968be1683fa3abaa991/roles/ed72181e1403401facb77dcf33644757` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:53.473899 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-8c82b5c6-7355-4de6-8eb2-4f587b398cc9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7203ec90eb04025a8d39395f9fa2cb0'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:53.475764 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-8c82b5c6-7355-4de6-8eb2-4f587b398cc9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7203ec90eb04025a8d39395f9fa2cb0'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:53.488341 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-8c82b5c6-7355-4de6-8eb2-4f587b398cc9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7203ec90eb04025a8d39395f9fa2cb0'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:53.489369 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-8c82b5c6-7355-4de6-8eb2-4f587b398cc9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7203ec90eb04025a8d39395f9fa2cb0'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:53.491514 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d90cdd7-ce48-459c-920d-eef5144407cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e8fd40c5e54486297b6c1dcc0f34ffe, user_id=45ecf27899e84968be1683fa3abaa991, role_id=ed72181e1403401facb77dcf33644757)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:53.494833 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d90cdd7-ce48-459c-920d-eef5144407cd admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:53.506647 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-8c82b5c6-7355-4de6-8eb2-4f587b398cc9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7203ec90eb04025a8d39395f9fa2cb0'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:53.517093 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1040/2071] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 5 12:17:53 2022] PUT /identity/v3/projects/8e8fd40c5e54486297b6c1dcc0f34ffe/users/45ecf27899e84968be1683fa3abaa991/roles/ed72181e1403401facb77dcf33644757 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:17:53.519757 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87688d6-83ae-45df-9d47-4b28284470a4 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:53.520542 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87688d6-83ae-45df-9d47-4b28284470a4 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:53.521056 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87688d6-83ae-45df-9d47-4b28284470a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:53.525663 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1032/2072] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 5 12:17:53 2022] DELETE /identity/v3/users/a7203ec90eb04025a8d39395f9fa2cb0 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:17:53.527467 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c82b5c6-7355-4de6-8eb2-4f587b398cc9 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:53.529012 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-8c82b5c6-7355-4de6-8eb2-4f587b398cc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:53.550144 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-a87688d6-83ae-45df-9d47-4b28284470a4 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:17:53.551373 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-a87688d6-83ae-45df-9d47-4b28284470a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:53.616458 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c82b5c6-7355-4de6-8eb2-4f587b398cc9 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:53.622343 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de9e54d-348d-42a0-a19c-269b5a5b639b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:53.623054 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de9e54d-348d-42a0-a19c-269b5a5b639b admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:53.623404 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de9e54d-348d-42a0-a19c-269b5a5b639b admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:53.623747 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de9e54d-348d-42a0-a19c-269b5a5b639b admin admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:53.624480 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de9e54d-348d-42a0-a19c-269b5a5b639b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:17:53.624854 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de9e54d-348d-42a0-a19c-269b5a5b639b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:53.626632 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de9e54d-348d-42a0-a19c-269b5a5b639b admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:53.630795 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1041/2073] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:17:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:17:53.630795 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa577872-24ab-4dcb-a979-df8cb1ef5f46 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:53.630795 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa577872-24ab-4dcb-a979-df8cb1ef5f46 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:53.630795 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa577872-24ab-4dcb-a979-df8cb1ef5f46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:53.648125 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1033/2074] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Sep 5 12:17:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:17:53.648125 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f09e1b-5140-4be5-8379-7b060d6c3a74 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:53.648125 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f09e1b-5140-4be5-8379-7b060d6c3a74 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:53.648125 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f09e1b-5140-4be5-8379-7b060d6c3a74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:53.668685 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-31f09e1b-5140-4be5-8379-7b060d6c3a74 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:17:53.670091 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-31f09e1b-5140-4be5-8379-7b060d6c3a74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:53.678234 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-aa577872-24ab-4dcb-a979-df8cb1ef5f46 None None] MFA Rules not processed for user `45ecf27899e84968be1683fa3abaa991`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:17:53.682146 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1034/2075] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:17:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:17:53.682311 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-aa577872-24ab-4dcb-a979-df8cb1ef5f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:53.682431 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f09e1b-5140-4be5-8379-7b060d6c3a74 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:53.695894 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f09e1b-5140-4be5-8379-7b060d6c3a74 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:53.702848 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af44ddcb-6025-495c-89ff-97cec62365a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:53.703487 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af44ddcb-6025-495c-89ff-97cec62365a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:53.704167 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af44ddcb-6025-495c-89ff-97cec62365a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:53.704167 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af44ddcb-6025-495c-89ff-97cec62365a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:53.704706 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af44ddcb-6025-495c-89ff-97cec62365a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:17:53.705071 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af44ddcb-6025-495c-89ff-97cec62365a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:53.707601 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af44ddcb-6025-495c-89ff-97cec62365a6 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:53.726418 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1035/2076] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Sep 5 12:17:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:17:53.726418 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af44ddcb-6025-495c-89ff-97cec62365a6 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:53.735461 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af44ddcb-6025-495c-89ff-97cec62365a6 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:53.741449 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718dfa0c-9071-4ad0-b33b-860ec96526e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:53.742200 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718dfa0c-9071-4ad0-b33b-860ec96526e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:53.742532 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718dfa0c-9071-4ad0-b33b-860ec96526e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:53.742879 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718dfa0c-9071-4ad0-b33b-860ec96526e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:53.743616 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718dfa0c-9071-4ad0-b33b-860ec96526e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:53.745793 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718dfa0c-9071-4ad0-b33b-860ec96526e1 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:53.752723 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:53.792760 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1036/2077] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 5 12:17:53 2022] POST /identity/v3/projects => generated 383 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:17:53.795489 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718dfa0c-9071-4ad0-b33b-860ec96526e1 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:53.800326 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-718dfa0c-9071-4ad0-b33b-860ec96526e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:53.810278 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1042/2078] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:17:53 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:17:53.811166 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa577872-24ab-4dcb-a979-df8cb1ef5f46 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:53.833159 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa577872-24ab-4dcb-a979-df8cb1ef5f46 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:53.892142 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718dfa0c-9071-4ad0-b33b-860ec96526e1 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:53.895990 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aafe47-85d1-4cc1-a85c-a57cfa3ad13f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4994b4faa4ec4aa088f3dc32c9c5614d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:53.896733 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aafe47-85d1-4cc1-a85c-a57cfa3ad13f service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:53.896970 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aafe47-85d1-4cc1-a85c-a57cfa3ad13f service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:53.897278 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aafe47-85d1-4cc1-a85c-a57cfa3ad13f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:53.905865 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d090d27-b600-4060-8a40-7aa9d181d2d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:53.907162 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d090d27-b600-4060-8a40-7aa9d181d2d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:53.908014 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d090d27-b600-4060-8a40-7aa9d181d2d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:53.908014 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d090d27-b600-4060-8a40-7aa9d181d2d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:53.908564 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d090d27-b600-4060-8a40-7aa9d181d2d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:53.910618 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d090d27-b600-4060-8a40-7aa9d181d2d0 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:53.922922 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:53.949737 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1043/2079] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 5 12:17:53 2022] POST /identity/v3/projects => generated 409 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:17:53.953995 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d090d27-b600-4060-8a40-7aa9d181d2d0 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:53.977105 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aafe47-85d1-4cc1-a85c-a57cfa3ad13f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:53.978595 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aafe47-85d1-4cc1-a85c-a57cfa3ad13f service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:53.990170 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1037/2080] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:17:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:17:53.990918 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aafe47-85d1-4cc1-a85c-a57cfa3ad13f service neutron] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:53.992387 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-09aafe47-85d1-4cc1-a85c-a57cfa3ad13f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:54.037264 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d090d27-b600-4060-8a40-7aa9d181d2d0 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:54.053862 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d85930a-31f1-4742-b129-de5c1dcd7f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:54.054790 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d85930a-31f1-4742-b129-de5c1dcd7f8b admin admin] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:54.055076 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d85930a-31f1-4742-b129-de5c1dcd7f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:54.055349 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d85930a-31f1-4742-b129-de5c1dcd7f8b admin admin] PATH_INFO: `/v3/users` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:54.056213 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d85930a-31f1-4742-b129-de5c1dcd7f8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:54.059523 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d85930a-31f1-4742-b129-de5c1dcd7f8b admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:54.100193 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1044/2081] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 5 12:17:53 2022] POST /identity/v3/users => generated 292 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:17:54.100193 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d85930a-31f1-4742-b129-de5c1dcd7f8b admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:54.100469 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-9d85930a-31f1-4742-b129-de5c1dcd7f8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:54.111199 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aafe47-85d1-4cc1-a85c-a57cfa3ad13f service neutron] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:54.119899 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d85930a-31f1-4742-b129-de5c1dcd7f8b admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:54.125500 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2edeab-a437-4c7f-9510-d1374a42ae4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:54.127239 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2edeab-a437-4c7f-9510-d1374a42ae4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:54.127239 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2edeab-a437-4c7f-9510-d1374a42ae4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:54.127239 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2edeab-a437-4c7f-9510-d1374a42ae4e admin admin] PATH_INFO: `/v3/projects/d8643c648d0c4193b1206794742a4ad0` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:54.127913 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2edeab-a437-4c7f-9510-d1374a42ae4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8643c648d0c4193b1206794742a4ad0)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:54.129897 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2edeab-a437-4c7f-9510-d1374a42ae4e admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:54.161855 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:54.199395 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe1c309-9a9e-4d15-84de-531d56f01680 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b08e831af84a658b0f5b28ad03e4f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:54.200042 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe1c309-9a9e-4d15-84de-531d56f01680 service glance] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:54.200515 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe1c309-9a9e-4d15-84de-531d56f01680 service glance] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:54.200661 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe1c309-9a9e-4d15-84de-531d56f01680 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:54.205091 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-5b2edeab-a437-4c7f-9510-d1374a42ae4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8643c648d0c4193b1206794742a4ad0', 'request_id': 'req-5b2edeab-a437-4c7f-9510-d1374a42ae4e'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:54.218344 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-5b2edeab-a437-4c7f-9510-d1374a42ae4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8643c648d0c4193b1206794742a4ad0', 'request_id': 'req-5b2edeab-a437-4c7f-9510-d1374a42ae4e'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:54.228445 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-5b2edeab-a437-4c7f-9510-d1374a42ae4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8643c648d0c4193b1206794742a4ad0', 'request_id': 'req-5b2edeab-a437-4c7f-9510-d1374a42ae4e'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:54.243004 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-5b2edeab-a437-4c7f-9510-d1374a42ae4e admin admin] The token cache is being invalidate because project d8643c648d0c4193b1206794742a4ad0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:17:54.243309 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-5b2edeab-a437-4c7f-9510-d1374a42ae4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:54.244013 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-5b2edeab-a437-4c7f-9510-d1374a42ae4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:54.249306 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1045/2082] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 5 12:17:54 2022] DELETE /identity/v3/projects/d8643c648d0c4193b1206794742a4ad0 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:17:54.250155 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2edeab-a437-4c7f-9510-d1374a42ae4e admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:54.251948 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-5b2edeab-a437-4c7f-9510-d1374a42ae4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:54.273361 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe1c309-9a9e-4d15-84de-531d56f01680 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:54.274839 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe1c309-9a9e-4d15-84de-531d56f01680 service glance] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:54.287921 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1038/2083] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:17:53 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:17:54.288992 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe1c309-9a9e-4d15-84de-531d56f01680 service glance] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:54.309325 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe1c309-9a9e-4d15-84de-531d56f01680 service glance] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:54.335405 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2edeab-a437-4c7f-9510-d1374a42ae4e admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:54.342067 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f792f9c9-7617-4d52-9971-d65fee1c7918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:54.343036 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f792f9c9-7617-4d52-9971-d65fee1c7918 admin admin] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:54.348510 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f792f9c9-7617-4d52-9971-d65fee1c7918 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:54.348510 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f792f9c9-7617-4d52-9971-d65fee1c7918 admin admin] PATH_INFO: `/v3/users` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:54.348510 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f792f9c9-7617-4d52-9971-d65fee1c7918 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:54.349124 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f792f9c9-7617-4d52-9971-d65fee1c7918 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:54.359576 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:54.382271 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1046/2084] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 5 12:17:54 2022] POST /identity/v3/users => generated 305 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:17:54.387194 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f792f9c9-7617-4d52-9971-d65fee1c7918 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:54.389621 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-f792f9c9-7617-4d52-9971-d65fee1c7918 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:54.396267 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3776d050-d1ee-465e-8b60-9412de491045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:54.397040 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3776d050-d1ee-465e-8b60-9412de491045 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:54.397384 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3776d050-d1ee-465e-8b60-9412de491045 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:54.397719 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3776d050-d1ee-465e-8b60-9412de491045 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:54.398437 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3776d050-d1ee-465e-8b60-9412de491045 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:54.400692 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3776d050-d1ee-465e-8b60-9412de491045 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:54.402765 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f792f9c9-7617-4d52-9971-d65fee1c7918 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:54.408009 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b490ff2-6c87-41d0-915e-d4e84320039d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:54.408960 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b490ff2-6c87-41d0-915e-d4e84320039d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:54.409387 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b490ff2-6c87-41d0-915e-d4e84320039d admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:54.409806 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b490ff2-6c87-41d0-915e-d4e84320039d admin admin] PATH_INFO: `/v3/users/80743778674e45afb166b6fa42b5c1d5` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:54.411108 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b490ff2-6c87-41d0-915e-d4e84320039d admin admin] RBAC: Authorizing `identity:delete_user(user_id=80743778674e45afb166b6fa42b5c1d5)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:54.414817 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1039/2085] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:17:54 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:17:54.414817 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3776d050-d1ee-465e-8b60-9412de491045 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:54.415571 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-3776d050-d1ee-465e-8b60-9412de491045 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:54.416679 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b490ff2-6c87-41d0-915e-d4e84320039d admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:54.430707 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3776d050-d1ee-465e-8b60-9412de491045 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:54.436008 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a27fa6-a09b-4f87-80ff-f37612b07081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:54.436649 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a27fa6-a09b-4f87-80ff-f37612b07081 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:54.437017 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a27fa6-a09b-4f87-80ff-f37612b07081 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:54.437365 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a27fa6-a09b-4f87-80ff-f37612b07081 admin admin] PATH_INFO: `/v3/projects/4b2186fd152249009e585cd59c58d510` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:54.438490 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a27fa6-a09b-4f87-80ff-f37612b07081 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b2186fd152249009e585cd59c58d510)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:54.445674 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a27fa6-a09b-4f87-80ff-f37612b07081 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:54.471268 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-6b490ff2-6c87-41d0-915e-d4e84320039d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80743778674e45afb166b6fa42b5c1d5'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:54.472001 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-6b490ff2-6c87-41d0-915e-d4e84320039d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80743778674e45afb166b6fa42b5c1d5'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:54.481716 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-6b490ff2-6c87-41d0-915e-d4e84320039d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80743778674e45afb166b6fa42b5c1d5'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:54.482362 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-6b490ff2-6c87-41d0-915e-d4e84320039d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80743778674e45afb166b6fa42b5c1d5'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:54.501281 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-6b490ff2-6c87-41d0-915e-d4e84320039d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80743778674e45afb166b6fa42b5c1d5'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:54.502216 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-c2a27fa6-a09b-4f87-80ff-f37612b07081 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b2186fd152249009e585cd59c58d510', 'request_id': 'req-c2a27fa6-a09b-4f87-80ff-f37612b07081'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:54.511934 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-c2a27fa6-a09b-4f87-80ff-f37612b07081 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b2186fd152249009e585cd59c58d510', 'request_id': 'req-c2a27fa6-a09b-4f87-80ff-f37612b07081'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:54.514984 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1047/2086] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 5 12:17:54 2022] DELETE /identity/v3/users/80743778674e45afb166b6fa42b5c1d5 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:17:54.515946 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b490ff2-6c87-41d0-915e-d4e84320039d admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:54.518047 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-6b490ff2-6c87-41d0-915e-d4e84320039d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:54.523691 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-c2a27fa6-a09b-4f87-80ff-f37612b07081 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b2186fd152249009e585cd59c58d510', 'request_id': 'req-c2a27fa6-a09b-4f87-80ff-f37612b07081'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:54.543696 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-c2a27fa6-a09b-4f87-80ff-f37612b07081 admin admin] The token cache is being invalidate because project 4b2186fd152249009e585cd59c58d510 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:17:54.543994 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-c2a27fa6-a09b-4f87-80ff-f37612b07081 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:54.545188 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-c2a27fa6-a09b-4f87-80ff-f37612b07081 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:54.546793 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1040/2087] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 5 12:17:54 2022] DELETE /identity/v3/projects/4b2186fd152249009e585cd59c58d510 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:17:54.547781 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a27fa6-a09b-4f87-80ff-f37612b07081 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:54.549528 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-c2a27fa6-a09b-4f87-80ff-f37612b07081 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:54.560733 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:54.619537 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b490ff2-6c87-41d0-915e-d4e84320039d admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:54.629128 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84827ef2-2b0b-485b-8ab1-c0abc4d9f92b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:54.629828 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84827ef2-2b0b-485b-8ab1-c0abc4d9f92b admin admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:54.630179 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84827ef2-2b0b-485b-8ab1-c0abc4d9f92b admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:54.630565 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84827ef2-2b0b-485b-8ab1-c0abc4d9f92b admin admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:54.631747 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84827ef2-2b0b-485b-8ab1-c0abc4d9f92b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:54.633689 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84827ef2-2b0b-485b-8ab1-c0abc4d9f92b admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:54.648105 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a27fa6-a09b-4f87-80ff-f37612b07081 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:54.649014 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1048/2088] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:17:54 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:17:54.649891 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84827ef2-2b0b-485b-8ab1-c0abc4d9f92b admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:54.651918 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-84827ef2-2b0b-485b-8ab1-c0abc4d9f92b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:54.655624 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dedac8-22c4-45dc-a527-7ca8119a99cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:54.656809 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dedac8-22c4-45dc-a527-7ca8119a99cf admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:54.657257 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dedac8-22c4-45dc-a527-7ca8119a99cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:54.658235 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dedac8-22c4-45dc-a527-7ca8119a99cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:54.659155 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dedac8-22c4-45dc-a527-7ca8119a99cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:54.661137 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dedac8-22c4-45dc-a527-7ca8119a99cf admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:54.672458 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84827ef2-2b0b-485b-8ab1-c0abc4d9f92b admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:54.679159 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdc3338-fe31-4b94-9e85-e347c4ed35d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:54.680042 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdc3338-fe31-4b94-9e85-e347c4ed35d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:54.680794 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdc3338-fe31-4b94-9e85-e347c4ed35d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:54.681293 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdc3338-fe31-4b94-9e85-e347c4ed35d9 admin admin] PATH_INFO: `/v3/users/024b138a684b418cbc3af7881fd55c84` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:54.682054 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1041/2089] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:17:54 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:17:54.683545 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dedac8-22c4-45dc-a527-7ca8119a99cf admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:54.684084 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdc3338-fe31-4b94-9e85-e347c4ed35d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=024b138a684b418cbc3af7881fd55c84)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:54.686506 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdc3338-fe31-4b94-9e85-e347c4ed35d9 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:54.689805 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-50dedac8-22c4-45dc-a527-7ca8119a99cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:54.716473 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dedac8-22c4-45dc-a527-7ca8119a99cf admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:54.729213 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf22fbbf-bc72-4419-867c-9a7fcccba046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:54.732967 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf22fbbf-bc72-4419-867c-9a7fcccba046 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:54.734709 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf22fbbf-bc72-4419-867c-9a7fcccba046 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:54.734709 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf22fbbf-bc72-4419-867c-9a7fcccba046 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:54.734709 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf22fbbf-bc72-4419-867c-9a7fcccba046 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:54.737029 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf22fbbf-bc72-4419-867c-9a7fcccba046 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:54.766382 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1042/2090] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:17:54 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:17:54.768441 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf22fbbf-bc72-4419-867c-9a7fcccba046 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:54.769761 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-bbdc3338-fe31-4b94-9e85-e347c4ed35d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '024b138a684b418cbc3af7881fd55c84'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:54.771539 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-bbdc3338-fe31-4b94-9e85-e347c4ed35d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '024b138a684b418cbc3af7881fd55c84'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:54.774289 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-bf22fbbf-bc72-4419-867c-9a7fcccba046 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:54.787545 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-bbdc3338-fe31-4b94-9e85-e347c4ed35d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '024b138a684b418cbc3af7881fd55c84'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:54.788384 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-bbdc3338-fe31-4b94-9e85-e347c4ed35d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '024b138a684b418cbc3af7881fd55c84'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:54.790557 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:INSERT=4,keystone:SELECT=78,keystone:DELETE=18 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:54.802935 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf22fbbf-bc72-4419-867c-9a7fcccba046 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:54.810384 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22329b2-36a3-4da8-a6b7-32a30a22294a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:54.811458 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22329b2-36a3-4da8-a6b7-32a30a22294a admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:54.811741 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22329b2-36a3-4da8-a6b7-32a30a22294a admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:54.812005 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22329b2-36a3-4da8-a6b7-32a30a22294a admin admin] PATH_INFO: `/v3/projects/797a68d44bf442aa8ecc42f3e667a742/users/9e4db324ccaf4ff4898c778fc1a1b4bf/roles/ed72181e1403401facb77dcf33644757` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:54.813194 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-bbdc3338-fe31-4b94-9e85-e347c4ed35d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '024b138a684b418cbc3af7881fd55c84'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:54.831179 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22329b2-36a3-4da8-a6b7-32a30a22294a admin admin] RBAC: Authorizing `identity:create_grant(project_id=797a68d44bf442aa8ecc42f3e667a742, user_id=9e4db324ccaf4ff4898c778fc1a1b4bf, role_id=ed72181e1403401facb77dcf33644757)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:54.834617 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22329b2-36a3-4da8-a6b7-32a30a22294a admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:54.838309 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1049/2091] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 5 12:17:54 2022] DELETE /identity/v3/users/024b138a684b418cbc3af7881fd55c84 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:17:54.840104 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdc3338-fe31-4b94-9e85-e347c4ed35d9 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:54.845428 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-bbdc3338-fe31-4b94-9e85-e347c4ed35d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:54.863470 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1043/2092] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 5 12:17:54 2022] PUT /identity/v3/projects/797a68d44bf442aa8ecc42f3e667a742/users/9e4db324ccaf4ff4898c778fc1a1b4bf/roles/ed72181e1403401facb77dcf33644757 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:17:54.876817 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b6ba0e-c409-4938-b6d6-924184d71725 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:54.877113 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b6ba0e-c409-4938-b6d6-924184d71725 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:54.877640 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b6ba0e-c409-4938-b6d6-924184d71725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:54.941853 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-50b6ba0e-c409-4938-b6d6-924184d71725 None None] MFA Rules not processed for user `9e4db324ccaf4ff4898c778fc1a1b4bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:17:54.943084 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-50b6ba0e-c409-4938-b6d6-924184d71725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:55.023916 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdc3338-fe31-4b94-9e85-e347c4ed35d9 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:55.077951 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1044/2093] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:17:54 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 12:17:55.080442 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b6ba0e-c409-4938-b6d6-924184d71725 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:55.083013 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-50b6ba0e-c409-4938-b6d6-924184d71725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:55.108156 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e8bc8a-be04-491a-ae01-e79986b61269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:55.109168 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e8bc8a-be04-491a-ae01-e79986b61269 admin admin] REQUEST_METHOD: `PUT` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:55.109542 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e8bc8a-be04-491a-ae01-e79986b61269 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:55.110343 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e8bc8a-be04-491a-ae01-e79986b61269 admin admin] PATH_INFO: `/v3/projects/34fb77d8fb9c4c1884001f8748bf4469/users/227539f3d3844b15a456c937edbe955e/roles/ed72181e1403401facb77dcf33644757` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:55.126937 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e8bc8a-be04-491a-ae01-e79986b61269 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34fb77d8fb9c4c1884001f8748bf4469, user_id=227539f3d3844b15a456c937edbe955e, role_id=ed72181e1403401facb77dcf33644757)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:55.129936 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e8bc8a-be04-491a-ae01-e79986b61269 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:55.148330 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1050/2094] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 5 12:17:54 2022] PUT /identity/v3/projects/34fb77d8fb9c4c1884001f8748bf4469/users/227539f3d3844b15a456c937edbe955e/roles/ed72181e1403401facb77dcf33644757 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:17:55.149957 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e8bc8a-be04-491a-ae01-e79986b61269 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:55.173529 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:55.179037 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b6ba0e-c409-4938-b6d6-924184d71725 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:55.225439 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e8bc8a-be04-491a-ae01-e79986b61269 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:55.230596 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e8fbae-9aab-4472-aa55-0eb14096d436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:55.231353 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e8fbae-9aab-4472-aa55-0eb14096d436 admin admin] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:55.231638 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e8fbae-9aab-4472-aa55-0eb14096d436 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:55.231911 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e8fbae-9aab-4472-aa55-0eb14096d436 admin admin] PATH_INFO: `/v3/projects` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:55.232553 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e8fbae-9aab-4472-aa55-0eb14096d436 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:55.234488 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e8fbae-9aab-4472-aa55-0eb14096d436 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:55.240752 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:55.261742 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069e5429-2a5d-4271-8e2f-810f5f1585ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:55.262712 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069e5429-2a5d-4271-8e2f-810f5f1585ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:55.263063 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069e5429-2a5d-4271-8e2f-810f5f1585ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:55.263395 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069e5429-2a5d-4271-8e2f-810f5f1585ed admin admin] PATH_INFO: `/v3/projects/c95966d652054b9492ddbad6074bad33` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:55.264751 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069e5429-2a5d-4271-8e2f-810f5f1585ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=c95966d652054b9492ddbad6074bad33)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:55.267543 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069e5429-2a5d-4271-8e2f-810f5f1585ed admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:55.269395 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1051/2095] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 5 12:17:55 2022] POST /identity/v3/projects => generated 385 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:17:55.273778 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d531956-b6a5-481b-810f-f8f6fccf0629 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:55.274135 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d531956-b6a5-481b-810f-f8f6fccf0629 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:55.274477 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d531956-b6a5-481b-810f-f8f6fccf0629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:55.309933 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-0d531956-b6a5-481b-810f-f8f6fccf0629 None None] MFA Rules not processed for user `227539f3d3844b15a456c937edbe955e`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:17:55.311290 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-0d531956-b6a5-481b-810f-f8f6fccf0629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:55.331594 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-069e5429-2a5d-4271-8e2f-810f5f1585ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c95966d652054b9492ddbad6074bad33', 'request_id': 'req-069e5429-2a5d-4271-8e2f-810f5f1585ed'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:55.342853 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-069e5429-2a5d-4271-8e2f-810f5f1585ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c95966d652054b9492ddbad6074bad33', 'request_id': 'req-069e5429-2a5d-4271-8e2f-810f5f1585ed'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:55.352950 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-069e5429-2a5d-4271-8e2f-810f5f1585ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c95966d652054b9492ddbad6074bad33', 'request_id': 'req-069e5429-2a5d-4271-8e2f-810f5f1585ed'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:55.368457 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-069e5429-2a5d-4271-8e2f-810f5f1585ed admin admin] The token cache is being invalidate because project c95966d652054b9492ddbad6074bad33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:17:55.369040 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-069e5429-2a5d-4271-8e2f-810f5f1585ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:55.369803 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-069e5429-2a5d-4271-8e2f-810f5f1585ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:55.371974 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1045/2096] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 5 12:17:55 2022] DELETE /identity/v3/projects/c95966d652054b9492ddbad6074bad33 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:17:55.372754 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069e5429-2a5d-4271-8e2f-810f5f1585ed admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:55.377456 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-069e5429-2a5d-4271-8e2f-810f5f1585ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:55.402020 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1052/2097] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:17:55 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:17:55.403617 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0afea7-2396-4d0f-b662-0fdf58668e20 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:55.403909 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0afea7-2396-4d0f-b662-0fdf58668e20 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:55.404188 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0afea7-2396-4d0f-b662-0fdf58668e20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:55.428308 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-4f0afea7-2396-4d0f-b662-0fdf58668e20 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:17:55.430658 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-4f0afea7-2396-4d0f-b662-0fdf58668e20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:55.492462 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069e5429-2a5d-4271-8e2f-810f5f1585ed admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:55.498550 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed66cf5b-d0fc-45f0-b4ec-2e2d72c4a4df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:55.499644 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed66cf5b-d0fc-45f0-b4ec-2e2d72c4a4df admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:55.500027 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed66cf5b-d0fc-45f0-b4ec-2e2d72c4a4df admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:55.500411 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed66cf5b-d0fc-45f0-b4ec-2e2d72c4a4df admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:55.501251 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed66cf5b-d0fc-45f0-b4ec-2e2d72c4a4df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:55.504298 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed66cf5b-d0fc-45f0-b4ec-2e2d72c4a4df admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:55.529078 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1053/2098] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:17:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:17:55.530235 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0afea7-2396-4d0f-b662-0fdf58668e20 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:55.535008 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-4f0afea7-2396-4d0f-b662-0fdf58668e20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:55.540586 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1046/2099] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 5 12:17:55 2022] POST /identity/v3/users => generated 293 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:17:55.542176 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acba494-f400-4c78-ae9e-9cad34d9f4bb None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:55.542475 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acba494-f400-4c78-ae9e-9cad34d9f4bb None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:55.542754 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acba494-f400-4c78-ae9e-9cad34d9f4bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:55.551915 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0afea7-2396-4d0f-b662-0fdf58668e20 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:55.570758 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a4319e-6238-4cb2-a669-8ee83b5830a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:55.571478 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a4319e-6238-4cb2-a669-8ee83b5830a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:55.572205 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a4319e-6238-4cb2-a669-8ee83b5830a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:55.572433 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-0acba494-f400-4c78-ae9e-9cad34d9f4bb None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:17:55.572542 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a4319e-6238-4cb2-a669-8ee83b5830a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:55.573495 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a4319e-6238-4cb2-a669-8ee83b5830a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:55.575751 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a4319e-6238-4cb2-a669-8ee83b5830a4 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:55.578954 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-0acba494-f400-4c78-ae9e-9cad34d9f4bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:55.589927 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1047/2100] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:17:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:17:55.591021 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acba494-f400-4c78-ae9e-9cad34d9f4bb None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:55.606375 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acba494-f400-4c78-ae9e-9cad34d9f4bb None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:55.621710 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e1890e-3d28-4819-82be-d4e4aa1334b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:55.622322 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e1890e-3d28-4819-82be-d4e4aa1334b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:55.622698 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e1890e-3d28-4819-82be-d4e4aa1334b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:55.623025 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e1890e-3d28-4819-82be-d4e4aa1334b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:55.623841 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1054/2101] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 5 12:17:55 2022] POST /identity/v3/projects => generated 409 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:17:55.623993 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e1890e-3d28-4819-82be-d4e4aa1334b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:55.625006 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a4319e-6238-4cb2-a669-8ee83b5830a4 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:55.625677 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e1890e-3d28-4819-82be-d4e4aa1334b2 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:55.643722 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1048/2102] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:17:55 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:17:55.644856 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e1890e-3d28-4819-82be-d4e4aa1334b2 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:55.661207 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e1890e-3d28-4819-82be-d4e4aa1334b2 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:55.665634 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:55.748364 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:55.756161 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a4319e-6238-4cb2-a669-8ee83b5830a4 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:55.769640 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a60c266-1a84-4d22-b41a-2e8cd82bd229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:55.770366 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a60c266-1a84-4d22-b41a-2e8cd82bd229 admin admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:55.770849 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a60c266-1a84-4d22-b41a-2e8cd82bd229 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:55.771188 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a60c266-1a84-4d22-b41a-2e8cd82bd229 admin admin] PATH_INFO: `/v3/domains` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:55.772636 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a60c266-1a84-4d22-b41a-2e8cd82bd229 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:17:55.772968 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a60c266-1a84-4d22-b41a-2e8cd82bd229 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:55.774663 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a60c266-1a84-4d22-b41a-2e8cd82bd229 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:55.790517 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1055/2103] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Sep 5 12:17:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:17:55.791450 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a60c266-1a84-4d22-b41a-2e8cd82bd229 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:55.798697 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f64fa4e-5ba1-4846-a73b-6add81b4f795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:55.799695 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f64fa4e-5ba1-4846-a73b-6add81b4f795 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:55.800202 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f64fa4e-5ba1-4846-a73b-6add81b4f795 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:55.800487 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f64fa4e-5ba1-4846-a73b-6add81b4f795 admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:55.801540 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f64fa4e-5ba1-4846-a73b-6add81b4f795 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:55.803687 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f64fa4e-5ba1-4846-a73b-6add81b4f795 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:55.804749 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a60c266-1a84-4d22-b41a-2e8cd82bd229 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:55.811056 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf61a59-2df5-46b5-986d-9a4208fb2294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:55.811485 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf61a59-2df5-46b5-986d-9a4208fb2294 admin admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:55.811924 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf61a59-2df5-46b5-986d-9a4208fb2294 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:55.812263 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf61a59-2df5-46b5-986d-9a4208fb2294 admin admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:55.813091 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf61a59-2df5-46b5-986d-9a4208fb2294 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:55.814911 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf61a59-2df5-46b5-986d-9a4208fb2294 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:55.837932 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1056/2104] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:17:55 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:17:55.839278 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf61a59-2df5-46b5-986d-9a4208fb2294 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:55.841106 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1049/2105] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 5 12:17:55 2022] POST /identity/v3/users => generated 311 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:17:55.842153 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f64fa4e-5ba1-4846-a73b-6add81b4f795 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:55.842508 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-0bf61a59-2df5-46b5-986d-9a4208fb2294 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:55.855264 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f64fa4e-5ba1-4846-a73b-6add81b4f795 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:55.858494 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf61a59-2df5-46b5-986d-9a4208fb2294 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:55.862589 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5cbd4d-e962-4e5d-beab-473528ed85df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:55.863338 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5cbd4d-e962-4e5d-beab-473528ed85df admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:55.863663 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5cbd4d-e962-4e5d-beab-473528ed85df admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:55.864123 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5cbd4d-e962-4e5d-beab-473528ed85df admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:55.865027 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5cbd4d-e962-4e5d-beab-473528ed85df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:55.867247 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5cbd4d-e962-4e5d-beab-473528ed85df admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:55.873254 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0d77ff-9cf9-4158-87b1-e7d17fd0d7e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:55.873945 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0d77ff-9cf9-4158-87b1-e7d17fd0d7e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:55.874233 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0d77ff-9cf9-4158-87b1-e7d17fd0d7e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:55.875078 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0d77ff-9cf9-4158-87b1-e7d17fd0d7e5 admin admin] PATH_INFO: `/v3/projects/e453a265c97545499833506eb090cd3e` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:55.876556 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0d77ff-9cf9-4158-87b1-e7d17fd0d7e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e453a265c97545499833506eb090cd3e)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:55.878566 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0d77ff-9cf9-4158-87b1-e7d17fd0d7e5 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:55.911249 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1050/2106] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 5 12:17:55 2022] POST /identity/v3/projects => generated 373 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:17:55.911249 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5cbd4d-e962-4e5d-beab-473528ed85df admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:55.953823 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-7f0d77ff-9cf9-4158-87b1-e7d17fd0d7e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e453a265c97545499833506eb090cd3e', 'request_id': 'req-7f0d77ff-9cf9-4158-87b1-e7d17fd0d7e5'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:55.967767 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-7f0d77ff-9cf9-4158-87b1-e7d17fd0d7e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e453a265c97545499833506eb090cd3e', 'request_id': 'req-7f0d77ff-9cf9-4158-87b1-e7d17fd0d7e5'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:55.977250 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-7f0d77ff-9cf9-4158-87b1-e7d17fd0d7e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e453a265c97545499833506eb090cd3e', 'request_id': 'req-7f0d77ff-9cf9-4158-87b1-e7d17fd0d7e5'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:55.992829 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-7f0d77ff-9cf9-4158-87b1-e7d17fd0d7e5 admin admin] The token cache is being invalidate because project e453a265c97545499833506eb090cd3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:17:55.993236 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-7f0d77ff-9cf9-4158-87b1-e7d17fd0d7e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:55.994082 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-7f0d77ff-9cf9-4158-87b1-e7d17fd0d7e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:55.999516 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1057/2107] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 5 12:17:55 2022] DELETE /identity/v3/projects/e453a265c97545499833506eb090cd3e => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:17:55.999516 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0d77ff-9cf9-4158-87b1-e7d17fd0d7e5 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:56.000600 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-7f0d77ff-9cf9-4158-87b1-e7d17fd0d7e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:56.018839 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5cbd4d-e962-4e5d-beab-473528ed85df admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:56.100313 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0d77ff-9cf9-4158-87b1-e7d17fd0d7e5 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:56.106252 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc873d7d-6a88-4270-b2a4-5b393d3d718b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:56.107049 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc873d7d-6a88-4270-b2a4-5b393d3d718b admin admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:56.107349 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc873d7d-6a88-4270-b2a4-5b393d3d718b admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:56.107674 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc873d7d-6a88-4270-b2a4-5b393d3d718b admin admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:56.108664 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc873d7d-6a88-4270-b2a4-5b393d3d718b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:56.110246 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc873d7d-6a88-4270-b2a4-5b393d3d718b admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:56.127380 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1058/2108] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:17:55 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:17:56.128940 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc873d7d-6a88-4270-b2a4-5b393d3d718b admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:56.130568 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-cc873d7d-6a88-4270-b2a4-5b393d3d718b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:56.147617 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc873d7d-6a88-4270-b2a4-5b393d3d718b admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:56.156617 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da05af31-ee59-4e60-b11f-67903533f492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:56.158600 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da05af31-ee59-4e60-b11f-67903533f492 admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:56.158600 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da05af31-ee59-4e60-b11f-67903533f492 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:56.158600 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da05af31-ee59-4e60-b11f-67903533f492 admin admin] PATH_INFO: `/v3/projects/4f2dacf42b4c4a008f2aaa7185405b5f/users/18d3ae51c052491aaa92e3e99ae7ca2c/roles/ed72181e1403401facb77dcf33644757` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:56.161672 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5117e6b-9c10-4563-8957-185b386097d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:56.162555 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5117e6b-9c10-4563-8957-185b386097d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:56.163072 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5117e6b-9c10-4563-8957-185b386097d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:56.163542 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5117e6b-9c10-4563-8957-185b386097d3 admin admin] PATH_INFO: `/v3/users` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:56.164380 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5117e6b-9c10-4563-8957-185b386097d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:56.166554 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5117e6b-9c10-4563-8957-185b386097d3 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:56.178066 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da05af31-ee59-4e60-b11f-67903533f492 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f2dacf42b4c4a008f2aaa7185405b5f, user_id=18d3ae51c052491aaa92e3e99ae7ca2c, role_id=ed72181e1403401facb77dcf33644757)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:56.181203 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da05af31-ee59-4e60-b11f-67903533f492 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:56.200220 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1059/2109] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 5 12:17:56 2022] POST /identity/v3/users => generated 287 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:17:56.203480 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5117e6b-9c10-4563-8957-185b386097d3 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:56.203844 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-f5117e6b-9c10-4563-8957-185b386097d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:56.205441 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1051/2110] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 5 12:17:55 2022] PUT /identity/v3/projects/4f2dacf42b4c4a008f2aaa7185405b5f/users/18d3ae51c052491aaa92e3e99ae7ca2c/roles/ed72181e1403401facb77dcf33644757 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:17:56.206412 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da05af31-ee59-4e60-b11f-67903533f492 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:56.212301 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:56.224872 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5117e6b-9c10-4563-8957-185b386097d3 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:56.284344 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:56.290243 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da05af31-ee59-4e60-b11f-67903533f492 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:56.303093 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fea0e2b-933d-4cb5-9284-10a9224fbb70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:56.304045 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fea0e2b-933d-4cb5-9284-10a9224fbb70 admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:56.304328 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fea0e2b-933d-4cb5-9284-10a9224fbb70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:56.305178 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fea0e2b-933d-4cb5-9284-10a9224fbb70 admin admin] PATH_INFO: `/v3/projects/97eb76336bb34d29bcb1a97506f55d93/users/f575ab2a3d7548e88116387668fdbbf5/roles/16e2ccc8bd1b497d8cee780c1c7df0d2` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:56.315317 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05acd4e-6107-47b5-b48c-c5c787f25b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:56.316076 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05acd4e-6107-47b5-b48c-c5c787f25b6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:56.316404 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05acd4e-6107-47b5-b48c-c5c787f25b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:56.316690 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05acd4e-6107-47b5-b48c-c5c787f25b6e admin admin] PATH_INFO: `/v3/users/15d12da0f73f454cb3ed6c7e03733ea0` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:56.320498 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05acd4e-6107-47b5-b48c-c5c787f25b6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=15d12da0f73f454cb3ed6c7e03733ea0)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:56.322649 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05acd4e-6107-47b5-b48c-c5c787f25b6e admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:56.323326 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fea0e2b-933d-4cb5-9284-10a9224fbb70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97eb76336bb34d29bcb1a97506f55d93, user_id=f575ab2a3d7548e88116387668fdbbf5, role_id=16e2ccc8bd1b497d8cee780c1c7df0d2)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:56.332218 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fea0e2b-933d-4cb5-9284-10a9224fbb70 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:56.351485 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1052/2111] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 5 12:17:56 2022] PUT /identity/v3/projects/97eb76336bb34d29bcb1a97506f55d93/users/f575ab2a3d7548e88116387668fdbbf5/roles/16e2ccc8bd1b497d8cee780c1c7df0d2 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:17:56.354059 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fea0e2b-933d-4cb5-9284-10a9224fbb70 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:56.402328 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-d05acd4e-6107-47b5-b48c-c5c787f25b6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15d12da0f73f454cb3ed6c7e03733ea0'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:56.403500 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-d05acd4e-6107-47b5-b48c-c5c787f25b6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15d12da0f73f454cb3ed6c7e03733ea0'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:56.416158 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-d05acd4e-6107-47b5-b48c-c5c787f25b6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15d12da0f73f454cb3ed6c7e03733ea0'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:56.417737 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-d05acd4e-6107-47b5-b48c-c5c787f25b6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15d12da0f73f454cb3ed6c7e03733ea0'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:56.434372 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-d05acd4e-6107-47b5-b48c-c5c787f25b6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15d12da0f73f454cb3ed6c7e03733ea0'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:56.455971 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1060/2112] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 5 12:17:56 2022] DELETE /identity/v3/users/15d12da0f73f454cb3ed6c7e03733ea0 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:17:56.458897 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecad225c-bc45-458c-8d01-0fa7aa312cb3 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:56.458897 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecad225c-bc45-458c-8d01-0fa7aa312cb3 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:56.458897 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecad225c-bc45-458c-8d01-0fa7aa312cb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:56.460250 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fea0e2b-933d-4cb5-9284-10a9224fbb70 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:56.493283 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-ecad225c-bc45-458c-8d01-0fa7aa312cb3 None None] MFA Rules not processed for user `18d3ae51c052491aaa92e3e99ae7ca2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:17:56.495191 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-ecad225c-bc45-458c-8d01-0fa7aa312cb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:56.570803 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c678cf61-9674-4ae3-b3bb-0ab893ec6b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:56.572295 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c678cf61-9674-4ae3-b3bb-0ab893ec6b5a admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:56.572825 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c678cf61-9674-4ae3-b3bb-0ab893ec6b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:56.573394 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c678cf61-9674-4ae3-b3bb-0ab893ec6b5a admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:56.574295 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c678cf61-9674-4ae3-b3bb-0ab893ec6b5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:56.576799 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c678cf61-9674-4ae3-b3bb-0ab893ec6b5a admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:56.598912 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1053/2113] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:17:56 2022] GET /identity/v3/roles => generated 1420 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:17:56.599998 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c678cf61-9674-4ae3-b3bb-0ab893ec6b5a admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:56.606688 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-c678cf61-9674-4ae3-b3bb-0ab893ec6b5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:56.625907 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c678cf61-9674-4ae3-b3bb-0ab893ec6b5a admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:56.632172 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82475ca7-91ae-41db-a8e8-346c39bece31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:56.632709 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82475ca7-91ae-41db-a8e8-346c39bece31 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:56.633046 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82475ca7-91ae-41db-a8e8-346c39bece31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:56.633863 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82475ca7-91ae-41db-a8e8-346c39bece31 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:56.634617 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82475ca7-91ae-41db-a8e8-346c39bece31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:56.638029 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82475ca7-91ae-41db-a8e8-346c39bece31 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:56.660383 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1054/2114] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:17:56 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:17:56.661477 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82475ca7-91ae-41db-a8e8-346c39bece31 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:56.663627 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-82475ca7-91ae-41db-a8e8-346c39bece31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:56.665402 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1061/2115] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:17:56 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:17:56.666427 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecad225c-bc45-458c-8d01-0fa7aa312cb3 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:56.669072 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-ecad225c-bc45-458c-8d01-0fa7aa312cb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:56.680076 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82475ca7-91ae-41db-a8e8-346c39bece31 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:56.688949 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecad225c-bc45-458c-8d01-0fa7aa312cb3 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:56.695870 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfea9b69-e32d-4cdf-889e-c4076d2b8aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:56.696107 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8106f7de-d4f9-4ab7-befc-a901a2d4497a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:56.696520 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfea9b69-e32d-4cdf-889e-c4076d2b8aa8 admin admin] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:56.696629 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8106f7de-d4f9-4ab7-befc-a901a2d4497a admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:56.697039 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfea9b69-e32d-4cdf-889e-c4076d2b8aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:56.697228 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8106f7de-d4f9-4ab7-befc-a901a2d4497a admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:56.697325 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfea9b69-e32d-4cdf-889e-c4076d2b8aa8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:56.697508 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8106f7de-d4f9-4ab7-befc-a901a2d4497a admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:56.697955 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfea9b69-e32d-4cdf-889e-c4076d2b8aa8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:56.698132 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8106f7de-d4f9-4ab7-befc-a901a2d4497a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:56.700277 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8106f7de-d4f9-4ab7-befc-a901a2d4497a admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:56.700609 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfea9b69-e32d-4cdf-889e-c4076d2b8aa8 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:56.721461 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1055/2116] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:17:56 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:17:56.723088 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8106f7de-d4f9-4ab7-befc-a901a2d4497a admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:56.742996 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8106f7de-d4f9-4ab7-befc-a901a2d4497a admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:56.749883 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677832be-f974-4637-921b-4c05b219a4c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:56.750861 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677832be-f974-4637-921b-4c05b219a4c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:56.751303 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677832be-f974-4637-921b-4c05b219a4c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:56.752118 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677832be-f974-4637-921b-4c05b219a4c5 admin admin] PATH_INFO: `/v3/projects/97eb76336bb34d29bcb1a97506f55d93/users/f575ab2a3d7548e88116387668fdbbf5/roles/16e2ccc8bd1b497d8cee780c1c7df0d2` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:56.753985 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1062/2117] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 5 12:17:56 2022] POST /identity/v3/projects => generated 383 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:17:56.754778 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677832be-f974-4637-921b-4c05b219a4c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97eb76336bb34d29bcb1a97506f55d93, user_id=f575ab2a3d7548e88116387668fdbbf5, role_id=16e2ccc8bd1b497d8cee780c1c7df0d2)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:56.755191 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfea9b69-e32d-4cdf-889e-c4076d2b8aa8 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:56.758504 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677832be-f974-4637-921b-4c05b219a4c5 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:56.767704 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:56.789118 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1056/2118] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 5 12:17:56 2022] PUT /identity/v3/projects/97eb76336bb34d29bcb1a97506f55d93/users/f575ab2a3d7548e88116387668fdbbf5/roles/16e2ccc8bd1b497d8cee780c1c7df0d2 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:17:56.789118 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677832be-f974-4637-921b-4c05b219a4c5 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:56.831213 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:56.897584 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfea9b69-e32d-4cdf-889e-c4076d2b8aa8 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:56.918368 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677832be-f974-4637-921b-4c05b219a4c5 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:56.925687 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a1aa44-2ac5-4c54-b11c-4e710c97d44b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:56.926676 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a1aa44-2ac5-4c54-b11c-4e710c97d44b admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:56.927696 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a1aa44-2ac5-4c54-b11c-4e710c97d44b admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:56.928214 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a1aa44-2ac5-4c54-b11c-4e710c97d44b admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:56.929163 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a1aa44-2ac5-4c54-b11c-4e710c97d44b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:56.935352 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a1aa44-2ac5-4c54-b11c-4e710c97d44b admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:56.973978 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1057/2119] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 5 12:17:56 2022] POST /identity/v3/users => generated 298 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:17:56.974685 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00f765f-54ec-48d8-aba5-6bad23e856b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:56.975554 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00f765f-54ec-48d8-aba5-6bad23e856b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:56.975907 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00f765f-54ec-48d8-aba5-6bad23e856b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:56.976295 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00f765f-54ec-48d8-aba5-6bad23e856b1 admin admin] PATH_INFO: `/v3/projects/dcf70712fd4e4235a0698238db7e1f3d/users/ab3a4519819e46ba945398957780f956/roles/ed72181e1403401facb77dcf33644757` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:56.977300 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d740c56-6ca6-4b1b-a65c-a53ad63effda None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:56.977784 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d740c56-6ca6-4b1b-a65c-a53ad63effda None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:56.978240 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d740c56-6ca6-4b1b-a65c-a53ad63effda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:56.998719 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00f765f-54ec-48d8-aba5-6bad23e856b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcf70712fd4e4235a0698238db7e1f3d, user_id=ab3a4519819e46ba945398957780f956, role_id=ed72181e1403401facb77dcf33644757)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:57.012047 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00f765f-54ec-48d8-aba5-6bad23e856b1 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:57.023970 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-1d740c56-6ca6-4b1b-a65c-a53ad63effda None None] MFA Rules not processed for user `f575ab2a3d7548e88116387668fdbbf5`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:17:57.025449 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-1d740c56-6ca6-4b1b-a65c-a53ad63effda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:57.034389 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1063/2120] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 5 12:17:56 2022] PUT /identity/v3/projects/dcf70712fd4e4235a0698238db7e1f3d/users/ab3a4519819e46ba945398957780f956/roles/ed72181e1403401facb77dcf33644757 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:17:57.035506 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00f765f-54ec-48d8-aba5-6bad23e856b1 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:57.137615 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00f765f-54ec-48d8-aba5-6bad23e856b1 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:57.143835 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1058/2121] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:17:56 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:17:57.145006 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d740c56-6ca6-4b1b-a65c-a53ad63effda None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:57.146488 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-1d740c56-6ca6-4b1b-a65c-a53ad63effda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:57.162115 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587771c6-e402-4fc8-82df-f10d89eb2c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:57.164607 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587771c6-e402-4fc8-82df-f10d89eb2c69 admin admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:57.164971 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587771c6-e402-4fc8-82df-f10d89eb2c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:57.165840 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587771c6-e402-4fc8-82df-f10d89eb2c69 admin admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:57.167161 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d740c56-6ca6-4b1b-a65c-a53ad63effda None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:57.167982 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587771c6-e402-4fc8-82df-f10d89eb2c69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:57.169760 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587771c6-e402-4fc8-82df-f10d89eb2c69 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:57.176986 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729b6ac5-c701-4c5a-bb8d-100b4f631f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:57.177660 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729b6ac5-c701-4c5a-bb8d-100b4f631f1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:57.178086 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729b6ac5-c701-4c5a-bb8d-100b4f631f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:57.178243 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729b6ac5-c701-4c5a-bb8d-100b4f631f1f admin admin] PATH_INFO: `/v3/projects/a9ec20558cca4cd68c7a1bdecde24343` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:57.179452 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729b6ac5-c701-4c5a-bb8d-100b4f631f1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9ec20558cca4cd68c7a1bdecde24343)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:57.181775 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729b6ac5-c701-4c5a-bb8d-100b4f631f1f admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:57.191212 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1064/2122] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:17:57 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:17:57.191212 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6eba3f-ca55-46e6-aaa3-d17dbc2db0ed None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:57.191212 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6eba3f-ca55-46e6-aaa3-d17dbc2db0ed None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:57.191212 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6eba3f-ca55-46e6-aaa3-d17dbc2db0ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:57.218425 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-4f6eba3f-ca55-46e6-aaa3-d17dbc2db0ed None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:17:57.219649 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-4f6eba3f-ca55-46e6-aaa3-d17dbc2db0ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:57.231716 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1065/2123] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:17:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:17:57.231716 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6eba3f-ca55-46e6-aaa3-d17dbc2db0ed None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:57.231716 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-4f6eba3f-ca55-46e6-aaa3-d17dbc2db0ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:57.246346 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-729b6ac5-c701-4c5a-bb8d-100b4f631f1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9ec20558cca4cd68c7a1bdecde24343', 'request_id': 'req-729b6ac5-c701-4c5a-bb8d-100b4f631f1f'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:57.258879 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-729b6ac5-c701-4c5a-bb8d-100b4f631f1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9ec20558cca4cd68c7a1bdecde24343', 'request_id': 'req-729b6ac5-c701-4c5a-bb8d-100b4f631f1f'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:57.267016 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-729b6ac5-c701-4c5a-bb8d-100b4f631f1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9ec20558cca4cd68c7a1bdecde24343', 'request_id': 'req-729b6ac5-c701-4c5a-bb8d-100b4f631f1f'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:57.271775 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=90,keystone:INSERT=4,keystone:DELETE=6 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:57.280700 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-729b6ac5-c701-4c5a-bb8d-100b4f631f1f admin admin] The token cache is being invalidate because project a9ec20558cca4cd68c7a1bdecde24343 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:17:57.281065 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-729b6ac5-c701-4c5a-bb8d-100b4f631f1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:57.281853 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-729b6ac5-c701-4c5a-bb8d-100b4f631f1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:17:57.284088 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1059/2124] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 5 12:17:57 2022] DELETE /identity/v3/projects/a9ec20558cca4cd68c7a1bdecde24343 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:17:57.285337 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729b6ac5-c701-4c5a-bb8d-100b4f631f1f admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:57.286786 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-729b6ac5-c701-4c5a-bb8d-100b4f631f1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:57.291378 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:57.297687 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6eba3f-ca55-46e6-aaa3-d17dbc2db0ed None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:57.357671 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ef64aa-b149-4939-8f46-638bef19b508 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37633bbae0c2423c81ccd61ac3a17ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:57.358385 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef64aa-b149-4939-8f46-638bef19b508 service cinder] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:57.358670 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef64aa-b149-4939-8f46-638bef19b508 service cinder] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:57.358946 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef64aa-b149-4939-8f46-638bef19b508 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:57.367181 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-71ef64aa-b149-4939-8f46-638bef19b508 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:57.367395 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729b6ac5-c701-4c5a-bb8d-100b4f631f1f admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:57.371061 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361f3a03-d0f0-4bd1-a49d-caf0481660ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:57.371737 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361f3a03-d0f0-4bd1-a49d-caf0481660ab admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:57.372009 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361f3a03-d0f0-4bd1-a49d-caf0481660ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:57.372279 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361f3a03-d0f0-4bd1-a49d-caf0481660ab admin admin] PATH_INFO: `/v3/projects/406a40cbcd3f4884abb587bf286cd412/users/80cb6150305c4eb1bd08187187451d6e/roles/16e2ccc8bd1b497d8cee780c1c7df0d2` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:57.391139 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361f3a03-d0f0-4bd1-a49d-caf0481660ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=406a40cbcd3f4884abb587bf286cd412, user_id=80cb6150305c4eb1bd08187187451d6e, role_id=16e2ccc8bd1b497d8cee780c1c7df0d2)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:57.394384 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361f3a03-d0f0-4bd1-a49d-caf0481660ab admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:57.409199 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1060/2125] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 5 12:17:57 2022] PUT /identity/v3/projects/406a40cbcd3f4884abb587bf286cd412/users/80cb6150305c4eb1bd08187187451d6e/roles/16e2ccc8bd1b497d8cee780c1c7df0d2 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:17:57.410115 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361f3a03-d0f0-4bd1-a49d-caf0481660ab admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:57.412514 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-361f3a03-d0f0-4bd1-a49d-caf0481660ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:57.444021 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ef64aa-b149-4939-8f46-638bef19b508 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:57.445739 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ef64aa-b149-4939-8f46-638bef19b508 service cinder] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:57.457972 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1066/2126] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:17:57 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:17:57.459255 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c7e3f0-dda9-4931-b4c8-f5e64d7bcc74 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:57.459545 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c7e3f0-dda9-4931-b4c8-f5e64d7bcc74 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:57.459825 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c7e3f0-dda9-4931-b4c8-f5e64d7bcc74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:57.486164 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-e9c7e3f0-dda9-4931-b4c8-f5e64d7bcc74 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:17:57.487392 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-e9c7e3f0-dda9-4931-b4c8-f5e64d7bcc74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:57.506611 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361f3a03-d0f0-4bd1-a49d-caf0481660ab admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:57.513784 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3169fb2f-71fa-4d57-b092-90e7716108d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4994b4faa4ec4aa088f3dc32c9c5614d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:57.514517 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3169fb2f-71fa-4d57-b092-90e7716108d2 service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:57.514901 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3169fb2f-71fa-4d57-b092-90e7716108d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:57.515310 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3169fb2f-71fa-4d57-b092-90e7716108d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:57.517626 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-3169fb2f-71fa-4d57-b092-90e7716108d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:57.595274 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1067/2127] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:17:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:17:57.597049 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c7e3f0-dda9-4931-b4c8-f5e64d7bcc74 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:57.609435 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3169fb2f-71fa-4d57-b092-90e7716108d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:57.611683 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3169fb2f-71fa-4d57-b092-90e7716108d2 service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:57.622091 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c7e3f0-dda9-4931-b4c8-f5e64d7bcc74 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:57.626956 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1061/2128] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:17:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:17:57.627260 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e93425-f816-4e62-8cfe-3a15c49989e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:57.627954 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e93425-f816-4e62-8cfe-3a15c49989e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:57.628093 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d998c8-228d-44d8-bf63-0dbd9701291c None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:57.628345 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d998c8-228d-44d8-bf63-0dbd9701291c None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:57.628466 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e93425-f816-4e62-8cfe-3a15c49989e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:57.628724 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e93425-f816-4e62-8cfe-3a15c49989e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:57.628835 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d998c8-228d-44d8-bf63-0dbd9701291c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:57.629662 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e93425-f816-4e62-8cfe-3a15c49989e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:57.631302 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e93425-f816-4e62-8cfe-3a15c49989e9 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:57.661364 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1068/2129] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:17:57 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:17:57.664374 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e93425-f816-4e62-8cfe-3a15c49989e9 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:57.667480 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-29d998c8-228d-44d8-bf63-0dbd9701291c None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:17:57.670170 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-29d998c8-228d-44d8-bf63-0dbd9701291c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:57.679933 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e93425-f816-4e62-8cfe-3a15c49989e9 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:57.687265 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c244cfe-3d2e-47a8-ac9b-ab02e29b535a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:57.689160 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c244cfe-3d2e-47a8-ac9b-ab02e29b535a admin admin] REQUEST_METHOD: `PUT` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:57.689160 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c244cfe-3d2e-47a8-ac9b-ab02e29b535a admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:57.690120 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c244cfe-3d2e-47a8-ac9b-ab02e29b535a admin admin] PATH_INFO: `/v3/projects/406a40cbcd3f4884abb587bf286cd412/users/80cb6150305c4eb1bd08187187451d6e/roles/16e2ccc8bd1b497d8cee780c1c7df0d2` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:57.694781 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1062/2130] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:17:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:17:57.699843 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c244cfe-3d2e-47a8-ac9b-ab02e29b535a admin admin] RBAC: Authorizing `identity:create_grant(project_id=406a40cbcd3f4884abb587bf286cd412, user_id=80cb6150305c4eb1bd08187187451d6e, role_id=16e2ccc8bd1b497d8cee780c1c7df0d2)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:57.703122 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c244cfe-3d2e-47a8-ac9b-ab02e29b535a admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:57.705244 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d998c8-228d-44d8-bf63-0dbd9701291c None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:57.730840 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1069/2131] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 5 12:17:57 2022] PUT /identity/v3/projects/406a40cbcd3f4884abb587bf286cd412/users/80cb6150305c4eb1bd08187187451d6e/roles/16e2ccc8bd1b497d8cee780c1c7df0d2 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:17:57.731053 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d998c8-228d-44d8-bf63-0dbd9701291c None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:57.734969 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f445ca-6382-41fd-aa75-0542194e8324 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:57.736883 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f445ca-6382-41fd-aa75-0542194e8324 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:57.738699 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f445ca-6382-41fd-aa75-0542194e8324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:57.753985 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:57.823755 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-b9f445ca-6382-41fd-aa75-0542194e8324 None None] MFA Rules not processed for user `80cb6150305c4eb1bd08187187451d6e`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:17:57.826341 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-b9f445ca-6382-41fd-aa75-0542194e8324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:57.837953 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1b135c-18ec-4432-a768-290a1dde6700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:57.838655 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1b135c-18ec-4432-a768-290a1dde6700 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:57.839524 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1b135c-18ec-4432-a768-290a1dde6700 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:57.839781 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1b135c-18ec-4432-a768-290a1dde6700 admin admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:57.840415 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1b135c-18ec-4432-a768-290a1dde6700 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:17:57.841375 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1b135c-18ec-4432-a768-290a1dde6700 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:57.842633 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1b135c-18ec-4432-a768-290a1dde6700 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:57.859541 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1063/2132] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Sep 5 12:17:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:17:57.860623 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1b135c-18ec-4432-a768-290a1dde6700 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:57.862747 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-2f1b135c-18ec-4432-a768-290a1dde6700 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:57.868145 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:57.976032 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1070/2133] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:17:57 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:17:57.976032 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f445ca-6382-41fd-aa75-0542194e8324 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:57.981765 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1b135c-18ec-4432-a768-290a1dde6700 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:57.987804 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216e03c2-a036-4bad-a67c-67d7dc7145d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37633bbae0c2423c81ccd61ac3a17ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:57.988480 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216e03c2-a036-4bad-a67c-67d7dc7145d2 service cinder] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:57.988792 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216e03c2-a036-4bad-a67c-67d7dc7145d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:57.989096 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216e03c2-a036-4bad-a67c-67d7dc7145d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:57.990349 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f445ca-6382-41fd-aa75-0542194e8324 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:57.991432 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-216e03c2-a036-4bad-a67c-67d7dc7145d2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:57.996336 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6baf2e7-f928-4c2a-99b2-280627f3bc3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:57.997041 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6baf2e7-f928-4c2a-99b2-280627f3bc3d admin admin] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:57.997322 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6baf2e7-f928-4c2a-99b2-280627f3bc3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:57.997596 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6baf2e7-f928-4c2a-99b2-280627f3bc3d admin admin] PATH_INFO: `/v3/projects` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:57.998628 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6baf2e7-f928-4c2a-99b2-280627f3bc3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:58.007216 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6baf2e7-f928-4c2a-99b2-280627f3bc3d admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:58.048940 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1071/2134] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 5 12:17:57 2022] POST /identity/v3/projects => generated 383 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:17:58.048940 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6baf2e7-f928-4c2a-99b2-280627f3bc3d admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:58.051640 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-c6baf2e7-f928-4c2a-99b2-280627f3bc3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:58.075084 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216e03c2-a036-4bad-a67c-67d7dc7145d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:58.077065 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216e03c2-a036-4bad-a67c-67d7dc7145d2 service cinder] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:58.088673 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1064/2135] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:17:57 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:17:58.092676 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216e03c2-a036-4bad-a67c-67d7dc7145d2 service cinder] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:58.114197 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216e03c2-a036-4bad-a67c-67d7dc7145d2 service cinder] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:58.147134 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6baf2e7-f928-4c2a-99b2-280627f3bc3d admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:58.153714 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a213b8-9488-4b4c-a5a0-c1ab67b58463 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37633bbae0c2423c81ccd61ac3a17ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:58.154240 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a213b8-9488-4b4c-a5a0-c1ab67b58463 service cinder] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:58.154932 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a213b8-9488-4b4c-a5a0-c1ab67b58463 service cinder] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:58.155268 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a213b8-9488-4b4c-a5a0-c1ab67b58463 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:58.157383 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-f2a213b8-9488-4b4c-a5a0-c1ab67b58463 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:58.232396 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58eed5b0-c986-4787-b1fa-a698dfa32710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:58.233134 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eed5b0-c986-4787-b1fa-a698dfa32710 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:58.233417 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eed5b0-c986-4787-b1fa-a698dfa32710 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:58.233727 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eed5b0-c986-4787-b1fa-a698dfa32710 admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:58.234719 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58eed5b0-c986-4787-b1fa-a698dfa32710 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:58.238042 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58eed5b0-c986-4787-b1fa-a698dfa32710 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:58.265852 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:58.280577 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1065/2136] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 5 12:17:58 2022] POST /identity/v3/users => generated 292 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:17:58.286138 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58eed5b0-c986-4787-b1fa-a698dfa32710 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:58.309926 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a213b8-9488-4b4c-a5a0-c1ab67b58463 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:58.314845 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a213b8-9488-4b4c-a5a0-c1ab67b58463 service cinder] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:58.316582 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58eed5b0-c986-4787-b1fa-a698dfa32710 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:58.338701 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4878b3-3565-4896-88ea-cf71650ddc3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:58.339979 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4878b3-3565-4896-88ea-cf71650ddc3c admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:58.340590 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4878b3-3565-4896-88ea-cf71650ddc3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:58.341231 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4878b3-3565-4896-88ea-cf71650ddc3c admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:58.342457 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4878b3-3565-4896-88ea-cf71650ddc3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:58.345842 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4878b3-3565-4896-88ea-cf71650ddc3c admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:58.346602 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1072/2137] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:17:58 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:17:58.382205 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1066/2138] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:17:58 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:17:58.385941 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a213b8-9488-4b4c-a5a0-c1ab67b58463 service cinder] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:58.405935 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a213b8-9488-4b4c-a5a0-c1ab67b58463 service cinder] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:58.412054 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccdad2a-3490-4824-9a62-d9d72f198455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:58.412749 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccdad2a-3490-4824-9a62-d9d72f198455 admin admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:58.413400 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccdad2a-3490-4824-9a62-d9d72f198455 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:58.413747 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccdad2a-3490-4824-9a62-d9d72f198455 admin admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:58.414634 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccdad2a-3490-4824-9a62-d9d72f198455 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:58.417556 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccdad2a-3490-4824-9a62-d9d72f198455 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:58.433791 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1073/2139] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:17:58 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:17:58.437746 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4878b3-3565-4896-88ea-cf71650ddc3c admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:58.450935 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4878b3-3565-4896-88ea-cf71650ddc3c admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:58.456730 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082be4bd-5dd7-4593-83f0-3958d39665a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:58.457452 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082be4bd-5dd7-4593-83f0-3958d39665a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:58.457729 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082be4bd-5dd7-4593-83f0-3958d39665a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:58.458009 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082be4bd-5dd7-4593-83f0-3958d39665a7 admin admin] PATH_INFO: `/v3/projects/0031f99854a04b85a16a66b876a8abc5/users/0f4d223b08bf4ab09b4ac0a5c8f90ad6/roles/ed72181e1403401facb77dcf33644757` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:58.482447 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082be4bd-5dd7-4593-83f0-3958d39665a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0031f99854a04b85a16a66b876a8abc5, user_id=0f4d223b08bf4ab09b4ac0a5c8f90ad6, role_id=ed72181e1403401facb77dcf33644757)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:58.485984 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082be4bd-5dd7-4593-83f0-3958d39665a7 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:58.510237 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1067/2140] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 5 12:17:58 2022] PUT /identity/v3/projects/0031f99854a04b85a16a66b876a8abc5/users/0f4d223b08bf4ab09b4ac0a5c8f90ad6/roles/ed72181e1403401facb77dcf33644757 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:17:58.524206 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0215f1-703f-4283-b007-73345e3f6ea6 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:58.524994 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0215f1-703f-4283-b007-73345e3f6ea6 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:58.525580 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0215f1-703f-4283-b007-73345e3f6ea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:58.576018 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-cd0215f1-703f-4283-b007-73345e3f6ea6 None None] MFA Rules not processed for user `0f4d223b08bf4ab09b4ac0a5c8f90ad6`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:17:58.577671 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-cd0215f1-703f-4283-b007-73345e3f6ea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:58.644426 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:58.787774 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082be4bd-5dd7-4593-83f0-3958d39665a7 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:58.788431 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1074/2141] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:17:58 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:17:58.995600 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082be4bd-5dd7-4593-83f0-3958d39665a7 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:59.013316 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a445e5-fd4e-4341-a93b-2eae1ceff1b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:59.016886 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a445e5-fd4e-4341-a93b-2eae1ceff1b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:59.020779 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a445e5-fd4e-4341-a93b-2eae1ceff1b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:59.021177 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a445e5-fd4e-4341-a93b-2eae1ceff1b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:59.022036 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a445e5-fd4e-4341-a93b-2eae1ceff1b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:59.025575 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a445e5-fd4e-4341-a93b-2eae1ceff1b5 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:59.095059 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1068/2142] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 5 12:17:58 2022] POST /identity/v3/projects => generated 383 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:17:59.099507 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0215f1-703f-4283-b007-73345e3f6ea6 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:59.115559 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0215f1-703f-4283-b007-73345e3f6ea6 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:59.216756 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8800c72e-b8ad-48e7-a80d-4823e1857ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:59.217481 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8800c72e-b8ad-48e7-a80d-4823e1857ff0 admin admin] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:59.217896 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8800c72e-b8ad-48e7-a80d-4823e1857ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:59.218245 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8800c72e-b8ad-48e7-a80d-4823e1857ff0 admin admin] PATH_INFO: `/v3/users` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:59.219128 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8800c72e-b8ad-48e7-a80d-4823e1857ff0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:59.223296 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8800c72e-b8ad-48e7-a80d-4823e1857ff0 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:59.262799 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1075/2143] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 5 12:17:59 2022] POST /identity/v3/users => generated 298 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:17:59.264112 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a445e5-fd4e-4341-a93b-2eae1ceff1b5 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:59.278161 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a445e5-fd4e-4341-a93b-2eae1ceff1b5 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:59.283873 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad1dcd0-6aaa-48f6-8d9d-a68e41ea965c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:59.284730 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad1dcd0-6aaa-48f6-8d9d-a68e41ea965c admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:59.285109 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad1dcd0-6aaa-48f6-8d9d-a68e41ea965c admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:59.285496 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad1dcd0-6aaa-48f6-8d9d-a68e41ea965c admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:59.286342 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad1dcd0-6aaa-48f6-8d9d-a68e41ea965c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:59.288166 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad1dcd0-6aaa-48f6-8d9d-a68e41ea965c admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:59.308752 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1069/2144] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:17:59 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:17:59.318490 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8800c72e-b8ad-48e7-a80d-4823e1857ff0 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:59.342541 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8800c72e-b8ad-48e7-a80d-4823e1857ff0 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:59.365701 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd54194-c37b-4ab1-842c-7d8e54db9806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:59.367990 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd54194-c37b-4ab1-842c-7d8e54db9806 admin admin] REQUEST_METHOD: `PUT` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:59.368533 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd54194-c37b-4ab1-842c-7d8e54db9806 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:59.382184 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd54194-c37b-4ab1-842c-7d8e54db9806 admin admin] PATH_INFO: `/v3/projects/f4775b4130a44d48ac10475d005c5bbc/users/59cd17896a1843af854cd23245b27911/roles/16e2ccc8bd1b497d8cee780c1c7df0d2` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:59.405552 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd54194-c37b-4ab1-842c-7d8e54db9806 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4775b4130a44d48ac10475d005c5bbc, user_id=59cd17896a1843af854cd23245b27911, role_id=16e2ccc8bd1b497d8cee780c1c7df0d2)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:59.408549 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd54194-c37b-4ab1-842c-7d8e54db9806 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:59.428653 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1076/2145] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 5 12:17:59 2022] PUT /identity/v3/projects/f4775b4130a44d48ac10475d005c5bbc/users/59cd17896a1843af854cd23245b27911/roles/16e2ccc8bd1b497d8cee780c1c7df0d2 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:17:59.434006 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad1dcd0-6aaa-48f6-8d9d-a68e41ea965c admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:59.446904 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad1dcd0-6aaa-48f6-8d9d-a68e41ea965c admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:59.563250 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdc5dea-b443-426a-8683-1d710332a73f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:59.564236 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdc5dea-b443-426a-8683-1d710332a73f admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:59.564707 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdc5dea-b443-426a-8683-1d710332a73f admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:59.565233 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdc5dea-b443-426a-8683-1d710332a73f admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:59.566334 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdc5dea-b443-426a-8683-1d710332a73f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:59.569297 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdc5dea-b443-426a-8683-1d710332a73f admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:59.594148 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1070/2146] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:17:59 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:17:59.599071 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd54194-c37b-4ab1-842c-7d8e54db9806 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:17:59.619761 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd54194-c37b-4ab1-842c-7d8e54db9806 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:17:59.627808 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb5c429-b639-4b7a-9f8c-780e05c42186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:17:59.628985 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb5c429-b639-4b7a-9f8c-780e05c42186 admin admin] REQUEST_METHOD: `PUT` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:59.629581 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb5c429-b639-4b7a-9f8c-780e05c42186 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:59.630081 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb5c429-b639-4b7a-9f8c-780e05c42186 admin admin] PATH_INFO: `/v3/projects/f4775b4130a44d48ac10475d005c5bbc/users/59cd17896a1843af854cd23245b27911/roles/16e2ccc8bd1b497d8cee780c1c7df0d2` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:59.633305 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb5c429-b639-4b7a-9f8c-780e05c42186 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4775b4130a44d48ac10475d005c5bbc, user_id=59cd17896a1843af854cd23245b27911, role_id=16e2ccc8bd1b497d8cee780c1c7df0d2)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:17:59.642384 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb5c429-b639-4b7a-9f8c-780e05c42186 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:17:59.697582 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1077/2147] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 5 12:17:59 2022] PUT /identity/v3/projects/f4775b4130a44d48ac10475d005c5bbc/users/59cd17896a1843af854cd23245b27911/roles/16e2ccc8bd1b497d8cee780c1c7df0d2 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:17:59.709488 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a4b0e6-70c3-4c14-9302-b60e6fbb9da5 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:17:59.709810 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a4b0e6-70c3-4c14-9302-b60e6fbb9da5 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:17:59.710091 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a4b0e6-70c3-4c14-9302-b60e6fbb9da5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:17:59.747487 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-22a4b0e6-70c3-4c14-9302-b60e6fbb9da5 None None] MFA Rules not processed for user `59cd17896a1843af854cd23245b27911`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:17:59.748748 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-22a4b0e6-70c3-4c14-9302-b60e6fbb9da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:17:59.810148 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:17:59.918382 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1071/2148] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:17:59 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:17:59.930779 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb5c429-b639-4b7a-9f8c-780e05c42186 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:00.006388 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb5c429-b639-4b7a-9f8c-780e05c42186 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:00.012367 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedf2554-06a1-4f49-b29a-044febef357d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37633bbae0c2423c81ccd61ac3a17ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:00.013075 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedf2554-06a1-4f49-b29a-044febef357d service cinder] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:00.013422 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedf2554-06a1-4f49-b29a-044febef357d service cinder] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:00.013697 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedf2554-06a1-4f49-b29a-044febef357d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:00.035959 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedf2554-06a1-4f49-b29a-044febef357d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:00.039607 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedf2554-06a1-4f49-b29a-044febef357d service cinder] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:00.060298 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1078/2149] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:17:59 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:18:00.309390 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a4b0e6-70c3-4c14-9302-b60e6fbb9da5 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:00.326896 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a4b0e6-70c3-4c14-9302-b60e6fbb9da5 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:00.340556 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b820159d-e7f5-4ad5-8fac-da76cd043333 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37633bbae0c2423c81ccd61ac3a17ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:00.341296 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b820159d-e7f5-4ad5-8fac-da76cd043333 service cinder] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:00.341585 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b820159d-e7f5-4ad5-8fac-da76cd043333 service cinder] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:00.345120 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b820159d-e7f5-4ad5-8fac-da76cd043333 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:00.441296 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b820159d-e7f5-4ad5-8fac-da76cd043333 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:00.443101 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b820159d-e7f5-4ad5-8fac-da76cd043333 service cinder] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:00.456304 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1072/2150] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:18:00 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 12:18:00.589684 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedf2554-06a1-4f49-b29a-044febef357d service cinder] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:00.617421 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedf2554-06a1-4f49-b29a-044febef357d service cinder] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:00.627995 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd418c7f-3a06-40a7-8a3f-9e962f5595a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37633bbae0c2423c81ccd61ac3a17ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:00.629054 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd418c7f-3a06-40a7-8a3f-9e962f5595a6 service cinder] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:00.629521 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd418c7f-3a06-40a7-8a3f-9e962f5595a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:00.629982 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd418c7f-3a06-40a7-8a3f-9e962f5595a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:00.635221 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-fd418c7f-3a06-40a7-8a3f-9e962f5595a6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:18:00.677866 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:18:00.835870 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd418c7f-3a06-40a7-8a3f-9e962f5595a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:00.837771 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd418c7f-3a06-40a7-8a3f-9e962f5595a6 service cinder] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:00.856341 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1079/2151] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:18:00 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 12:18:01.202225 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b820159d-e7f5-4ad5-8fac-da76cd043333 service cinder] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:01.412486 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b820159d-e7f5-4ad5-8fac-da76cd043333 service cinder] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:01.425455 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8906885a-ae2e-4a08-8312-d254b7befb72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:01.427085 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8906885a-ae2e-4a08-8312-d254b7befb72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:01.427863 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8906885a-ae2e-4a08-8312-d254b7befb72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:01.428416 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8906885a-ae2e-4a08-8312-d254b7befb72 admin admin] PATH_INFO: `/v3/users/0f4d223b08bf4ab09b4ac0a5c8f90ad6` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:01.431294 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8906885a-ae2e-4a08-8312-d254b7befb72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f4d223b08bf4ab09b4ac0a5c8f90ad6)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:01.436456 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8906885a-ae2e-4a08-8312-d254b7befb72 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:01.663933 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-8906885a-ae2e-4a08-8312-d254b7befb72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f4d223b08bf4ab09b4ac0a5c8f90ad6'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:01.665346 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-8906885a-ae2e-4a08-8312-d254b7befb72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f4d223b08bf4ab09b4ac0a5c8f90ad6'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:01.698729 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-8906885a-ae2e-4a08-8312-d254b7befb72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f4d223b08bf4ab09b4ac0a5c8f90ad6'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:01.699826 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-8906885a-ae2e-4a08-8312-d254b7befb72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f4d223b08bf4ab09b4ac0a5c8f90ad6'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:01.714946 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:18:01.747924 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-8906885a-ae2e-4a08-8312-d254b7befb72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f4d223b08bf4ab09b4ac0a5c8f90ad6'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:01.804127 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1073/2152] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 5 12:18:01 2022] DELETE /identity/v3/users/0f4d223b08bf4ab09b4ac0a5c8f90ad6 => generated 0 bytes in 598 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:18:01.808953 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bff9426-bb88-47ba-9523-e3e56cdc3cd8 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:01.811749 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bff9426-bb88-47ba-9523-e3e56cdc3cd8 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:01.813644 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bff9426-bb88-47ba-9523-e3e56cdc3cd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:01.921003 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-9bff9426-bb88-47ba-9523-e3e56cdc3cd8 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:18:01.923324 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-9bff9426-bb88-47ba-9523-e3e56cdc3cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:18:02.182243 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1080/2153] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:18:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:18:02.227085 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8906885a-ae2e-4a08-8312-d254b7befb72 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:02.228935 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-8906885a-ae2e-4a08-8312-d254b7befb72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:18:02.414814 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bff9426-bb88-47ba-9523-e3e56cdc3cd8 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:02.416556 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-9bff9426-bb88-47ba-9523-e3e56cdc3cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:18:02.469417 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8906885a-ae2e-4a08-8312-d254b7befb72 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:02.487147 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2076024f-c8be-49a5-80f3-6b76b0e353af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4994b4faa4ec4aa088f3dc32c9c5614d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:02.488395 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2076024f-c8be-49a5-80f3-6b76b0e353af service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:02.488866 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2076024f-c8be-49a5-80f3-6b76b0e353af service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:02.489346 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2076024f-c8be-49a5-80f3-6b76b0e353af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:02.546352 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2076024f-c8be-49a5-80f3-6b76b0e353af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:02.549843 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2076024f-c8be-49a5-80f3-6b76b0e353af service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:02.607342 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1074/2154] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:18:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 12:18:02.626564 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bff9426-bb88-47ba-9523-e3e56cdc3cd8 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:02.642870 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01783ffd-cadf-4ac4-a7f7-22c8baacfdc8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37633bbae0c2423c81ccd61ac3a17ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:02.643818 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01783ffd-cadf-4ac4-a7f7-22c8baacfdc8 service cinder] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:02.644265 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01783ffd-cadf-4ac4-a7f7-22c8baacfdc8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:02.644648 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01783ffd-cadf-4ac4-a7f7-22c8baacfdc8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:02.653582 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-01783ffd-cadf-4ac4-a7f7-22c8baacfdc8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:18:02.833582 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01783ffd-cadf-4ac4-a7f7-22c8baacfdc8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:02.842789 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01783ffd-cadf-4ac4-a7f7-22c8baacfdc8 service cinder] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:02.874783 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1081/2155] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:18:02 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 12:18:03.992370 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2076024f-c8be-49a5-80f3-6b76b0e353af service neutron] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:03.995098 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-2076024f-c8be-49a5-80f3-6b76b0e353af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:18:04.039836 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2076024f-c8be-49a5-80f3-6b76b0e353af service neutron] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:04.057484 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e01a88-1b52-4a2f-8ce7-75b67025a6c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:04.058292 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e01a88-1b52-4a2f-8ce7-75b67025a6c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:04.058581 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e01a88-1b52-4a2f-8ce7-75b67025a6c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:04.058849 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e01a88-1b52-4a2f-8ce7-75b67025a6c7 admin admin] PATH_INFO: `/v3/projects/0031f99854a04b85a16a66b876a8abc5` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:04.060660 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e01a88-1b52-4a2f-8ce7-75b67025a6c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0031f99854a04b85a16a66b876a8abc5)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:04.062794 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e01a88-1b52-4a2f-8ce7-75b67025a6c7 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:04.232354 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-81e01a88-1b52-4a2f-8ce7-75b67025a6c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0031f99854a04b85a16a66b876a8abc5', 'request_id': 'req-81e01a88-1b52-4a2f-8ce7-75b67025a6c7'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:04.253389 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-81e01a88-1b52-4a2f-8ce7-75b67025a6c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0031f99854a04b85a16a66b876a8abc5', 'request_id': 'req-81e01a88-1b52-4a2f-8ce7-75b67025a6c7'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:04.266323 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-81e01a88-1b52-4a2f-8ce7-75b67025a6c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0031f99854a04b85a16a66b876a8abc5', 'request_id': 'req-81e01a88-1b52-4a2f-8ce7-75b67025a6c7'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:04.292031 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-81e01a88-1b52-4a2f-8ce7-75b67025a6c7 admin admin] The token cache is being invalidate because project 0031f99854a04b85a16a66b876a8abc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:18:04.292514 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-81e01a88-1b52-4a2f-8ce7-75b67025a6c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:04.295456 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-81e01a88-1b52-4a2f-8ce7-75b67025a6c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:04.298649 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1075/2156] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 5 12:18:03 2022] DELETE /identity/v3/projects/0031f99854a04b85a16a66b876a8abc5 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:18:04.302450 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01783ffd-cadf-4ac4-a7f7-22c8baacfdc8 service cinder] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:04.332221 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01783ffd-cadf-4ac4-a7f7-22c8baacfdc8 service cinder] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:04.348089 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:18:04.445543 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817e9c19-3533-46ea-91b0-1b3f1f9ac7d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:04.446459 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817e9c19-3533-46ea-91b0-1b3f1f9ac7d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:04.446899 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817e9c19-3533-46ea-91b0-1b3f1f9ac7d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:04.447358 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817e9c19-3533-46ea-91b0-1b3f1f9ac7d0 admin admin] PATH_INFO: `/v3/users/59cd17896a1843af854cd23245b27911` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:04.449828 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817e9c19-3533-46ea-91b0-1b3f1f9ac7d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59cd17896a1843af854cd23245b27911)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:04.452170 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817e9c19-3533-46ea-91b0-1b3f1f9ac7d0 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:04.539300 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-817e9c19-3533-46ea-91b0-1b3f1f9ac7d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59cd17896a1843af854cd23245b27911'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:04.540357 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-817e9c19-3533-46ea-91b0-1b3f1f9ac7d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59cd17896a1843af854cd23245b27911'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:04.555115 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-817e9c19-3533-46ea-91b0-1b3f1f9ac7d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59cd17896a1843af854cd23245b27911'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:04.556761 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-817e9c19-3533-46ea-91b0-1b3f1f9ac7d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59cd17896a1843af854cd23245b27911'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:04.594040 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-817e9c19-3533-46ea-91b0-1b3f1f9ac7d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59cd17896a1843af854cd23245b27911'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:04.616935 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1082/2157] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 5 12:18:04 2022] DELETE /identity/v3/users/59cd17896a1843af854cd23245b27911 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:18:05.152189 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e01a88-1b52-4a2f-8ce7-75b67025a6c7 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:05.154799 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-81e01a88-1b52-4a2f-8ce7-75b67025a6c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:18:05.179065 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e01a88-1b52-4a2f-8ce7-75b67025a6c7 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:05.360041 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c641ff89-02ba-4df1-a345-cda3e4b027b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:05.361177 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c641ff89-02ba-4df1-a345-cda3e4b027b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:05.361642 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c641ff89-02ba-4df1-a345-cda3e4b027b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:05.362072 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c641ff89-02ba-4df1-a345-cda3e4b027b3 admin admin] PATH_INFO: `/v3/projects/f4775b4130a44d48ac10475d005c5bbc` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:05.363643 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c641ff89-02ba-4df1-a345-cda3e4b027b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4775b4130a44d48ac10475d005c5bbc)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:05.366584 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c641ff89-02ba-4df1-a345-cda3e4b027b3 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:05.371374 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:18:05.388045 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817e9c19-3533-46ea-91b0-1b3f1f9ac7d0 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:05.389784 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-817e9c19-3533-46ea-91b0-1b3f1f9ac7d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:18:05.454641 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817e9c19-3533-46ea-91b0-1b3f1f9ac7d0 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:05.461024 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9dc964-7521-4705-9dd8-85b49c7056bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:05.461931 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9dc964-7521-4705-9dd8-85b49c7056bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:05.462388 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9dc964-7521-4705-9dd8-85b49c7056bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:05.462874 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9dc964-7521-4705-9dd8-85b49c7056bc admin admin] PATH_INFO: `/v3/users/227539f3d3844b15a456c937edbe955e` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:05.465868 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9dc964-7521-4705-9dd8-85b49c7056bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=227539f3d3844b15a456c937edbe955e)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:05.468218 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9dc964-7521-4705-9dd8-85b49c7056bc admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:05.576783 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-c641ff89-02ba-4df1-a345-cda3e4b027b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4775b4130a44d48ac10475d005c5bbc', 'request_id': 'req-c641ff89-02ba-4df1-a345-cda3e4b027b3'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:05.593451 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-ec9dc964-7521-4705-9dd8-85b49c7056bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '227539f3d3844b15a456c937edbe955e'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:05.594215 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-ec9dc964-7521-4705-9dd8-85b49c7056bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '227539f3d3844b15a456c937edbe955e'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:05.610792 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-c641ff89-02ba-4df1-a345-cda3e4b027b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4775b4130a44d48ac10475d005c5bbc', 'request_id': 'req-c641ff89-02ba-4df1-a345-cda3e4b027b3'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:05.625191 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-ec9dc964-7521-4705-9dd8-85b49c7056bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '227539f3d3844b15a456c937edbe955e'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:05.625843 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-ec9dc964-7521-4705-9dd8-85b49c7056bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '227539f3d3844b15a456c937edbe955e'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:05.635131 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-c641ff89-02ba-4df1-a345-cda3e4b027b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4775b4130a44d48ac10475d005c5bbc', 'request_id': 'req-c641ff89-02ba-4df1-a345-cda3e4b027b3'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:05.657060 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-ec9dc964-7521-4705-9dd8-85b49c7056bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '227539f3d3844b15a456c937edbe955e'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:05.661609 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-c641ff89-02ba-4df1-a345-cda3e4b027b3 admin admin] The token cache is being invalidate because project f4775b4130a44d48ac10475d005c5bbc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:18:05.662020 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-c641ff89-02ba-4df1-a345-cda3e4b027b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:05.666346 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-c641ff89-02ba-4df1-a345-cda3e4b027b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:05.669331 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1076/2158] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 5 12:18:05 2022] DELETE /identity/v3/projects/f4775b4130a44d48ac10475d005c5bbc => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:18:05.675508 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb50f99-09bb-4a8f-b1f5-3ac24fc3f1c4 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:05.675508 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb50f99-09bb-4a8f-b1f5-3ac24fc3f1c4 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:05.675508 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb50f99-09bb-4a8f-b1f5-3ac24fc3f1c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:05.683223 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:18:05.689156 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1083/2159] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 5 12:18:05 2022] DELETE /identity/v3/users/227539f3d3844b15a456c937edbe955e => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:18:05.694225 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb3cfa8-07e2-4bc0-9f71-8d65c7726ec7 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:05.694624 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb3cfa8-07e2-4bc0-9f71-8d65c7726ec7 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:05.694966 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb3cfa8-07e2-4bc0-9f71-8d65c7726ec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:05.709540 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-7eb50f99-09bb-4a8f-b1f5-3ac24fc3f1c4 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:18:05.710936 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-7eb50f99-09bb-4a8f-b1f5-3ac24fc3f1c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:18:05.733857 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-cfb3cfa8-07e2-4bc0-9f71-8d65c7726ec7 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:18:05.735110 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-cfb3cfa8-07e2-4bc0-9f71-8d65c7726ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:18:05.905360 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1077/2160] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:18:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 12:18:05.916505 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66113e38-ffd7-4edb-93e7-2792e7aa4b8b None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:05.917338 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66113e38-ffd7-4edb-93e7-2792e7aa4b8b None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:05.917681 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66113e38-ffd7-4edb-93e7-2792e7aa4b8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:05.930767 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1084/2161] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:18:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 12:18:05.947690 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb3cfa8-07e2-4bc0-9f71-8d65c7726ec7 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:05.949524 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-cfb3cfa8-07e2-4bc0-9f71-8d65c7726ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:18:05.960506 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-66113e38-ffd7-4edb-93e7-2792e7aa4b8b None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:18:05.961924 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-66113e38-ffd7-4edb-93e7-2792e7aa4b8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:18:05.991931 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1078/2162] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:18:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:18:05.994992 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66113e38-ffd7-4edb-93e7-2792e7aa4b8b None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:06.019085 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66113e38-ffd7-4edb-93e7-2792e7aa4b8b None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:06.027512 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163e137c-6bf7-467e-9967-5394886cc356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:06.028853 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163e137c-6bf7-467e-9967-5394886cc356 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:06.029395 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163e137c-6bf7-467e-9967-5394886cc356 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:06.029813 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163e137c-6bf7-467e-9967-5394886cc356 admin admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:06.030734 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163e137c-6bf7-467e-9967-5394886cc356 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:18:06.031272 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163e137c-6bf7-467e-9967-5394886cc356 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:06.033482 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163e137c-6bf7-467e-9967-5394886cc356 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:06.058741 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1079/2163] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Sep 5 12:18:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:18:06.064154 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163e137c-6bf7-467e-9967-5394886cc356 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:06.065888 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb3cfa8-07e2-4bc0-9f71-8d65c7726ec7 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:06.073834 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291657ce-8081-4fa4-8381-07f97b8b5bdf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4994b4faa4ec4aa088f3dc32c9c5614d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:06.079469 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291657ce-8081-4fa4-8381-07f97b8b5bdf service neutron] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:06.079921 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291657ce-8081-4fa4-8381-07f97b8b5bdf service neutron] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:06.080557 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291657ce-8081-4fa4-8381-07f97b8b5bdf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:06.091869 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163e137c-6bf7-467e-9967-5394886cc356 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:06.104308 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496271e5-e7b7-4a85-976d-4e0da325d99f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:06.105546 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496271e5-e7b7-4a85-976d-4e0da325d99f admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:06.105829 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496271e5-e7b7-4a85-976d-4e0da325d99f admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:06.106102 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496271e5-e7b7-4a85-976d-4e0da325d99f admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:06.106753 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496271e5-e7b7-4a85-976d-4e0da325d99f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:06.108860 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496271e5-e7b7-4a85-976d-4e0da325d99f admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:06.120430 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291657ce-8081-4fa4-8381-07f97b8b5bdf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:06.121944 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291657ce-8081-4fa4-8381-07f97b8b5bdf service neutron] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:06.148387 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1085/2164] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:18:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 12:18:06.149595 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1080/2165] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 5 12:18:06 2022] POST /identity/v3/projects => generated 369 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:18:06.150701 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291657ce-8081-4fa4-8381-07f97b8b5bdf service neutron] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:06.166798 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291657ce-8081-4fa4-8381-07f97b8b5bdf service neutron] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:06.340013 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ad33a0-5b78-4f21-bfc9-e963333b5109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:06.341278 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ad33a0-5b78-4f21-bfc9-e963333b5109 admin admin] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:06.341662 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ad33a0-5b78-4f21-bfc9-e963333b5109 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:06.342035 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ad33a0-5b78-4f21-bfc9-e963333b5109 admin admin] PATH_INFO: `/v3/users` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:06.343069 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ad33a0-5b78-4f21-bfc9-e963333b5109 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:06.345453 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ad33a0-5b78-4f21-bfc9-e963333b5109 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:06.382263 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1086/2166] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 5 12:18:06 2022] POST /identity/v3/users => generated 285 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:18:06.386714 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496271e5-e7b7-4a85-976d-4e0da325d99f admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:06.404540 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496271e5-e7b7-4a85-976d-4e0da325d99f admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:06.409542 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a71c44-c783-4ff0-ac6c-ea1e3f17b51f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:06.410398 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a71c44-c783-4ff0-ac6c-ea1e3f17b51f admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:06.410926 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a71c44-c783-4ff0-ac6c-ea1e3f17b51f admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:06.411412 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a71c44-c783-4ff0-ac6c-ea1e3f17b51f admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:06.412349 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a71c44-c783-4ff0-ac6c-ea1e3f17b51f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:06.414222 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a71c44-c783-4ff0-ac6c-ea1e3f17b51f admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:06.427286 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1081/2167] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:18:06 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 12:18:06.431022 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ad33a0-5b78-4f21-bfc9-e963333b5109 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:06.448157 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ad33a0-5b78-4f21-bfc9-e963333b5109 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:06.461661 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0328ef4f-7068-496e-b00d-f5a287eb37f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:06.462866 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0328ef4f-7068-496e-b00d-f5a287eb37f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:06.463134 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0328ef4f-7068-496e-b00d-f5a287eb37f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:06.463697 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0328ef4f-7068-496e-b00d-f5a287eb37f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:06.464666 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0328ef4f-7068-496e-b00d-f5a287eb37f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:06.467257 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0328ef4f-7068-496e-b00d-f5a287eb37f9 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:06.486481 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1087/2168] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:18:06 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 12:18:06.487735 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a71c44-c783-4ff0-ac6c-ea1e3f17b51f admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:06.499565 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a71c44-c783-4ff0-ac6c-ea1e3f17b51f admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:06.504586 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aac593-14d5-4a60-badc-1f92f08e056b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:06.505297 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aac593-14d5-4a60-badc-1f92f08e056b admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:06.505580 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aac593-14d5-4a60-badc-1f92f08e056b admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:06.505856 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aac593-14d5-4a60-badc-1f92f08e056b admin admin] PATH_INFO: `/v3/projects/eb5db7502a1a4f2c89b2cb4c26e930f7/users/e66527a6005b476f8becd947c9e79394/roles/ed72181e1403401facb77dcf33644757` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:06.530221 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98aac593-14d5-4a60-badc-1f92f08e056b admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb5db7502a1a4f2c89b2cb4c26e930f7, user_id=e66527a6005b476f8becd947c9e79394, role_id=ed72181e1403401facb77dcf33644757)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:06.534783 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98aac593-14d5-4a60-badc-1f92f08e056b admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:06.559440 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1082/2169] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 5 12:18:06 2022] PUT /identity/v3/projects/eb5db7502a1a4f2c89b2cb4c26e930f7/users/e66527a6005b476f8becd947c9e79394/roles/ed72181e1403401facb77dcf33644757 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:18:06.569856 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af507ad-0b0b-43b9-811c-0e2ef1929011 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:06.570350 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af507ad-0b0b-43b9-811c-0e2ef1929011 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:06.570745 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af507ad-0b0b-43b9-811c-0e2ef1929011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:06.605920 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-0af507ad-0b0b-43b9-811c-0e2ef1929011 None None] MFA Rules not processed for user `e66527a6005b476f8becd947c9e79394`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:18:06.607362 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-0af507ad-0b0b-43b9-811c-0e2ef1929011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:18:06.620837 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:18:06.727487 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1088/2170] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:18:06 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:18:06.740514 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aac593-14d5-4a60-badc-1f92f08e056b admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:06.742577 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-98aac593-14d5-4a60-badc-1f92f08e056b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:18:06.795348 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:18:06.866758 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aac593-14d5-4a60-badc-1f92f08e056b admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:06.874383 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7c3301-0b5e-47ca-a824-3c7d5942a884 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37633bbae0c2423c81ccd61ac3a17ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:06.874775 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7c3301-0b5e-47ca-a824-3c7d5942a884 service cinder] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:06.875118 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7c3301-0b5e-47ca-a824-3c7d5942a884 service cinder] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:06.875398 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7c3301-0b5e-47ca-a824-3c7d5942a884 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:06.889308 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7c3301-0b5e-47ca-a824-3c7d5942a884 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:06.890900 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7c3301-0b5e-47ca-a824-3c7d5942a884 service cinder] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:06.910352 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1083/2171] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:18:06 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:18:06.936923 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af507ad-0b0b-43b9-811c-0e2ef1929011 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:07.036805 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af507ad-0b0b-43b9-811c-0e2ef1929011 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:07.042463 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220e52a3-91e8-47d1-9366-0baac5f6a476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:07.043342 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220e52a3-91e8-47d1-9366-0baac5f6a476 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:07.043760 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220e52a3-91e8-47d1-9366-0baac5f6a476 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:07.044142 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220e52a3-91e8-47d1-9366-0baac5f6a476 admin admin] PATH_INFO: `/v3/users/e66527a6005b476f8becd947c9e79394` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:07.045665 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220e52a3-91e8-47d1-9366-0baac5f6a476 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e66527a6005b476f8becd947c9e79394)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:07.047944 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220e52a3-91e8-47d1-9366-0baac5f6a476 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:07.105772 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-220e52a3-91e8-47d1-9366-0baac5f6a476 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e66527a6005b476f8becd947c9e79394'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:07.106556 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-220e52a3-91e8-47d1-9366-0baac5f6a476 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e66527a6005b476f8becd947c9e79394'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:07.117470 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-220e52a3-91e8-47d1-9366-0baac5f6a476 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e66527a6005b476f8becd947c9e79394'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:07.118578 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-220e52a3-91e8-47d1-9366-0baac5f6a476 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e66527a6005b476f8becd947c9e79394'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:07.134605 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-220e52a3-91e8-47d1-9366-0baac5f6a476 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e66527a6005b476f8becd947c9e79394'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:07.160935 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1089/2172] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 5 12:18:06 2022] DELETE /identity/v3/users/e66527a6005b476f8becd947c9e79394 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:18:07.165908 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b64d82-2898-430a-b044-461b1b51ea57 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:07.167631 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b64d82-2898-430a-b044-461b1b51ea57 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:07.167995 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b64d82-2898-430a-b044-461b1b51ea57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:07.195438 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-31b64d82-2898-430a-b044-461b1b51ea57 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:18:07.197700 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-31b64d82-2898-430a-b044-461b1b51ea57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:18:07.244922 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220e52a3-91e8-47d1-9366-0baac5f6a476 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:07.251045 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-220e52a3-91e8-47d1-9366-0baac5f6a476 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:18:07.300194 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1084/2173] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:18:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:18:07.314011 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:18:07.317832 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b64d82-2898-430a-b044-461b1b51ea57 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:07.320676 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-31b64d82-2898-430a-b044-461b1b51ea57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:18:07.370936 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220e52a3-91e8-47d1-9366-0baac5f6a476 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:07.377340 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11ad2f3-da95-454a-979e-d3bdf74124cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:07.377875 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11ad2f3-da95-454a-979e-d3bdf74124cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:07.378159 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11ad2f3-da95-454a-979e-d3bdf74124cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:07.378481 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11ad2f3-da95-454a-979e-d3bdf74124cb admin admin] PATH_INFO: `/v3/projects/34fb77d8fb9c4c1884001f8748bf4469` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:07.380574 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11ad2f3-da95-454a-979e-d3bdf74124cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=34fb77d8fb9c4c1884001f8748bf4469)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:07.383665 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11ad2f3-da95-454a-979e-d3bdf74124cb admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:07.486764 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-b11ad2f3-da95-454a-979e-d3bdf74124cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34fb77d8fb9c4c1884001f8748bf4469', 'request_id': 'req-b11ad2f3-da95-454a-979e-d3bdf74124cb'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:07.488600 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b64d82-2898-430a-b044-461b1b51ea57 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:07.505913 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-b11ad2f3-da95-454a-979e-d3bdf74124cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34fb77d8fb9c4c1884001f8748bf4469', 'request_id': 'req-b11ad2f3-da95-454a-979e-d3bdf74124cb'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:07.520261 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-b11ad2f3-da95-454a-979e-d3bdf74124cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34fb77d8fb9c4c1884001f8748bf4469', 'request_id': 'req-b11ad2f3-da95-454a-979e-d3bdf74124cb'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:07.555620 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-b11ad2f3-da95-454a-979e-d3bdf74124cb admin admin] The token cache is being invalidate because project 34fb77d8fb9c4c1884001f8748bf4469 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:18:07.558466 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-b11ad2f3-da95-454a-979e-d3bdf74124cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:07.560953 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-b11ad2f3-da95-454a-979e-d3bdf74124cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:07.565622 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1090/2174] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 5 12:18:07 2022] DELETE /identity/v3/projects/34fb77d8fb9c4c1884001f8748bf4469 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:18:07.569312 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11ad2f3-da95-454a-979e-d3bdf74124cb admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:07.572167 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-b11ad2f3-da95-454a-979e-d3bdf74124cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:18:07.626623 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b81f228-4670-4138-a482-f3798d89273f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4994b4faa4ec4aa088f3dc32c9c5614d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:07.627252 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b81f228-4670-4138-a482-f3798d89273f service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:07.627532 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b81f228-4670-4138-a482-f3798d89273f service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:07.627803 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b81f228-4670-4138-a482-f3798d89273f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:07.634823 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-5b81f228-4670-4138-a482-f3798d89273f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:18:07.724730 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:18:07.748773 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11ad2f3-da95-454a-979e-d3bdf74124cb admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:07.775409 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aa46cd-e8a6-4b69-8ed9-f972d4b38e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:07.775409 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aa46cd-e8a6-4b69-8ed9-f972d4b38e50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:07.775409 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aa46cd-e8a6-4b69-8ed9-f972d4b38e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:07.775409 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aa46cd-e8a6-4b69-8ed9-f972d4b38e50 admin admin] PATH_INFO: `/v3/users/f575ab2a3d7548e88116387668fdbbf5` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:07.776304 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60aa46cd-e8a6-4b69-8ed9-f972d4b38e50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f575ab2a3d7548e88116387668fdbbf5)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:07.776304 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60aa46cd-e8a6-4b69-8ed9-f972d4b38e50 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:07.815466 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b81f228-4670-4138-a482-f3798d89273f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:07.817353 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b81f228-4670-4138-a482-f3798d89273f service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:07.830791 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1085/2175] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:18:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 514 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 12:18:07.831778 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b81f228-4670-4138-a482-f3798d89273f service neutron] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:07.833283 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-5b81f228-4670-4138-a482-f3798d89273f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:18:07.852437 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b81f228-4670-4138-a482-f3798d89273f service neutron] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:07.852652 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-60aa46cd-e8a6-4b69-8ed9-f972d4b38e50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f575ab2a3d7548e88116387668fdbbf5'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:07.852652 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-60aa46cd-e8a6-4b69-8ed9-f972d4b38e50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f575ab2a3d7548e88116387668fdbbf5'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:07.853017 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91467d2-7919-4567-90b0-fab3b7443bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:07.853017 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91467d2-7919-4567-90b0-fab3b7443bda admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:07.853017 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91467d2-7919-4567-90b0-fab3b7443bda admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:07.853017 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91467d2-7919-4567-90b0-fab3b7443bda admin admin] PATH_INFO: `/v3/users/9e4db324ccaf4ff4898c778fc1a1b4bf` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:07.854363 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91467d2-7919-4567-90b0-fab3b7443bda admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e4db324ccaf4ff4898c778fc1a1b4bf)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:07.856354 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91467d2-7919-4567-90b0-fab3b7443bda admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:07.876407 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-60aa46cd-e8a6-4b69-8ed9-f972d4b38e50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f575ab2a3d7548e88116387668fdbbf5'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:07.877193 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-60aa46cd-e8a6-4b69-8ed9-f972d4b38e50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f575ab2a3d7548e88116387668fdbbf5'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:07.891314 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:18:07.905904 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-60aa46cd-e8a6-4b69-8ed9-f972d4b38e50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f575ab2a3d7548e88116387668fdbbf5'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:07.945513 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1091/2176] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 5 12:18:07 2022] DELETE /identity/v3/users/f575ab2a3d7548e88116387668fdbbf5 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:18:07.951892 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-d91467d2-7919-4567-90b0-fab3b7443bda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e4db324ccaf4ff4898c778fc1a1b4bf'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:07.953335 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-d91467d2-7919-4567-90b0-fab3b7443bda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e4db324ccaf4ff4898c778fc1a1b4bf'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:07.964601 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-d91467d2-7919-4567-90b0-fab3b7443bda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e4db324ccaf4ff4898c778fc1a1b4bf'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:07.965469 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-d91467d2-7919-4567-90b0-fab3b7443bda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e4db324ccaf4ff4898c778fc1a1b4bf'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:07.984861 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-d91467d2-7919-4567-90b0-fab3b7443bda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e4db324ccaf4ff4898c778fc1a1b4bf'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:08.004276 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1086/2177] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 5 12:18:07 2022] DELETE /identity/v3/users/9e4db324ccaf4ff4898c778fc1a1b4bf => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:18:08.009598 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288722f9-3dbd-4cc3-b467-5bbf440a4893 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:08.009890 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288722f9-3dbd-4cc3-b467-5bbf440a4893 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:08.010169 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288722f9-3dbd-4cc3-b467-5bbf440a4893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:08.035970 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-288722f9-3dbd-4cc3-b467-5bbf440a4893 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:18:08.037253 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-288722f9-3dbd-4cc3-b467-5bbf440a4893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:18:08.135711 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1092/2178] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:18:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:18:08.160002 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91467d2-7919-4567-90b0-fab3b7443bda admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:08.161660 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-d91467d2-7919-4567-90b0-fab3b7443bda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:18:08.261557 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91467d2-7919-4567-90b0-fab3b7443bda admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:08.274769 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606cf886-22a9-4a1c-ac09-b86e16cfe54d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4994b4faa4ec4aa088f3dc32c9c5614d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:08.275565 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606cf886-22a9-4a1c-ac09-b86e16cfe54d service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:08.277223 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606cf886-22a9-4a1c-ac09-b86e16cfe54d service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:08.277653 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606cf886-22a9-4a1c-ac09-b86e16cfe54d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:08.294032 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606cf886-22a9-4a1c-ac09-b86e16cfe54d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:08.298291 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606cf886-22a9-4a1c-ac09-b86e16cfe54d service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:08.317403 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1087/2179] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:18:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:18:08.590357 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95da4259-d035-495e-a799-8bf0dc7839f3 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:08.590862 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95da4259-d035-495e-a799-8bf0dc7839f3 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:08.590974 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95da4259-d035-495e-a799-8bf0dc7839f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:08.659101 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-95da4259-d035-495e-a799-8bf0dc7839f3 None None] MFA Rules not processed for user `ab3a4519819e46ba945398957780f956`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:18:08.660419 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-95da4259-d035-495e-a799-8bf0dc7839f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:18:08.822554 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1093/2180] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:18:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:18:08.825137 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606cf886-22a9-4a1c-ac09-b86e16cfe54d service neutron] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:08.826655 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-606cf886-22a9-4a1c-ac09-b86e16cfe54d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:18:08.847745 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606cf886-22a9-4a1c-ac09-b86e16cfe54d service neutron] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:08.860768 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3fd4f7-a168-4038-b3d3-18b5b1485f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:08.861027 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3fd4f7-a168-4038-b3d3-18b5b1485f36 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:08.861271 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3fd4f7-a168-4038-b3d3-18b5b1485f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:08.861545 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3fd4f7-a168-4038-b3d3-18b5b1485f36 admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:08.862199 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3fd4f7-a168-4038-b3d3-18b5b1485f36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:08.864139 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3fd4f7-a168-4038-b3d3-18b5b1485f36 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:08.927023 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1088/2181] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 5 12:18:08 2022] POST /identity/v3/projects => generated 373 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 12:18:08.931561 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95da4259-d035-495e-a799-8bf0dc7839f3 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:08.949587 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95da4259-d035-495e-a799-8bf0dc7839f3 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:09.065914 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3fd4f7-a168-4038-b3d3-18b5b1485f36 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:09.068668 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-ee3fd4f7-a168-4038-b3d3-18b5b1485f36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:18:09.079938 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b64669-8875-44fb-a231-17612dc2d210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:09.081478 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b64669-8875-44fb-a231-17612dc2d210 admin admin] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:09.081962 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b64669-8875-44fb-a231-17612dc2d210 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:09.082427 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b64669-8875-44fb-a231-17612dc2d210 admin admin] PATH_INFO: `/v3/users` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:09.093514 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b64669-8875-44fb-a231-17612dc2d210 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:09.098259 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b64669-8875-44fb-a231-17612dc2d210 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:09.112163 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:18:09.123605 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:18:09.132563 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1094/2182] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 5 12:18:08 2022] POST /identity/v3/users => generated 293 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:18:09.146451 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b64669-8875-44fb-a231-17612dc2d210 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:09.166930 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b64669-8875-44fb-a231-17612dc2d210 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:09.174020 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b629ecc4-68b0-412d-b32d-3912d50b051f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:09.175509 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b629ecc4-68b0-412d-b32d-3912d50b051f admin admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:09.175639 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b629ecc4-68b0-412d-b32d-3912d50b051f admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:09.177412 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b629ecc4-68b0-412d-b32d-3912d50b051f admin admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:09.178690 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b629ecc4-68b0-412d-b32d-3912d50b051f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:09.184628 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b629ecc4-68b0-412d-b32d-3912d50b051f admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:09.214713 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1095/2183] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:18:09 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 12:18:09.215864 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b629ecc4-68b0-412d-b32d-3912d50b051f admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:09.217651 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3fd4f7-a168-4038-b3d3-18b5b1485f36 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:09.229891 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b629ecc4-68b0-412d-b32d-3912d50b051f admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:09.230811 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8691a6e5-ef19-4ec4-b452-7c0a4974bf36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:09.231468 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8691a6e5-ef19-4ec4-b452-7c0a4974bf36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:09.231748 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8691a6e5-ef19-4ec4-b452-7c0a4974bf36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:09.232385 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8691a6e5-ef19-4ec4-b452-7c0a4974bf36 admin admin] PATH_INFO: `/v3/projects/797a68d44bf442aa8ecc42f3e667a742` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:09.234825 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8691a6e5-ef19-4ec4-b452-7c0a4974bf36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=797a68d44bf442aa8ecc42f3e667a742)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:09.236711 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8691a6e5-ef19-4ec4-b452-7c0a4974bf36 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:09.237586 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6453f2-05a9-4e95-9f7f-ac87f9b76ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:09.238903 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6453f2-05a9-4e95-9f7f-ac87f9b76ea4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:09.239403 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6453f2-05a9-4e95-9f7f-ac87f9b76ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:09.239874 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6453f2-05a9-4e95-9f7f-ac87f9b76ea4 admin admin] PATH_INFO: `/v3/projects/b4af6f679e5947968fd76098c7af67b4/users/3647bfeea3344a80a9bb0a3ede380373/roles/16e2ccc8bd1b497d8cee780c1c7df0d2` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:09.286781 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6453f2-05a9-4e95-9f7f-ac87f9b76ea4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4af6f679e5947968fd76098c7af67b4, user_id=3647bfeea3344a80a9bb0a3ede380373, role_id=16e2ccc8bd1b497d8cee780c1c7df0d2)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:09.289796 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6453f2-05a9-4e95-9f7f-ac87f9b76ea4 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:09.316143 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1096/2184] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 5 12:18:09 2022] PUT /identity/v3/projects/b4af6f679e5947968fd76098c7af67b4/users/3647bfeea3344a80a9bb0a3ede380373/roles/16e2ccc8bd1b497d8cee780c1c7df0d2 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:18:09.317771 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-8691a6e5-ef19-4ec4-b452-7c0a4974bf36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '797a68d44bf442aa8ecc42f3e667a742', 'request_id': 'req-8691a6e5-ef19-4ec4-b452-7c0a4974bf36'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:09.318261 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6453f2-05a9-4e95-9f7f-ac87f9b76ea4 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:09.328625 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-8691a6e5-ef19-4ec4-b452-7c0a4974bf36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '797a68d44bf442aa8ecc42f3e667a742', 'request_id': 'req-8691a6e5-ef19-4ec4-b452-7c0a4974bf36'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:09.337236 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-8691a6e5-ef19-4ec4-b452-7c0a4974bf36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '797a68d44bf442aa8ecc42f3e667a742', 'request_id': 'req-8691a6e5-ef19-4ec4-b452-7c0a4974bf36'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:09.349499 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-8691a6e5-ef19-4ec4-b452-7c0a4974bf36 admin admin] The token cache is being invalidate because project 797a68d44bf442aa8ecc42f3e667a742 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:18:09.350578 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-8691a6e5-ef19-4ec4-b452-7c0a4974bf36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:09.350923 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-8691a6e5-ef19-4ec4-b452-7c0a4974bf36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:09.352616 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1089/2185] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 5 12:18:09 2022] DELETE /identity/v3/projects/797a68d44bf442aa8ecc42f3e667a742 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:18:09.356713 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8691a6e5-ef19-4ec4-b452-7c0a4974bf36 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:09.359787 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-8691a6e5-ef19-4ec4-b452-7c0a4974bf36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:18:09.392635 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6453f2-05a9-4e95-9f7f-ac87f9b76ea4 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:09.397788 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32cf84d-207a-4022-a867-e2cf279dcfc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:09.398539 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32cf84d-207a-4022-a867-e2cf279dcfc6 admin admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:09.398925 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32cf84d-207a-4022-a867-e2cf279dcfc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:09.399297 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32cf84d-207a-4022-a867-e2cf279dcfc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:09.400060 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32cf84d-207a-4022-a867-e2cf279dcfc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:09.402068 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32cf84d-207a-4022-a867-e2cf279dcfc6 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:09.416275 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1097/2186] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:18:09 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:18:09.418519 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32cf84d-207a-4022-a867-e2cf279dcfc6 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:09.420457 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-a32cf84d-207a-4022-a867-e2cf279dcfc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:18:09.434279 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32cf84d-207a-4022-a867-e2cf279dcfc6 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:09.440134 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6406eb-7534-49ed-a799-e955b8add504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:09.440904 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6406eb-7534-49ed-a799-e955b8add504 admin admin] REQUEST_METHOD: `PUT` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:09.441318 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6406eb-7534-49ed-a799-e955b8add504 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:09.441683 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6406eb-7534-49ed-a799-e955b8add504 admin admin] PATH_INFO: `/v3/projects/b4af6f679e5947968fd76098c7af67b4/users/3647bfeea3344a80a9bb0a3ede380373/roles/16e2ccc8bd1b497d8cee780c1c7df0d2` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:09.443915 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6406eb-7534-49ed-a799-e955b8add504 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4af6f679e5947968fd76098c7af67b4, user_id=3647bfeea3344a80a9bb0a3ede380373, role_id=16e2ccc8bd1b497d8cee780c1c7df0d2)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:09.448528 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6406eb-7534-49ed-a799-e955b8add504 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:09.448927 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8691a6e5-ef19-4ec4-b452-7c0a4974bf36 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:09.458269 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f806adb0-f368-4625-a2a7-b33a10f4d74a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:09.459109 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f806adb0-f368-4625-a2a7-b33a10f4d74a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:09.459431 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f806adb0-f368-4625-a2a7-b33a10f4d74a admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:09.459792 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f806adb0-f368-4625-a2a7-b33a10f4d74a admin admin] PATH_INFO: `/v3/users/18d3ae51c052491aaa92e3e99ae7ca2c` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:09.461107 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f806adb0-f368-4625-a2a7-b33a10f4d74a admin admin] RBAC: Authorizing `identity:delete_user(user_id=18d3ae51c052491aaa92e3e99ae7ca2c)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:09.461823 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1098/2187] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 5 12:18:09 2022] PUT /identity/v3/projects/b4af6f679e5947968fd76098c7af67b4/users/3647bfeea3344a80a9bb0a3ede380373/roles/16e2ccc8bd1b497d8cee780c1c7df0d2 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 12:18:09.477368 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f806adb0-f368-4625-a2a7-b33a10f4d74a admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:09.479762 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6406eb-7534-49ed-a799-e955b8add504 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:09.481605 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-9d6406eb-7534-49ed-a799-e955b8add504 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:18:09.570103 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-f806adb0-f368-4625-a2a7-b33a10f4d74a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18d3ae51c052491aaa92e3e99ae7ca2c'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:09.571382 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-f806adb0-f368-4625-a2a7-b33a10f4d74a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18d3ae51c052491aaa92e3e99ae7ca2c'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:09.577328 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:18:09.580075 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6406eb-7534-49ed-a799-e955b8add504 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:09.585907 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4220c698-00f6-44c3-954a-abcda3ac4ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:09.587969 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4220c698-00f6-44c3-954a-abcda3ac4ba0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:09.588252 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4220c698-00f6-44c3-954a-abcda3ac4ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:09.588926 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4220c698-00f6-44c3-954a-abcda3ac4ba0 admin admin] PATH_INFO: `/v3/projects/97eb76336bb34d29bcb1a97506f55d93` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:09.590641 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4220c698-00f6-44c3-954a-abcda3ac4ba0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97eb76336bb34d29bcb1a97506f55d93)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:09.593001 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4220c698-00f6-44c3-954a-abcda3ac4ba0 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:09.597673 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-f806adb0-f368-4625-a2a7-b33a10f4d74a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18d3ae51c052491aaa92e3e99ae7ca2c'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:09.600010 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-f806adb0-f368-4625-a2a7-b33a10f4d74a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18d3ae51c052491aaa92e3e99ae7ca2c'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:09.629397 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-f806adb0-f368-4625-a2a7-b33a10f4d74a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18d3ae51c052491aaa92e3e99ae7ca2c'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:09.662655 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1090/2188] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 5 12:18:09 2022] DELETE /identity/v3/users/18d3ae51c052491aaa92e3e99ae7ca2c => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 12:18:09.662655 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f806adb0-f368-4625-a2a7-b33a10f4d74a admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:09.664173 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-f806adb0-f368-4625-a2a7-b33a10f4d74a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:18:09.670875 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-4220c698-00f6-44c3-954a-abcda3ac4ba0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97eb76336bb34d29bcb1a97506f55d93', 'request_id': 'req-4220c698-00f6-44c3-954a-abcda3ac4ba0'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:09.673224 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:18:09.687663 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-4220c698-00f6-44c3-954a-abcda3ac4ba0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97eb76336bb34d29bcb1a97506f55d93', 'request_id': 'req-4220c698-00f6-44c3-954a-abcda3ac4ba0'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:09.710948 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-4220c698-00f6-44c3-954a-abcda3ac4ba0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97eb76336bb34d29bcb1a97506f55d93', 'request_id': 'req-4220c698-00f6-44c3-954a-abcda3ac4ba0'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:09.744735 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-4220c698-00f6-44c3-954a-abcda3ac4ba0 admin admin] The token cache is being invalidate because project 97eb76336bb34d29bcb1a97506f55d93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:18:09.745963 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-4220c698-00f6-44c3-954a-abcda3ac4ba0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:09.747054 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-4220c698-00f6-44c3-954a-abcda3ac4ba0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:09.753368 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1099/2189] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 5 12:18:09 2022] DELETE /identity/v3/projects/97eb76336bb34d29bcb1a97506f55d93 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 12:18:09.756058 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b6a53f-824c-4ffb-8c9d-3a8cd9ff4b69 None None] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:09.756564 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b6a53f-824c-4ffb-8c9d-3a8cd9ff4b69 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:09.756980 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b6a53f-824c-4ffb-8c9d-3a8cd9ff4b69 None None] PATH_INFO: `/` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:09.759279 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1100/2190] 10.222.0.50 () {54 vars in 921 bytes} [Mon Sep 5 12:18:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:18:09.760812 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7f78e2-0f3f-4378-966d-23255c7370a1 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:09.761230 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7f78e2-0f3f-4378-966d-23255c7370a1 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:09.761836 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7f78e2-0f3f-4378-966d-23255c7370a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:09.802841 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-3f7f78e2-0f3f-4378-966d-23255c7370a1 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:18:09.806634 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-3f7f78e2-0f3f-4378-966d-23255c7370a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:18:09.813059 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f806adb0-f368-4625-a2a7-b33a10f4d74a admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:09.825118 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b9c478-7af4-42b5-9815-f15416c9105d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:09.826453 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b9c478-7af4-42b5-9815-f15416c9105d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:09.826981 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b9c478-7af4-42b5-9815-f15416c9105d admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:09.827167 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b9c478-7af4-42b5-9815-f15416c9105d admin admin] PATH_INFO: `/v3/projects/eb5db7502a1a4f2c89b2cb4c26e930f7` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:09.830205 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b9c478-7af4-42b5-9815-f15416c9105d admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb5db7502a1a4f2c89b2cb4c26e930f7)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:09.832555 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b9c478-7af4-42b5-9815-f15416c9105d admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:09.833283 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1101/2191] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:18:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:18:09.842514 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938e8bb0-2883-4af7-af74-dec8e3d8f1c8 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:09.844922 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938e8bb0-2883-4af7-af74-dec8e3d8f1c8 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:09.845429 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938e8bb0-2883-4af7-af74-dec8e3d8f1c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:09.874671 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-938e8bb0-2883-4af7-af74-dec8e3d8f1c8 None None] MFA Rules not processed for user `c5427d0752de4817b6aa25e28c2d9a30`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:18:09.876176 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-938e8bb0-2883-4af7-af74-dec8e3d8f1c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:18:09.911751 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-33b9c478-7af4-42b5-9815-f15416c9105d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb5db7502a1a4f2c89b2cb4c26e930f7', 'request_id': 'req-33b9c478-7af4-42b5-9815-f15416c9105d'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:09.924165 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-33b9c478-7af4-42b5-9815-f15416c9105d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb5db7502a1a4f2c89b2cb4c26e930f7', 'request_id': 'req-33b9c478-7af4-42b5-9815-f15416c9105d'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:09.945877 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-33b9c478-7af4-42b5-9815-f15416c9105d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb5db7502a1a4f2c89b2cb4c26e930f7', 'request_id': 'req-33b9c478-7af4-42b5-9815-f15416c9105d'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:09.975038 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-33b9c478-7af4-42b5-9815-f15416c9105d admin admin] The token cache is being invalidate because project eb5db7502a1a4f2c89b2cb4c26e930f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:18:09.975422 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-33b9c478-7af4-42b5-9815-f15416c9105d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:09.976287 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-33b9c478-7af4-42b5-9815-f15416c9105d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:09.978218 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1091/2192] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 5 12:18:09 2022] DELETE /identity/v3/projects/eb5db7502a1a4f2c89b2cb4c26e930f7 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:18:09.980519 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1102/2193] 10.222.0.50 () {58 vars in 1018 bytes} [Mon Sep 5 12:18:09 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:18:09.981914 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f972311-f39c-450a-927c-c91503a8531d None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:09.982304 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f972311-f39c-450a-927c-c91503a8531d None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:09.982753 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f972311-f39c-450a-927c-c91503a8531d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:09.984327 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b9c478-7af4-42b5-9815-f15416c9105d admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:09.988678 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-33b9c478-7af4-42b5-9815-f15416c9105d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:18:10.018050 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-9f972311-f39c-450a-927c-c91503a8531d None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:18:10.019661 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-9f972311-f39c-450a-927c-c91503a8531d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:18:10.131779 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:18:10.141002 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b9c478-7af4-42b5-9815-f15416c9105d admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:10.149312 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa4a4c7-cf23-4e4c-9f3b-9d4a17f2d030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:10.150330 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa4a4c7-cf23-4e4c-9f3b-9d4a17f2d030 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:10.152636 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa4a4c7-cf23-4e4c-9f3b-9d4a17f2d030 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:10.153154 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa4a4c7-cf23-4e4c-9f3b-9d4a17f2d030 admin admin] PATH_INFO: `/v3/users/1a65057dea094b77a0d13fda46b7d6ed` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:10.155842 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa4a4c7-cf23-4e4c-9f3b-9d4a17f2d030 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a65057dea094b77a0d13fda46b7d6ed)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:10.158360 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa4a4c7-cf23-4e4c-9f3b-9d4a17f2d030 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:10.211990 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1103/2194] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:18:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:18:10.214796 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ac9069-2f2b-44a4-ab4e-f471f1421725 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:10.215363 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ac9069-2f2b-44a4-ab4e-f471f1421725 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:10.215635 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ac9069-2f2b-44a4-ab4e-f471f1421725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:10.245064 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-d1ac9069-2f2b-44a4-ab4e-f471f1421725 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:18:10.246881 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-d1ac9069-2f2b-44a4-ab4e-f471f1421725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:18:10.262436 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1104/2195] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:18:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:18:10.268385 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8e94b3-5455-4f80-85b1-2aaf297e80b0 None None] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:10.268742 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8e94b3-5455-4f80-85b1-2aaf297e80b0 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:10.269059 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8e94b3-5455-4f80-85b1-2aaf297e80b0 None None] PATH_INFO: `/` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:10.270664 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1105/2196] 10.222.0.50 () {54 vars in 961 bytes} [Mon Sep 5 12:18:10 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:18:10.271278 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8e94b3-5455-4f80-85b1-2aaf297e80b0 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:10.274851 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-caa4a4c7-cf23-4e4c-9f3b-9d4a17f2d030 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a65057dea094b77a0d13fda46b7d6ed'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:10.275604 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-caa4a4c7-cf23-4e4c-9f3b-9d4a17f2d030 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a65057dea094b77a0d13fda46b7d6ed'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:10.289488 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-caa4a4c7-cf23-4e4c-9f3b-9d4a17f2d030 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a65057dea094b77a0d13fda46b7d6ed'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:10.290530 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-caa4a4c7-cf23-4e4c-9f3b-9d4a17f2d030 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a65057dea094b77a0d13fda46b7d6ed'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:10.297100 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8e94b3-5455-4f80-85b1-2aaf297e80b0 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:10.311064 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bf603b-faa7-486e-918e-7d2618f2a6fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:10.311902 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bf603b-faa7-486e-918e-7d2618f2a6fa admin admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:10.312986 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bf603b-faa7-486e-918e-7d2618f2a6fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:10.314828 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bf603b-faa7-486e-918e-7d2618f2a6fa admin admin] PATH_INFO: `/v3/domains` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:10.315739 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-caa4a4c7-cf23-4e4c-9f3b-9d4a17f2d030 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a65057dea094b77a0d13fda46b7d6ed'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:10.316369 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bf603b-faa7-486e-918e-7d2618f2a6fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:18:10.317272 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bf603b-faa7-486e-918e-7d2618f2a6fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:10.320813 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bf603b-faa7-486e-918e-7d2618f2a6fa admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:10.337325 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1092/2197] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 5 12:18:09 2022] DELETE /identity/v3/users/1a65057dea094b77a0d13fda46b7d6ed => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:18:10.339183 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d80834-90dd-487f-9235-2cca21e99a65 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:10.339630 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d80834-90dd-487f-9235-2cca21e99a65 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:10.339907 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d80834-90dd-487f-9235-2cca21e99a65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:10.351786 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1106/2198] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Sep 5 12:18:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:18:10.355738 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac0c945-887c-44cf-9549-b1d3f7ea5f56 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:10.357358 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac0c945-887c-44cf-9549-b1d3f7ea5f56 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:10.358465 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac0c945-887c-44cf-9549-b1d3f7ea5f56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:10.371052 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-19d80834-90dd-487f-9235-2cca21e99a65 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:18:10.372326 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-19d80834-90dd-487f-9235-2cca21e99a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:18:10.407839 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-6ac0c945-887c-44cf-9549-b1d3f7ea5f56 None None] MFA Rules not processed for user `c5427d0752de4817b6aa25e28c2d9a30`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:18:10.411045 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-6ac0c945-887c-44cf-9549-b1d3f7ea5f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:18:10.507850 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1093/2199] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:18:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:18:10.508848 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d80834-90dd-487f-9235-2cca21e99a65 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:10.512406 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-19d80834-90dd-487f-9235-2cca21e99a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:18:10.522104 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=96 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:18:10.538855 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d80834-90dd-487f-9235-2cca21e99a65 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:10.553251 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754d803c-ea8c-474f-9ba9-b3c8953e2b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:10.553849 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1107/2200] 10.222.0.50 () {58 vars in 1058 bytes} [Mon Sep 5 12:18:10 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:18:10.553971 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754d803c-ea8c-474f-9ba9-b3c8953e2b63 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:10.554174 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754d803c-ea8c-474f-9ba9-b3c8953e2b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:10.554452 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754d803c-ea8c-474f-9ba9-b3c8953e2b63 admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:10.554887 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac0c945-887c-44cf-9549-b1d3f7ea5f56 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:10.555099 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754d803c-ea8c-474f-9ba9-b3c8953e2b63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:10.557148 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754d803c-ea8c-474f-9ba9-b3c8953e2b63 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:10.569381 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac0c945-887c-44cf-9549-b1d3f7ea5f56 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:10.577409 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9178726c-8a94-4388-909b-daf81d60ee56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:10.578224 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9178726c-8a94-4388-909b-daf81d60ee56 admin admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:10.578603 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9178726c-8a94-4388-909b-daf81d60ee56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:10.579004 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9178726c-8a94-4388-909b-daf81d60ee56 admin admin] PATH_INFO: `/v3/domains` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:10.579967 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9178726c-8a94-4388-909b-daf81d60ee56 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:18:10.580378 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9178726c-8a94-4388-909b-daf81d60ee56 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:10.583315 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9178726c-8a94-4388-909b-daf81d60ee56 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:10.608351 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1108/2201] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Sep 5 12:18:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:18:10.608351 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9178726c-8a94-4388-909b-daf81d60ee56 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:10.621448 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1094/2202] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 5 12:18:10 2022] POST /identity/v3/projects => generated 383 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:18:10.621448 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754d803c-ea8c-474f-9ba9-b3c8953e2b63 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:10.626462 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9178726c-8a94-4388-909b-daf81d60ee56 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:10.706229 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:18:10.723021 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754d803c-ea8c-474f-9ba9-b3c8953e2b63 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:10.732192 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448ef5c5-a0c5-4bf7-a808-13ecc8068ade service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5427d0752de4817b6aa25e28c2d9a30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:10.733238 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448ef5c5-a0c5-4bf7-a808-13ecc8068ade service placement] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:10.733883 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448ef5c5-a0c5-4bf7-a808-13ecc8068ade service placement] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:10.740868 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448ef5c5-a0c5-4bf7-a808-13ecc8068ade service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:10.742462 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbb5e81-c698-4b5d-99c4-767778098cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:10.743340 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbb5e81-c698-4b5d-99c4-767778098cac admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:10.743477 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbb5e81-c698-4b5d-99c4-767778098cac admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:10.743700 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbb5e81-c698-4b5d-99c4-767778098cac admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:10.744612 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbb5e81-c698-4b5d-99c4-767778098cac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:10.750501 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbb5e81-c698-4b5d-99c4-767778098cac admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:10.754298 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-448ef5c5-a0c5-4bf7-a808-13ecc8068ade service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:18:10.791029 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448ef5c5-a0c5-4bf7-a808-13ecc8068ade service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:10.797669 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448ef5c5-a0c5-4bf7-a808-13ecc8068ade service placement] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:10.822169 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1109/2203] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:18:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:18:10.827896 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448ef5c5-a0c5-4bf7-a808-13ecc8068ade service placement] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:10.837308 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1095/2204] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 5 12:18:10 2022] POST /identity/v3/projects => generated 375 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:18:10.838275 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbb5e81-c698-4b5d-99c4-767778098cac admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:10.840283 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-acbb5e81-c698-4b5d-99c4-767778098cac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:18:10.854251 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448ef5c5-a0c5-4bf7-a808-13ecc8068ade service placement] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:10.959421 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbb5e81-c698-4b5d-99c4-767778098cac admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:10.972715 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33362633-1c14-4eea-88e0-2f15b528f856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:10.973485 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33362633-1c14-4eea-88e0-2f15b528f856 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:10.973739 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33362633-1c14-4eea-88e0-2f15b528f856 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:10.974017 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33362633-1c14-4eea-88e0-2f15b528f856 admin admin] PATH_INFO: `/v3/projects/4f2dacf42b4c4a008f2aaa7185405b5f` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:10.975229 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33362633-1c14-4eea-88e0-2f15b528f856 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f2dacf42b4c4a008f2aaa7185405b5f)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:10.977681 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33362633-1c14-4eea-88e0-2f15b528f856 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:10.998305 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b782eb-9bab-4527-9a8c-730d55d41e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:10.998948 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b782eb-9bab-4527-9a8c-730d55d41e7a admin admin] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:10.999243 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b782eb-9bab-4527-9a8c-730d55d41e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:10.999635 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b782eb-9bab-4527-9a8c-730d55d41e7a admin admin] PATH_INFO: `/v3/users` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:11.000195 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b782eb-9bab-4527-9a8c-730d55d41e7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:11.002179 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b782eb-9bab-4527-9a8c-730d55d41e7a admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:11.077997 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1110/2205] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 5 12:18:10 2022] POST /identity/v3/users => generated 292 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:18:11.078985 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b782eb-9bab-4527-9a8c-730d55d41e7a admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:11.082626 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-33b782eb-9bab-4527-9a8c-730d55d41e7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:18:11.103069 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-33362633-1c14-4eea-88e0-2f15b528f856 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f2dacf42b4c4a008f2aaa7185405b5f', 'request_id': 'req-33362633-1c14-4eea-88e0-2f15b528f856'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:11.106526 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b782eb-9bab-4527-9a8c-730d55d41e7a admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:11.131131 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-33362633-1c14-4eea-88e0-2f15b528f856 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f2dacf42b4c4a008f2aaa7185405b5f', 'request_id': 'req-33362633-1c14-4eea-88e0-2f15b528f856'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:11.144355 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-33362633-1c14-4eea-88e0-2f15b528f856 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f2dacf42b4c4a008f2aaa7185405b5f', 'request_id': 'req-33362633-1c14-4eea-88e0-2f15b528f856'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:11.169206 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-33362633-1c14-4eea-88e0-2f15b528f856 admin admin] The token cache is being invalidate because project 4f2dacf42b4c4a008f2aaa7185405b5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:18:11.169536 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-33362633-1c14-4eea-88e0-2f15b528f856 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:11.170195 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-33362633-1c14-4eea-88e0-2f15b528f856 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:11.175183 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1096/2206] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 5 12:18:10 2022] DELETE /identity/v3/projects/4f2dacf42b4c4a008f2aaa7185405b5f => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:18:11.175183 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33362633-1c14-4eea-88e0-2f15b528f856 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:11.175183 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-33362633-1c14-4eea-88e0-2f15b528f856 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:18:11.204334 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:18:11.238827 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2183e0a7-e3c0-46ec-bb36-5f2c4afb684b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:11.239883 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2183e0a7-e3c0-46ec-bb36-5f2c4afb684b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:11.240591 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2183e0a7-e3c0-46ec-bb36-5f2c4afb684b admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:11.240739 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2183e0a7-e3c0-46ec-bb36-5f2c4afb684b admin admin] PATH_INFO: `/v3/projects/f0af920fa61f43ee9245081bf48c4623` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:11.242965 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2183e0a7-e3c0-46ec-bb36-5f2c4afb684b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0af920fa61f43ee9245081bf48c4623)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:11.246557 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2183e0a7-e3c0-46ec-bb36-5f2c4afb684b admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:11.345996 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33362633-1c14-4eea-88e0-2f15b528f856 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:11.381917 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-2183e0a7-e3c0-46ec-bb36-5f2c4afb684b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0af920fa61f43ee9245081bf48c4623', 'request_id': 'req-2183e0a7-e3c0-46ec-bb36-5f2c4afb684b'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:11.385506 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:18:11.397737 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-2183e0a7-e3c0-46ec-bb36-5f2c4afb684b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0af920fa61f43ee9245081bf48c4623', 'request_id': 'req-2183e0a7-e3c0-46ec-bb36-5f2c4afb684b'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:11.406135 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-2183e0a7-e3c0-46ec-bb36-5f2c4afb684b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0af920fa61f43ee9245081bf48c4623', 'request_id': 'req-2183e0a7-e3c0-46ec-bb36-5f2c4afb684b'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:11.423008 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-2183e0a7-e3c0-46ec-bb36-5f2c4afb684b admin admin] The token cache is being invalidate because project f0af920fa61f43ee9245081bf48c4623 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:18:11.423821 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-2183e0a7-e3c0-46ec-bb36-5f2c4afb684b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:11.424762 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-2183e0a7-e3c0-46ec-bb36-5f2c4afb684b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:11.426653 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1111/2207] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 5 12:18:11 2022] DELETE /identity/v3/projects/f0af920fa61f43ee9245081bf48c4623 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:18:11.427818 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2183e0a7-e3c0-46ec-bb36-5f2c4afb684b admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:11.437568 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-2183e0a7-e3c0-46ec-bb36-5f2c4afb684b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:18:11.455159 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c36beb-1d77-4ce7-aefa-fdb975a74f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:11.455790 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c36beb-1d77-4ce7-aefa-fdb975a74f63 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:11.456214 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c36beb-1d77-4ce7-aefa-fdb975a74f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:11.456495 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c36beb-1d77-4ce7-aefa-fdb975a74f63 admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:11.457204 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c36beb-1d77-4ce7-aefa-fdb975a74f63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:11.462858 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c36beb-1d77-4ce7-aefa-fdb975a74f63 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:11.495868 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1097/2208] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 5 12:18:11 2022] POST /identity/v3/users => generated 288 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:18:11.496923 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c36beb-1d77-4ce7-aefa-fdb975a74f63 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:11.500932 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-74c36beb-1d77-4ce7-aefa-fdb975a74f63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:18:11.522617 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c36beb-1d77-4ce7-aefa-fdb975a74f63 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:11.531202 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a59dbfc-74a7-4afa-b481-89993d6a0e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:11.532743 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a59dbfc-74a7-4afa-b481-89993d6a0e5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:11.533300 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a59dbfc-74a7-4afa-b481-89993d6a0e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:11.533678 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a59dbfc-74a7-4afa-b481-89993d6a0e5e admin admin] PATH_INFO: `/v3/users/80cb6150305c4eb1bd08187187451d6e` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:11.536208 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a59dbfc-74a7-4afa-b481-89993d6a0e5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=80cb6150305c4eb1bd08187187451d6e)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:11.539449 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a59dbfc-74a7-4afa-b481-89993d6a0e5e admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:11.560681 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2183e0a7-e3c0-46ec-bb36-5f2c4afb684b admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:11.573405 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aee0297-1f6a-4dc2-9c09-d02b57c0d5a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:11.574190 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aee0297-1f6a-4dc2-9c09-d02b57c0d5a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:11.574661 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aee0297-1f6a-4dc2-9c09-d02b57c0d5a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:11.575021 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aee0297-1f6a-4dc2-9c09-d02b57c0d5a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:11.575770 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aee0297-1f6a-4dc2-9c09-d02b57c0d5a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:11.577546 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aee0297-1f6a-4dc2-9c09-d02b57c0d5a1 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:11.597299 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1112/2209] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:18:11 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:18:11.599435 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43afa75c-091f-42bc-b55a-7bdd10b0d136 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:11.600165 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43afa75c-091f-42bc-b55a-7bdd10b0d136 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:11.600276 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43afa75c-091f-42bc-b55a-7bdd10b0d136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:11.633424 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-43afa75c-091f-42bc-b55a-7bdd10b0d136 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:18:11.635971 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-43afa75c-091f-42bc-b55a-7bdd10b0d136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:18:11.642729 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-8a59dbfc-74a7-4afa-b481-89993d6a0e5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80cb6150305c4eb1bd08187187451d6e'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:11.653012 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-8a59dbfc-74a7-4afa-b481-89993d6a0e5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80cb6150305c4eb1bd08187187451d6e'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:11.667716 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1113/2210] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:18:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:18:11.668760 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43afa75c-091f-42bc-b55a-7bdd10b0d136 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:11.671674 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-43afa75c-091f-42bc-b55a-7bdd10b0d136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:18:11.676811 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-8a59dbfc-74a7-4afa-b481-89993d6a0e5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80cb6150305c4eb1bd08187187451d6e'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:11.681552 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-8a59dbfc-74a7-4afa-b481-89993d6a0e5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80cb6150305c4eb1bd08187187451d6e'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:11.689627 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43afa75c-091f-42bc-b55a-7bdd10b0d136 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:11.696616 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-8a59dbfc-74a7-4afa-b481-89993d6a0e5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80cb6150305c4eb1bd08187187451d6e'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:11.697709 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfd9d4c-2705-45f2-aaae-9e8ac3c04981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:11.699250 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfd9d4c-2705-45f2-aaae-9e8ac3c04981 admin admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:11.699774 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfd9d4c-2705-45f2-aaae-9e8ac3c04981 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:11.700229 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfd9d4c-2705-45f2-aaae-9e8ac3c04981 admin admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:11.701111 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfd9d4c-2705-45f2-aaae-9e8ac3c04981 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:11.703694 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfd9d4c-2705-45f2-aaae-9e8ac3c04981 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:11.719149 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1114/2211] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:18:11 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:18:11.720565 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfd9d4c-2705-45f2-aaae-9e8ac3c04981 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:11.723162 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-5dfd9d4c-2705-45f2-aaae-9e8ac3c04981 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:18:11.724330 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1098/2212] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 5 12:18:11 2022] DELETE /identity/v3/users/80cb6150305c4eb1bd08187187451d6e => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:18:11.725930 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675b41de-756c-40b3-a592-b527a48ae2e4 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:11.726227 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675b41de-756c-40b3-a592-b527a48ae2e4 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:11.726615 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675b41de-756c-40b3-a592-b527a48ae2e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:11.760097 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-675b41de-756c-40b3-a592-b527a48ae2e4 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:18:11.765610 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-675b41de-756c-40b3-a592-b527a48ae2e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:18:11.768783 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfd9d4c-2705-45f2-aaae-9e8ac3c04981 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:11.902124 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1099/2213] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:18:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:18:11.903204 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675b41de-756c-40b3-a592-b527a48ae2e4 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:11.909228 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-675b41de-756c-40b3-a592-b527a48ae2e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:18:11.928042 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873567b6-46d6-438c-a952-3e961af23e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:11.928720 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873567b6-46d6-438c-a952-3e961af23e92 admin admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:11.929028 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873567b6-46d6-438c-a952-3e961af23e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:11.929307 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873567b6-46d6-438c-a952-3e961af23e92 admin admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:11.930074 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873567b6-46d6-438c-a952-3e961af23e92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:11.931713 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873567b6-46d6-438c-a952-3e961af23e92 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:11.933482 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:18:11.934638 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675b41de-756c-40b3-a592-b527a48ae2e4 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:11.953131 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da61853-cec9-4eb5-aa54-65c3be59ab4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:11.953778 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da61853-cec9-4eb5-aa54-65c3be59ab4e admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:11.954058 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da61853-cec9-4eb5-aa54-65c3be59ab4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:11.954333 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da61853-cec9-4eb5-aa54-65c3be59ab4e admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:11.954999 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da61853-cec9-4eb5-aa54-65c3be59ab4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:11.955814 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1115/2214] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:18:11 2022] GET /identity/v3/roles => generated 1420 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:18:11.956719 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873567b6-46d6-438c-a952-3e961af23e92 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:11.958478 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da61853-cec9-4eb5-aa54-65c3be59ab4e admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:11.975178 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873567b6-46d6-438c-a952-3e961af23e92 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:11.976229 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1100/2215] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:18:11 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:18:11.977760 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da61853-cec9-4eb5-aa54-65c3be59ab4e admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:11.991817 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da61853-cec9-4eb5-aa54-65c3be59ab4e admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:11.997349 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46ca540-fd5f-4ae1-b8f4-bcf0faf8eb52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:11.997990 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46ca540-fd5f-4ae1-b8f4-bcf0faf8eb52 admin admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:11.998160 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094daf8b-838c-4e56-aaf6-a1087e309c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:11.998302 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46ca540-fd5f-4ae1-b8f4-bcf0faf8eb52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:11.998533 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46ca540-fd5f-4ae1-b8f4-bcf0faf8eb52 admin admin] PATH_INFO: `/v3/domains` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:11.998881 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094daf8b-838c-4e56-aaf6-a1087e309c4c admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:11.999287 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094daf8b-838c-4e56-aaf6-a1087e309c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:11.999401 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46ca540-fd5f-4ae1-b8f4-bcf0faf8eb52 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:18:11.999567 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094daf8b-838c-4e56-aaf6-a1087e309c4c admin admin] PATH_INFO: `/v3/projects/d1ce06c92fe84ec8ac07779224febf2f/users/2d65c328118c4909a33b33b678c5be63/roles/ed72181e1403401facb77dcf33644757` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:12.000204 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46ca540-fd5f-4ae1-b8f4-bcf0faf8eb52 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:12.002202 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46ca540-fd5f-4ae1-b8f4-bcf0faf8eb52 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:12.003171 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:18:12.026762 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094daf8b-838c-4e56-aaf6-a1087e309c4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1ce06c92fe84ec8ac07779224febf2f, user_id=2d65c328118c4909a33b33b678c5be63, role_id=ed72181e1403401facb77dcf33644757)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:12.032207 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094daf8b-838c-4e56-aaf6-a1087e309c4c admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:12.037879 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1116/2216] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Sep 5 12:18:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:18:12.039718 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46ca540-fd5f-4ae1-b8f4-bcf0faf8eb52 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:12.062435 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46ca540-fd5f-4ae1-b8f4-bcf0faf8eb52 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:12.078943 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1101/2217] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 5 12:18:11 2022] PUT /identity/v3/projects/d1ce06c92fe84ec8ac07779224febf2f/users/2d65c328118c4909a33b33b678c5be63/roles/ed72181e1403401facb77dcf33644757 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:18:12.080575 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094daf8b-838c-4e56-aaf6-a1087e309c4c admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:12.187693 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913c9c50-4acf-4b03-a349-084ba219cb15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:12.188393 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913c9c50-4acf-4b03-a349-084ba219cb15 admin admin] REQUEST_METHOD: `PUT` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:12.188678 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913c9c50-4acf-4b03-a349-084ba219cb15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:12.188979 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913c9c50-4acf-4b03-a349-084ba219cb15 admin admin] PATH_INFO: `/v3/projects/7b3ad16aa8eb47a39eb789304d154725/users/01143d10bf904d259a6c9bf5f46a5c82/roles/ed72181e1403401facb77dcf33644757` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:12.225788 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913c9c50-4acf-4b03-a349-084ba219cb15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b3ad16aa8eb47a39eb789304d154725, user_id=01143d10bf904d259a6c9bf5f46a5c82, role_id=ed72181e1403401facb77dcf33644757)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:12.228504 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913c9c50-4acf-4b03-a349-084ba219cb15 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:12.238303 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094daf8b-838c-4e56-aaf6-a1087e309c4c admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:12.249762 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fbcefe-8a87-4594-946a-7957e52558ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:12.250433 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fbcefe-8a87-4594-946a-7957e52558ab admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:12.252085 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fbcefe-8a87-4594-946a-7957e52558ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:12.252389 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fbcefe-8a87-4594-946a-7957e52558ab admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:12.255407 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fbcefe-8a87-4594-946a-7957e52558ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:12.258871 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fbcefe-8a87-4594-946a-7957e52558ab admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:12.272321 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1117/2218] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 5 12:18:12 2022] PUT /identity/v3/projects/7b3ad16aa8eb47a39eb789304d154725/users/01143d10bf904d259a6c9bf5f46a5c82/roles/ed72181e1403401facb77dcf33644757 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:18:12.272321 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9fa030-96ff-42fd-97bc-e3c94641db9c None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:12.272321 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9fa030-96ff-42fd-97bc-e3c94641db9c None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:12.272321 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9fa030-96ff-42fd-97bc-e3c94641db9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:12.336309 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1102/2219] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 5 12:18:12 2022] POST /identity/v3/projects => generated 389 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:18:12.338983 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362d80d6-0b15-458d-9681-9a10dfea3c47 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:12.339295 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362d80d6-0b15-458d-9681-9a10dfea3c47 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:12.346096 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362d80d6-0b15-458d-9681-9a10dfea3c47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:12.349415 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-af9fa030-96ff-42fd-97bc-e3c94641db9c None None] MFA Rules not processed for user `2d65c328118c4909a33b33b678c5be63`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:18:12.351934 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-af9fa030-96ff-42fd-97bc-e3c94641db9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:18:12.406694 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-362d80d6-0b15-458d-9681-9a10dfea3c47 None None] MFA Rules not processed for user `01143d10bf904d259a6c9bf5f46a5c82`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:18:12.407994 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-362d80d6-0b15-458d-9681-9a10dfea3c47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:18:12.519231 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1103/2220] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:18:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:18:12.521200 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362d80d6-0b15-458d-9681-9a10dfea3c47 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:12.555330 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1118/2221] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:18:12 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:18:12.555330 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9fa030-96ff-42fd-97bc-e3c94641db9c None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:12.555330 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-af9fa030-96ff-42fd-97bc-e3c94641db9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:18:12.650016 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:18:12.665801 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9fa030-96ff-42fd-97bc-e3c94641db9c None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:12.679469 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed1496f-0fc1-4318-8afe-ad87c973cd02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:12.680505 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed1496f-0fc1-4318-8afe-ad87c973cd02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:12.681033 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed1496f-0fc1-4318-8afe-ad87c973cd02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:12.681532 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed1496f-0fc1-4318-8afe-ad87c973cd02 admin admin] PATH_INFO: `/v3/projects/406a40cbcd3f4884abb587bf286cd412` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:12.683663 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed1496f-0fc1-4318-8afe-ad87c973cd02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=406a40cbcd3f4884abb587bf286cd412)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:12.689298 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed1496f-0fc1-4318-8afe-ad87c973cd02 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:12.694871 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362d80d6-0b15-458d-9681-9a10dfea3c47 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:12.714637 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2065dd5-34dd-45e9-a6a6-c8a56681b68b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:12.715397 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2065dd5-34dd-45e9-a6a6-c8a56681b68b admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:12.715680 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2065dd5-34dd-45e9-a6a6-c8a56681b68b admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:12.715960 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2065dd5-34dd-45e9-a6a6-c8a56681b68b admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:12.718187 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2065dd5-34dd-45e9-a6a6-c8a56681b68b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:12.721973 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2065dd5-34dd-45e9-a6a6-c8a56681b68b admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:12.732830 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:18:12.772813 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1104/2222] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 5 12:18:12 2022] POST /identity/v3/users => generated 295 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:18:12.777785 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2065dd5-34dd-45e9-a6a6-c8a56681b68b admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:12.782127 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-d2065dd5-34dd-45e9-a6a6-c8a56681b68b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:18:12.797401 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-eed1496f-0fc1-4318-8afe-ad87c973cd02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '406a40cbcd3f4884abb587bf286cd412', 'request_id': 'req-eed1496f-0fc1-4318-8afe-ad87c973cd02'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:12.822242 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-eed1496f-0fc1-4318-8afe-ad87c973cd02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '406a40cbcd3f4884abb587bf286cd412', 'request_id': 'req-eed1496f-0fc1-4318-8afe-ad87c973cd02'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:12.831264 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-eed1496f-0fc1-4318-8afe-ad87c973cd02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '406a40cbcd3f4884abb587bf286cd412', 'request_id': 'req-eed1496f-0fc1-4318-8afe-ad87c973cd02'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:12.852137 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-eed1496f-0fc1-4318-8afe-ad87c973cd02 admin admin] The token cache is being invalidate because project 406a40cbcd3f4884abb587bf286cd412 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:18:12.852624 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-eed1496f-0fc1-4318-8afe-ad87c973cd02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:12.853506 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-eed1496f-0fc1-4318-8afe-ad87c973cd02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:12.856402 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1119/2223] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 5 12:18:12 2022] DELETE /identity/v3/projects/406a40cbcd3f4884abb587bf286cd412 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:18:12.857893 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed1496f-0fc1-4318-8afe-ad87c973cd02 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:12.859710 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-eed1496f-0fc1-4318-8afe-ad87c973cd02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:18:12.901813 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2065dd5-34dd-45e9-a6a6-c8a56681b68b admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:13.015861 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed1496f-0fc1-4318-8afe-ad87c973cd02 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:13.022584 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caf3206-7689-4eae-843f-f522e92b3cef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37633bbae0c2423c81ccd61ac3a17ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:13.023844 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caf3206-7689-4eae-843f-f522e92b3cef service cinder] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:13.023844 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caf3206-7689-4eae-843f-f522e92b3cef service cinder] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:13.024066 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caf3206-7689-4eae-843f-f522e92b3cef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:13.026511 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-0caf3206-7689-4eae-843f-f522e92b3cef service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:18:13.057975 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1387f7-cd02-4211-bd93-5f3789114f4f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b08e831af84a658b0f5b28ad03e4f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:13.059233 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1387f7-cd02-4211-bd93-5f3789114f4f service glance] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:13.059715 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1387f7-cd02-4211-bd93-5f3789114f4f service glance] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:13.060289 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1387f7-cd02-4211-bd93-5f3789114f4f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:13.063533 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-1e1387f7-cd02-4211-bd93-5f3789114f4f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:18:13.177819 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caf3206-7689-4eae-843f-f522e92b3cef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:13.179517 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caf3206-7689-4eae-843f-f522e92b3cef service cinder] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:13.190852 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1120/2224] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:18:12 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:18:13.191696 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caf3206-7689-4eae-843f-f522e92b3cef service cinder] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:13.196679 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-0caf3206-7689-4eae-843f-f522e92b3cef service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:18:13.271237 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1387f7-cd02-4211-bd93-5f3789114f4f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:13.273225 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1387f7-cd02-4211-bd93-5f3789114f4f service glance] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:13.296489 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:18:13.307347 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1105/2225] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:18:12 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 530 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:18:13.310444 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b0bd19-e2e8-44bc-a270-0fb9df59e6b1 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:13.316641 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b0bd19-e2e8-44bc-a270-0fb9df59e6b1 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:13.316991 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b0bd19-e2e8-44bc-a270-0fb9df59e6b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:13.373278 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-53b0bd19-e2e8-44bc-a270-0fb9df59e6b1 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:18:13.374526 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-53b0bd19-e2e8-44bc-a270-0fb9df59e6b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:18:13.383826 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caf3206-7689-4eae-843f-f522e92b3cef service cinder] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:13.399721 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1106/2226] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:18:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:18:13.406961 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24d8b9a-1fe9-46dc-bc7d-6c9251299e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:13.406961 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24d8b9a-1fe9-46dc-bc7d-6c9251299e72 admin admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:13.407360 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24d8b9a-1fe9-46dc-bc7d-6c9251299e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:13.407711 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc8359d-57b4-4f8d-b124-23b31925ad36 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:13.407827 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24d8b9a-1fe9-46dc-bc7d-6c9251299e72 admin admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:13.408002 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc8359d-57b4-4f8d-b124-23b31925ad36 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:13.408280 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc8359d-57b4-4f8d-b124-23b31925ad36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:13.409523 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24d8b9a-1fe9-46dc-bc7d-6c9251299e72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:13.411967 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24d8b9a-1fe9-46dc-bc7d-6c9251299e72 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:13.429509 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1121/2227] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:18:13 2022] GET /identity/v3/roles => generated 1420 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:18:13.434048 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24d8b9a-1fe9-46dc-bc7d-6c9251299e72 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:13.450720 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-8cc8359d-57b4-4f8d-b124-23b31925ad36 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:18:13.451822 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-8cc8359d-57b4-4f8d-b124-23b31925ad36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:18:13.470065 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24d8b9a-1fe9-46dc-bc7d-6c9251299e72 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:13.476558 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1107/2228] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:18:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 12:18:13.486012 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b3d8fd-5604-46ea-96ec-1f6f1ff211be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:13.486789 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b3d8fd-5604-46ea-96ec-1f6f1ff211be admin admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:13.488230 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc8359d-57b4-4f8d-b124-23b31925ad36 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:13.488742 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b3d8fd-5604-46ea-96ec-1f6f1ff211be admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:13.489351 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b3d8fd-5604-46ea-96ec-1f6f1ff211be admin admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:13.489747 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b3d8fd-5604-46ea-96ec-1f6f1ff211be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:13.492438 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b3d8fd-5604-46ea-96ec-1f6f1ff211be admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:13.522418 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc8359d-57b4-4f8d-b124-23b31925ad36 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:13.534974 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1122/2229] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:18:13 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 12:18:13.536458 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b3d8fd-5604-46ea-96ec-1f6f1ff211be admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:13.541464 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4742063e-2105-4eba-8777-a37b4c967f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:13.543230 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4742063e-2105-4eba-8777-a37b4c967f24 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:13.543664 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4742063e-2105-4eba-8777-a37b4c967f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:13.546663 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4742063e-2105-4eba-8777-a37b4c967f24 admin admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:13.547656 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4742063e-2105-4eba-8777-a37b4c967f24 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:18:13.548116 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4742063e-2105-4eba-8777-a37b4c967f24 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:13.550094 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4742063e-2105-4eba-8777-a37b4c967f24 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:13.576137 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b3d8fd-5604-46ea-96ec-1f6f1ff211be admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:13.578370 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1108/2230] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Sep 5 12:18:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:18:13.583532 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4742063e-2105-4eba-8777-a37b4c967f24 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:13.593342 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df73fce8-cc99-4532-aac5-cbd759dc33a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:13.595096 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df73fce8-cc99-4532-aac5-cbd759dc33a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:13.597861 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df73fce8-cc99-4532-aac5-cbd759dc33a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:13.599955 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df73fce8-cc99-4532-aac5-cbd759dc33a5 admin admin] PATH_INFO: `/v3/projects/7fdfe7dc0efc4ff4abd8fcdff51f2eae/users/09f4ccac184d43b7a519471316dd28b3/roles/ed72181e1403401facb77dcf33644757` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:13.610770 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4742063e-2105-4eba-8777-a37b4c967f24 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:13.622659 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dd7d86-08f0-44ae-81a2-4bf764ada1ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:13.624801 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dd7d86-08f0-44ae-81a2-4bf764ada1ee admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:13.626877 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dd7d86-08f0-44ae-81a2-4bf764ada1ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:13.628809 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dd7d86-08f0-44ae-81a2-4bf764ada1ee admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:13.629703 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dd7d86-08f0-44ae-81a2-4bf764ada1ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:13.637237 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dd7d86-08f0-44ae-81a2-4bf764ada1ee admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:13.643389 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df73fce8-cc99-4532-aac5-cbd759dc33a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fdfe7dc0efc4ff4abd8fcdff51f2eae, user_id=09f4ccac184d43b7a519471316dd28b3, role_id=ed72181e1403401facb77dcf33644757)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:13.647882 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df73fce8-cc99-4532-aac5-cbd759dc33a5 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:13.672090 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1123/2231] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 5 12:18:13 2022] PUT /identity/v3/projects/7fdfe7dc0efc4ff4abd8fcdff51f2eae/users/09f4ccac184d43b7a519471316dd28b3/roles/ed72181e1403401facb77dcf33644757 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:18:13.684344 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746d3df6-ba0b-4b39-8f66-47ff4ec532fc None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:13.684883 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746d3df6-ba0b-4b39-8f66-47ff4ec532fc None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:13.685452 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746d3df6-ba0b-4b39-8f66-47ff4ec532fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:13.724163 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1109/2232] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 5 12:18:13 2022] POST /identity/v3/projects => generated 367 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:18:13.735751 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dd7d86-08f0-44ae-81a2-4bf764ada1ee admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:13.744647 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-746d3df6-ba0b-4b39-8f66-47ff4ec532fc None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:18:13.751466 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-746d3df6-ba0b-4b39-8f66-47ff4ec532fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:18:13.789187 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:18:13.966321 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1124/2233] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:18:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:18:13.972960 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746d3df6-ba0b-4b39-8f66-47ff4ec532fc None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:13.983702 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-746d3df6-ba0b-4b39-8f66-47ff4ec532fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:18:13.995829 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dd7d86-08f0-44ae-81a2-4bf764ada1ee admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:14.009991 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1b0019-361e-48c5-849b-784b3772c501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:14.011054 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1b0019-361e-48c5-849b-784b3772c501 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:14.011428 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1b0019-361e-48c5-849b-784b3772c501 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:14.011756 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1b0019-361e-48c5-849b-784b3772c501 admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:14.014942 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1b0019-361e-48c5-849b-784b3772c501 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:14.019299 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1b0019-361e-48c5-849b-784b3772c501 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:14.064074 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1110/2234] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 5 12:18:13 2022] POST /identity/v3/users => generated 284 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:18:14.069911 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1b0019-361e-48c5-849b-784b3772c501 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:14.086956 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1b0019-361e-48c5-849b-784b3772c501 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:14.101289 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6045d95c-879b-40f8-aa21-66143e2fee7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:14.103519 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6045d95c-879b-40f8-aa21-66143e2fee7e admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:14.104115 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6045d95c-879b-40f8-aa21-66143e2fee7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:14.105321 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6045d95c-879b-40f8-aa21-66143e2fee7e admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:14.106014 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6045d95c-879b-40f8-aa21-66143e2fee7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:14.109417 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6045d95c-879b-40f8-aa21-66143e2fee7e admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:14.138057 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1111/2235] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:18:14 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:18:14.143838 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6045d95c-879b-40f8-aa21-66143e2fee7e admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:14.154943 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746d3df6-ba0b-4b39-8f66-47ff4ec532fc None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:14.163551 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dd8811-a85e-4cb5-9901-35c0e02d1d83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4994b4faa4ec4aa088f3dc32c9c5614d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:14.164417 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dd8811-a85e-4cb5-9901-35c0e02d1d83 service neutron] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:14.164666 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dd8811-a85e-4cb5-9901-35c0e02d1d83 service neutron] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:14.165803 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dd8811-a85e-4cb5-9901-35c0e02d1d83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:14.167577 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6045d95c-879b-40f8-aa21-66143e2fee7e admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:14.181767 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7de065-e801-45c2-b6eb-5191d4e79a83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:14.182597 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7de065-e801-45c2-b6eb-5191d4e79a83 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:14.182961 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7de065-e801-45c2-b6eb-5191d4e79a83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:14.183239 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7de065-e801-45c2-b6eb-5191d4e79a83 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:14.184065 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7de065-e801-45c2-b6eb-5191d4e79a83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:14.185590 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7de065-e801-45c2-b6eb-5191d4e79a83 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:14.207131 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dd8811-a85e-4cb5-9901-35c0e02d1d83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:14.213242 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1112/2236] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:18:14 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:18:14.218179 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dd8811-a85e-4cb5-9901-35c0e02d1d83 service neutron] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:14.218406 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7de065-e801-45c2-b6eb-5191d4e79a83 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:14.231890 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7de065-e801-45c2-b6eb-5191d4e79a83 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:14.237786 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b605649-8e92-46d7-8a9b-d6f7af30f84f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:14.239381 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b605649-8e92-46d7-8a9b-d6f7af30f84f admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:14.240151 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b605649-8e92-46d7-8a9b-d6f7af30f84f admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:14.240673 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b605649-8e92-46d7-8a9b-d6f7af30f84f admin admin] PATH_INFO: `/v3/projects/adca5e76f1e343229393c744dca6acc4/users/4b109f814c2241da8848bf3ecbc2c206/roles/ed72181e1403401facb77dcf33644757` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:14.254329 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1125/2237] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:18:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:18:14.272411 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b605649-8e92-46d7-8a9b-d6f7af30f84f admin admin] RBAC: Authorizing `identity:create_grant(project_id=adca5e76f1e343229393c744dca6acc4, user_id=4b109f814c2241da8848bf3ecbc2c206, role_id=ed72181e1403401facb77dcf33644757)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:14.286869 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b605649-8e92-46d7-8a9b-d6f7af30f84f admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:14.318141 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1113/2238] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 5 12:18:14 2022] PUT /identity/v3/projects/adca5e76f1e343229393c744dca6acc4/users/4b109f814c2241da8848bf3ecbc2c206/roles/ed72181e1403401facb77dcf33644757 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 12:18:14.330389 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83246b43-e52c-4ce8-b91c-e4dec34149f0 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:14.330968 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83246b43-e52c-4ce8-b91c-e4dec34149f0 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:14.331470 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83246b43-e52c-4ce8-b91c-e4dec34149f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:14.413059 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-83246b43-e52c-4ce8-b91c-e4dec34149f0 None None] MFA Rules not processed for user `4b109f814c2241da8848bf3ecbc2c206`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:18:14.414677 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-83246b43-e52c-4ce8-b91c-e4dec34149f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:18:14.555223 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:18:14.622750 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1126/2239] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:18:14 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:18:14.636297 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b605649-8e92-46d7-8a9b-d6f7af30f84f admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:14.638178 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-9b605649-8e92-46d7-8a9b-d6f7af30f84f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:18:14.754690 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b605649-8e92-46d7-8a9b-d6f7af30f84f admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:14.762323 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77acc52e-6add-46b1-a6d0-11ac56c4e288 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b08e831af84a658b0f5b28ad03e4f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:14.763214 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77acc52e-6add-46b1-a6d0-11ac56c4e288 service glance] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:14.763646 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77acc52e-6add-46b1-a6d0-11ac56c4e288 service glance] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:14.764021 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77acc52e-6add-46b1-a6d0-11ac56c4e288 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:14.781161 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77acc52e-6add-46b1-a6d0-11ac56c4e288 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:14.784119 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77acc52e-6add-46b1-a6d0-11ac56c4e288 service glance] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:14.847971 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1114/2240] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:18:14 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:18:17.679909 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cdb938-3690-4e48-b7d5-092bcf44c495 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:17.679909 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cdb938-3690-4e48-b7d5-092bcf44c495 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:17.680392 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cdb938-3690-4e48-b7d5-092bcf44c495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:17.725288 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-77cdb938-3690-4e48-b7d5-092bcf44c495 None None] MFA Rules not processed for user `3647bfeea3344a80a9bb0a3ede380373`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:18:17.726525 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-77cdb938-3690-4e48-b7d5-092bcf44c495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:18:17.981645 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1127/2241] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:18:17 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:18:17.999363 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77acc52e-6add-46b1-a6d0-11ac56c4e288 service glance] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:18.000946 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-77acc52e-6add-46b1-a6d0-11ac56c4e288 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:18:18.140793 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:18:18.186681 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77acc52e-6add-46b1-a6d0-11ac56c4e288 service glance] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:18.195293 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6617e21d-771e-45f1-a4f5-4aa7cd93000c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb060ff495bc4abb83ff88992fb7be09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:18.196485 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6617e21d-771e-45f1-a4f5-4aa7cd93000c service nova] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:18.196977 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6617e21d-771e-45f1-a4f5-4aa7cd93000c service nova] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:18.197533 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6617e21d-771e-45f1-a4f5-4aa7cd93000c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:18.201051 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-6617e21d-771e-45f1-a4f5-4aa7cd93000c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:18:18.294521 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6617e21d-771e-45f1-a4f5-4aa7cd93000c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:18.296764 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6617e21d-771e-45f1-a4f5-4aa7cd93000c service nova] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:18.315018 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1115/2242] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:18:17 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:18:20.503113 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cdb938-3690-4e48-b7d5-092bcf44c495 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:20.506035 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-77cdb938-3690-4e48-b7d5-092bcf44c495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:18:20.650363 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b8fe9-dfee-4cd8-bba5-bbabaf31b1ab None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:20.650901 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b8fe9-dfee-4cd8-bba5-bbabaf31b1ab None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:20.650901 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b8fe9-dfee-4cd8-bba5-bbabaf31b1ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:20.688629 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-2d2b8fe9-dfee-4cd8-bba5-bbabaf31b1ab None None] MFA Rules not processed for user `ab3a4519819e46ba945398957780f956`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:18:20.691404 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-2d2b8fe9-dfee-4cd8-bba5-bbabaf31b1ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:18:20.696094 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cdb938-3690-4e48-b7d5-092bcf44c495 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:20.702310 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1116/2243] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:18:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 12:18:20.710004 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4898169e-4ed4-4c5b-9d73-0643e55acbb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:20.714285 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4898169e-4ed4-4c5b-9d73-0643e55acbb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:20.715254 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4898169e-4ed4-4c5b-9d73-0643e55acbb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:20.715664 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4898169e-4ed4-4c5b-9d73-0643e55acbb0 admin admin] PATH_INFO: `/v3/users/2d65c328118c4909a33b33b678c5be63` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:20.718358 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4898169e-4ed4-4c5b-9d73-0643e55acbb0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d65c328118c4909a33b33b678c5be63)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:20.722521 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4898169e-4ed4-4c5b-9d73-0643e55acbb0 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:20.849090 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-4898169e-4ed4-4c5b-9d73-0643e55acbb0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d65c328118c4909a33b33b678c5be63'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:20.850858 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-4898169e-4ed4-4c5b-9d73-0643e55acbb0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d65c328118c4909a33b33b678c5be63'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:20.866851 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-4898169e-4ed4-4c5b-9d73-0643e55acbb0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d65c328118c4909a33b33b678c5be63'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:20.867734 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-4898169e-4ed4-4c5b-9d73-0643e55acbb0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d65c328118c4909a33b33b678c5be63'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:20.896507 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:18:20.915491 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-4898169e-4ed4-4c5b-9d73-0643e55acbb0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d65c328118c4909a33b33b678c5be63'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:20.935003 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1128/2244] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 5 12:18:20 2022] DELETE /identity/v3/users/2d65c328118c4909a33b33b678c5be63 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:18:20.936254 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132492d8-0f93-4706-82d2-7b07bc815271 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:20.936741 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132492d8-0f93-4706-82d2-7b07bc815271 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:20.937045 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132492d8-0f93-4706-82d2-7b07bc815271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:20.962971 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-132492d8-0f93-4706-82d2-7b07bc815271 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:18:20.971531 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-132492d8-0f93-4706-82d2-7b07bc815271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:18:21.062751 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1117/2245] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:18:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:18:21.081493 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4898169e-4ed4-4c5b-9d73-0643e55acbb0 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:21.083538 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-4898169e-4ed4-4c5b-9d73-0643e55acbb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:18:21.136227 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132492d8-0f93-4706-82d2-7b07bc815271 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:21.138234 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-132492d8-0f93-4706-82d2-7b07bc815271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:18:21.163756 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132492d8-0f93-4706-82d2-7b07bc815271 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:21.175502 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcc44a5-cd8c-4fef-bba7-ae11f18c7766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:21.177178 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcc44a5-cd8c-4fef-bba7-ae11f18c7766 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:21.179094 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4898169e-4ed4-4c5b-9d73-0643e55acbb0 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:21.179625 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcc44a5-cd8c-4fef-bba7-ae11f18c7766 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:21.179959 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcc44a5-cd8c-4fef-bba7-ae11f18c7766 admin admin] PATH_INFO: `/v3/users/45ecf27899e84968be1683fa3abaa991` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:21.184305 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcc44a5-cd8c-4fef-bba7-ae11f18c7766 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45ecf27899e84968be1683fa3abaa991)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:21.190702 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcc44a5-cd8c-4fef-bba7-ae11f18c7766 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:21.200751 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b198c1-3115-4d02-a0b9-013ff4a6c280 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4994b4faa4ec4aa088f3dc32c9c5614d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:21.200751 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b198c1-3115-4d02-a0b9-013ff4a6c280 service neutron] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:21.204031 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b198c1-3115-4d02-a0b9-013ff4a6c280 service neutron] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:21.204031 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b198c1-3115-4d02-a0b9-013ff4a6c280 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:21.219914 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b198c1-3115-4d02-a0b9-013ff4a6c280 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:21.224670 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b198c1-3115-4d02-a0b9-013ff4a6c280 service neutron] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:21.245471 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1129/2246] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:18:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:18:21.315598 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-3bcc44a5-cd8c-4fef-bba7-ae11f18c7766 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45ecf27899e84968be1683fa3abaa991'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:21.316346 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-3bcc44a5-cd8c-4fef-bba7-ae11f18c7766 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45ecf27899e84968be1683fa3abaa991'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:21.361324 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-3bcc44a5-cd8c-4fef-bba7-ae11f18c7766 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45ecf27899e84968be1683fa3abaa991'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:21.362806 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-3bcc44a5-cd8c-4fef-bba7-ae11f18c7766 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45ecf27899e84968be1683fa3abaa991'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:21.392634 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-3bcc44a5-cd8c-4fef-bba7-ae11f18c7766 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45ecf27899e84968be1683fa3abaa991'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:21.420651 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:18:21.431197 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1118/2247] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 5 12:18:21 2022] DELETE /identity/v3/users/45ecf27899e84968be1683fa3abaa991 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:18:21.433524 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39223099-ed63-48c5-86c0-0d661708398a None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:21.434070 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39223099-ed63-48c5-86c0-0d661708398a None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:21.434443 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39223099-ed63-48c5-86c0-0d661708398a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:21.486685 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-39223099-ed63-48c5-86c0-0d661708398a None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:18:21.487837 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-39223099-ed63-48c5-86c0-0d661708398a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:18:21.720729 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1130/2248] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:18:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:18:21.748927 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcc44a5-cd8c-4fef-bba7-ae11f18c7766 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:21.751121 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-3bcc44a5-cd8c-4fef-bba7-ae11f18c7766 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:18:21.866797 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39223099-ed63-48c5-86c0-0d661708398a None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:21.868420 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-39223099-ed63-48c5-86c0-0d661708398a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:18:21.891947 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39223099-ed63-48c5-86c0-0d661708398a None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:21.913753 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e3b53b-2f6d-4e2e-a27b-82f016bf5fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:21.914656 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e3b53b-2f6d-4e2e-a27b-82f016bf5fe9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:21.915087 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e3b53b-2f6d-4e2e-a27b-82f016bf5fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:21.915437 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e3b53b-2f6d-4e2e-a27b-82f016bf5fe9 admin admin] PATH_INFO: `/v3/projects/d1ce06c92fe84ec8ac07779224febf2f` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:21.916843 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e3b53b-2f6d-4e2e-a27b-82f016bf5fe9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1ce06c92fe84ec8ac07779224febf2f)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:21.918847 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcc44a5-cd8c-4fef-bba7-ae11f18c7766 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:21.918989 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e3b53b-2f6d-4e2e-a27b-82f016bf5fe9 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:21.935398 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36aa7e8-86ae-4747-8198-ff128631604a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4994b4faa4ec4aa088f3dc32c9c5614d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:21.936509 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36aa7e8-86ae-4747-8198-ff128631604a service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:21.937100 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36aa7e8-86ae-4747-8198-ff128631604a service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:21.937737 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36aa7e8-86ae-4747-8198-ff128631604a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:21.954909 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36aa7e8-86ae-4747-8198-ff128631604a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:21.957119 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36aa7e8-86ae-4747-8198-ff128631604a service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:21.979022 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1119/2249] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:18:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:18:22.007639 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-a8e3b53b-2f6d-4e2e-a27b-82f016bf5fe9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1ce06c92fe84ec8ac07779224febf2f', 'request_id': 'req-a8e3b53b-2f6d-4e2e-a27b-82f016bf5fe9'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:22.026226 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-a8e3b53b-2f6d-4e2e-a27b-82f016bf5fe9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1ce06c92fe84ec8ac07779224febf2f', 'request_id': 'req-a8e3b53b-2f6d-4e2e-a27b-82f016bf5fe9'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:22.066436 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-a8e3b53b-2f6d-4e2e-a27b-82f016bf5fe9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1ce06c92fe84ec8ac07779224febf2f', 'request_id': 'req-a8e3b53b-2f6d-4e2e-a27b-82f016bf5fe9'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:22.086776 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-a8e3b53b-2f6d-4e2e-a27b-82f016bf5fe9 admin admin] The token cache is being invalidate because project d1ce06c92fe84ec8ac07779224febf2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:18:22.087014 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-a8e3b53b-2f6d-4e2e-a27b-82f016bf5fe9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:22.088422 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-a8e3b53b-2f6d-4e2e-a27b-82f016bf5fe9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:22.090920 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1131/2250] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 5 12:18:21 2022] DELETE /identity/v3/projects/d1ce06c92fe84ec8ac07779224febf2f => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:18:22.096617 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77595d17-bf63-4ce1-99e4-4bce2332eac1 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:22.097282 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77595d17-bf63-4ce1-99e4-4bce2332eac1 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:22.097774 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77595d17-bf63-4ce1-99e4-4bce2332eac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:22.161122 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-77595d17-bf63-4ce1-99e4-4bce2332eac1 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:18:22.163252 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-77595d17-bf63-4ce1-99e4-4bce2332eac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:18:22.295373 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1120/2251] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:18:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:18:22.296577 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e351112c-2567-4b25-a37c-0804d27aae38 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:22.296869 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e351112c-2567-4b25-a37c-0804d27aae38 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:22.297192 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e351112c-2567-4b25-a37c-0804d27aae38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:22.314229 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:18:22.343249 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-e351112c-2567-4b25-a37c-0804d27aae38 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:18:22.344532 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-e351112c-2567-4b25-a37c-0804d27aae38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:18:22.363491 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1132/2252] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:18:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 12:18:22.368221 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77595d17-bf63-4ce1-99e4-4bce2332eac1 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:22.388717 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77595d17-bf63-4ce1-99e4-4bce2332eac1 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:22.405622 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0056de9-881c-48a9-8e00-def6c1298152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:22.406255 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0056de9-881c-48a9-8e00-def6c1298152 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:22.406590 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0056de9-881c-48a9-8e00-def6c1298152 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:22.406801 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0056de9-881c-48a9-8e00-def6c1298152 admin admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:22.422471 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0056de9-881c-48a9-8e00-def6c1298152 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:18:22.422733 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0056de9-881c-48a9-8e00-def6c1298152 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:22.424803 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0056de9-881c-48a9-8e00-def6c1298152 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:22.465344 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e351112c-2567-4b25-a37c-0804d27aae38 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:22.465576 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1121/2253] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Sep 5 12:18:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:18:22.486650 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e351112c-2567-4b25-a37c-0804d27aae38 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:22.509256 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7005fbe6-19db-4cfd-8e09-084c472cacab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:22.509901 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7005fbe6-19db-4cfd-8e09-084c472cacab admin admin] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:22.510229 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7005fbe6-19db-4cfd-8e09-084c472cacab admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:22.510507 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7005fbe6-19db-4cfd-8e09-084c472cacab admin admin] PATH_INFO: `/v3/projects` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:22.511166 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7005fbe6-19db-4cfd-8e09-084c472cacab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:22.521905 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7005fbe6-19db-4cfd-8e09-084c472cacab admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:22.583660 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1133/2254] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 5 12:18:22 2022] POST /identity/v3/projects => generated 371 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:18:22.587621 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0056de9-881c-48a9-8e00-def6c1298152 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:22.603543 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7005fbe6-19db-4cfd-8e09-084c472cacab admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:22.606021 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0056de9-881c-48a9-8e00-def6c1298152 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:22.611394 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-7005fbe6-19db-4cfd-8e09-084c472cacab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:18:22.746256 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cec84c-7025-4a77-8787-4af3190889b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:22.746903 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cec84c-7025-4a77-8787-4af3190889b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:22.747255 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cec84c-7025-4a77-8787-4af3190889b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:22.747597 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cec84c-7025-4a77-8787-4af3190889b2 admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:22.748311 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cec84c-7025-4a77-8787-4af3190889b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:22.754857 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cec84c-7025-4a77-8787-4af3190889b2 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:22.807852 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7005fbe6-19db-4cfd-8e09-084c472cacab admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:22.812083 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1122/2255] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 5 12:18:22 2022] POST /identity/v3/users => generated 286 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:18:22.813241 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cec84c-7025-4a77-8787-4af3190889b2 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:22.816860 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadde823-cc8d-4778-9b3b-fe4fff6f642c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:22.817649 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadde823-cc8d-4778-9b3b-fe4fff6f642c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:22.817918 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadde823-cc8d-4778-9b3b-fe4fff6f642c admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:22.818341 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadde823-cc8d-4778-9b3b-fe4fff6f642c admin admin] PATH_INFO: `/v3/projects/8e8fd40c5e54486297b6c1dcc0f34ffe` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:22.819832 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadde823-cc8d-4778-9b3b-fe4fff6f642c admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e8fd40c5e54486297b6c1dcc0f34ffe)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:22.829024 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadde823-cc8d-4778-9b3b-fe4fff6f642c admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:22.849611 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cec84c-7025-4a77-8787-4af3190889b2 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:22.863669 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae32894-ca33-42d8-b00a-716d99b1278b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:22.864319 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae32894-ca33-42d8-b00a-716d99b1278b admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:22.864596 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae32894-ca33-42d8-b00a-716d99b1278b admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:22.864871 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae32894-ca33-42d8-b00a-716d99b1278b admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:22.865903 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae32894-ca33-42d8-b00a-716d99b1278b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:22.867846 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae32894-ca33-42d8-b00a-716d99b1278b admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:22.901658 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1123/2256] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:18:22 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:18:22.903208 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f694aff5-189b-4e02-8a96-19faf0193b56 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:22.903500 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f694aff5-189b-4e02-8a96-19faf0193b56 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:22.903774 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f694aff5-189b-4e02-8a96-19faf0193b56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:22.920337 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-eadde823-cc8d-4778-9b3b-fe4fff6f642c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e8fd40c5e54486297b6c1dcc0f34ffe', 'request_id': 'req-eadde823-cc8d-4778-9b3b-fe4fff6f642c'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:22.927048 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:18:22.943450 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-eadde823-cc8d-4778-9b3b-fe4fff6f642c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e8fd40c5e54486297b6c1dcc0f34ffe', 'request_id': 'req-eadde823-cc8d-4778-9b3b-fe4fff6f642c'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:22.943950 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-f694aff5-189b-4e02-8a96-19faf0193b56 None None] MFA Rules not processed for user `09f4ccac184d43b7a519471316dd28b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:18:22.946677 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-f694aff5-189b-4e02-8a96-19faf0193b56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:18:22.958821 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-eadde823-cc8d-4778-9b3b-fe4fff6f642c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e8fd40c5e54486297b6c1dcc0f34ffe', 'request_id': 'req-eadde823-cc8d-4778-9b3b-fe4fff6f642c'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:22.981110 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-eadde823-cc8d-4778-9b3b-fe4fff6f642c admin admin] The token cache is being invalidate because project 8e8fd40c5e54486297b6c1dcc0f34ffe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:18:22.986195 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-eadde823-cc8d-4778-9b3b-fe4fff6f642c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:22.987136 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-eadde823-cc8d-4778-9b3b-fe4fff6f642c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:22.993082 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1134/2257] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 5 12:18:22 2022] DELETE /identity/v3/projects/8e8fd40c5e54486297b6c1dcc0f34ffe => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:18:22.994738 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadde823-cc8d-4778-9b3b-fe4fff6f642c admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:22.996370 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-eadde823-cc8d-4778-9b3b-fe4fff6f642c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:18:23.093594 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1124/2258] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:18:22 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:18:23.094580 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576d9d2c-51ae-489f-9b93-1ed090f33bc6 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:23.094866 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576d9d2c-51ae-489f-9b93-1ed090f33bc6 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:23.095180 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576d9d2c-51ae-489f-9b93-1ed090f33bc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:23.130391 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadde823-cc8d-4778-9b3b-fe4fff6f642c admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:23.132315 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-576d9d2c-51ae-489f-9b93-1ed090f33bc6 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:18:23.133835 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-576d9d2c-51ae-489f-9b93-1ed090f33bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:18:23.147356 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1125/2259] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:18:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:18:23.148838 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbd111f-2874-4608-9c8b-178407dc5107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:23.149487 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbd111f-2874-4608-9c8b-178407dc5107 admin admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:23.149745 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576d9d2c-51ae-489f-9b93-1ed090f33bc6 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:23.149853 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbd111f-2874-4608-9c8b-178407dc5107 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:23.150074 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbd111f-2874-4608-9c8b-178407dc5107 admin admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:23.150758 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbd111f-2874-4608-9c8b-178407dc5107 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:23.152718 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-576d9d2c-51ae-489f-9b93-1ed090f33bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:18:23.153333 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbd111f-2874-4608-9c8b-178407dc5107 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:23.185374 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1135/2260] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:18:22 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:18:23.185374 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356147f1-3b96-4e2a-8b36-0362f61c1fa2 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:23.185374 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356147f1-3b96-4e2a-8b36-0362f61c1fa2 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:23.186383 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356147f1-3b96-4e2a-8b36-0362f61c1fa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:23.196199 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:18:23.216055 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-356147f1-3b96-4e2a-8b36-0362f61c1fa2 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:18:23.219207 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-356147f1-3b96-4e2a-8b36-0362f61c1fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:18:23.250719 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1136/2261] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:18:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:18:23.250719 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356147f1-3b96-4e2a-8b36-0362f61c1fa2 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:23.279659 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356147f1-3b96-4e2a-8b36-0362f61c1fa2 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:23.291875 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e13304f-e35b-4abf-9d68-843a6d1b1be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:23.292781 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e13304f-e35b-4abf-9d68-843a6d1b1be0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:23.293024 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e13304f-e35b-4abf-9d68-843a6d1b1be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:23.294265 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e13304f-e35b-4abf-9d68-843a6d1b1be0 admin admin] PATH_INFO: `/v3/projects/f99cd373e8d5464c90b410af381f3cf6/users/513d0124255d430cb95b6435f62c788f/roles/ed72181e1403401facb77dcf33644757` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:23.318116 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576d9d2c-51ae-489f-9b93-1ed090f33bc6 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:23.326561 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e13304f-e35b-4abf-9d68-843a6d1b1be0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f99cd373e8d5464c90b410af381f3cf6, user_id=513d0124255d430cb95b6435f62c788f, role_id=ed72181e1403401facb77dcf33644757)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:23.336256 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8869dc74-7fc4-41d8-ab5c-64cc9980e2c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb060ff495bc4abb83ff88992fb7be09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:23.337040 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8869dc74-7fc4-41d8-ab5c-64cc9980e2c2 service nova] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:23.337356 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8869dc74-7fc4-41d8-ab5c-64cc9980e2c2 service nova] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:23.337460 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e13304f-e35b-4abf-9d68-843a6d1b1be0 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:23.337712 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8869dc74-7fc4-41d8-ab5c-64cc9980e2c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:23.366032 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8869dc74-7fc4-41d8-ab5c-64cc9980e2c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:23.368070 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8869dc74-7fc4-41d8-ab5c-64cc9980e2c2 service nova] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:23.376994 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1137/2262] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 5 12:18:23 2022] PUT /identity/v3/projects/f99cd373e8d5464c90b410af381f3cf6/users/513d0124255d430cb95b6435f62c788f/roles/ed72181e1403401facb77dcf33644757 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:18:23.378221 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e13304f-e35b-4abf-9d68-843a6d1b1be0 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:23.421248 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1126/2263] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:18:23 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:18:23.430194 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a712e7-e972-4c6d-8a99-2eb95dbf8690 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:23.430932 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a712e7-e972-4c6d-8a99-2eb95dbf8690 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:23.430932 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a712e7-e972-4c6d-8a99-2eb95dbf8690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:23.514272 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-53a712e7-e972-4c6d-8a99-2eb95dbf8690 None None] MFA Rules not processed for user `513d0124255d430cb95b6435f62c788f`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:18:23.516122 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-53a712e7-e972-4c6d-8a99-2eb95dbf8690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:18:23.538707 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e13304f-e35b-4abf-9d68-843a6d1b1be0 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:23.545871 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ca0161-85b7-4e5e-8778-29f4710823da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:23.546656 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ca0161-85b7-4e5e-8778-29f4710823da admin admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:23.547316 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ca0161-85b7-4e5e-8778-29f4710823da admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:23.547603 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ca0161-85b7-4e5e-8778-29f4710823da admin admin] PATH_INFO: `/v3/domains` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:23.548284 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ca0161-85b7-4e5e-8778-29f4710823da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:18:23.548723 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ca0161-85b7-4e5e-8778-29f4710823da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:23.550569 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ca0161-85b7-4e5e-8778-29f4710823da admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:23.580157 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1138/2264] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Sep 5 12:18:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:18:23.581332 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ca0161-85b7-4e5e-8778-29f4710823da admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:23.592934 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ca0161-85b7-4e5e-8778-29f4710823da admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:23.600274 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4372a67b-bf04-4743-a629-ab2fadcf31f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:23.601135 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4372a67b-bf04-4743-a629-ab2fadcf31f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:23.601675 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4372a67b-bf04-4743-a629-ab2fadcf31f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:23.601963 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4372a67b-bf04-4743-a629-ab2fadcf31f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:23.602914 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4372a67b-bf04-4743-a629-ab2fadcf31f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:23.605245 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4372a67b-bf04-4743-a629-ab2fadcf31f7 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:23.623674 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1127/2265] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:18:23 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:18:23.636521 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a712e7-e972-4c6d-8a99-2eb95dbf8690 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:23.638290 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-53a712e7-e972-4c6d-8a99-2eb95dbf8690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:18:23.642262 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1139/2266] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 5 12:18:23 2022] POST /identity/v3/projects => generated 391 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:18:23.646730 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4372a67b-bf04-4743-a629-ab2fadcf31f7 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:23.650547 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:18:23.749088 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a712e7-e972-4c6d-8a99-2eb95dbf8690 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:23.763660 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4372a67b-bf04-4743-a629-ab2fadcf31f7 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:23.774379 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea05b1c0-74b2-421b-a779-b025d0506c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:23.776393 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea05b1c0-74b2-421b-a779-b025d0506c24 admin admin] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:23.776854 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea05b1c0-74b2-421b-a779-b025d0506c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:23.777389 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea05b1c0-74b2-421b-a779-b025d0506c24 admin admin] PATH_INFO: `/v3/users` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:23.778836 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea05b1c0-74b2-421b-a779-b025d0506c24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:23.782792 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea05b1c0-74b2-421b-a779-b025d0506c24 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:23.824627 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6cea9e-afb6-416d-8486-201f1cfb2aa3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37633bbae0c2423c81ccd61ac3a17ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:23.825271 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6cea9e-afb6-416d-8486-201f1cfb2aa3 service cinder] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:23.825387 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6cea9e-afb6-416d-8486-201f1cfb2aa3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:23.825963 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6cea9e-afb6-416d-8486-201f1cfb2aa3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:23.831539 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1140/2267] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 5 12:18:23 2022] POST /identity/v3/users => generated 296 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 12:18:23.835490 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea05b1c0-74b2-421b-a779-b025d0506c24 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:23.859791 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea05b1c0-74b2-421b-a779-b025d0506c24 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:23.873269 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81242f1f-9fe7-44f4-8157-f16574bb09df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:23.875021 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81242f1f-9fe7-44f4-8157-f16574bb09df admin admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:23.876337 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81242f1f-9fe7-44f4-8157-f16574bb09df admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:23.877645 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81242f1f-9fe7-44f4-8157-f16574bb09df admin admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:23.879011 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81242f1f-9fe7-44f4-8157-f16574bb09df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:23.883937 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81242f1f-9fe7-44f4-8157-f16574bb09df admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:23.917335 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1141/2268] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:18:23 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:18:23.921382 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81242f1f-9fe7-44f4-8157-f16574bb09df admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:23.924087 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6cea9e-afb6-416d-8486-201f1cfb2aa3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:23.925654 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6cea9e-afb6-416d-8486-201f1cfb2aa3 service cinder] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:23.936487 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81242f1f-9fe7-44f4-8157-f16574bb09df admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:23.942273 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b833313-55e2-4659-bc39-043d5ce2d200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:23.942645 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1128/2269] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:18:23 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 12:18:23.953720 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b833313-55e2-4659-bc39-043d5ce2d200 admin admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:23.954253 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b833313-55e2-4659-bc39-043d5ce2d200 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:23.955940 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b833313-55e2-4659-bc39-043d5ce2d200 admin admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:23.957456 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b833313-55e2-4659-bc39-043d5ce2d200 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:23.960060 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b833313-55e2-4659-bc39-043d5ce2d200 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:23.986290 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6cea9e-afb6-416d-8486-201f1cfb2aa3 service cinder] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:24.009356 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1142/2270] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:18:23 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 12:18:24.009889 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b833313-55e2-4659-bc39-043d5ce2d200 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:24.012140 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6cea9e-afb6-416d-8486-201f1cfb2aa3 service cinder] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:24.027899 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77c7e86-ba90-430d-8de6-b6ac225d6bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:24.028836 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77c7e86-ba90-430d-8de6-b6ac225d6bd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:24.029007 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77c7e86-ba90-430d-8de6-b6ac225d6bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:24.032281 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77c7e86-ba90-430d-8de6-b6ac225d6bd0 admin admin] PATH_INFO: `/v3/projects/ee9ac3f9ed114b939ad496bfe57808bd/users/965f16e40ca44187adcacc6d624faf00/roles/ed72181e1403401facb77dcf33644757` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:24.037823 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b833313-55e2-4659-bc39-043d5ce2d200 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:24.057271 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbad9596-6652-4a50-8be8-1bb82dc6173f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:24.058057 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbad9596-6652-4a50-8be8-1bb82dc6173f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:24.059413 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbad9596-6652-4a50-8be8-1bb82dc6173f admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:24.059821 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbad9596-6652-4a50-8be8-1bb82dc6173f admin admin] PATH_INFO: `/v3/users/513d0124255d430cb95b6435f62c788f` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:24.061501 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbad9596-6652-4a50-8be8-1bb82dc6173f admin admin] RBAC: Authorizing `identity:delete_user(user_id=513d0124255d430cb95b6435f62c788f)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:24.069038 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbad9596-6652-4a50-8be8-1bb82dc6173f admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:24.092410 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77c7e86-ba90-430d-8de6-b6ac225d6bd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee9ac3f9ed114b939ad496bfe57808bd, user_id=965f16e40ca44187adcacc6d624faf00, role_id=ed72181e1403401facb77dcf33644757)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:24.099428 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:18:24.101215 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77c7e86-ba90-430d-8de6-b6ac225d6bd0 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:24.148008 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1129/2271] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 5 12:18:23 2022] PUT /identity/v3/projects/ee9ac3f9ed114b939ad496bfe57808bd/users/965f16e40ca44187adcacc6d624faf00/roles/ed72181e1403401facb77dcf33644757 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:18:24.152845 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4122105-0c4f-407d-9578-fd72708c5429 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:24.153163 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4122105-0c4f-407d-9578-fd72708c5429 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:24.153445 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4122105-0c4f-407d-9578-fd72708c5429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:24.211358 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-bbad9596-6652-4a50-8be8-1bb82dc6173f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '513d0124255d430cb95b6435f62c788f'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:24.213946 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-bbad9596-6652-4a50-8be8-1bb82dc6173f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '513d0124255d430cb95b6435f62c788f'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:24.225415 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-c4122105-0c4f-407d-9578-fd72708c5429 None None] MFA Rules not processed for user `965f16e40ca44187adcacc6d624faf00`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:18:24.233227 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-bbad9596-6652-4a50-8be8-1bb82dc6173f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '513d0124255d430cb95b6435f62c788f'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:24.234699 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-bbad9596-6652-4a50-8be8-1bb82dc6173f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '513d0124255d430cb95b6435f62c788f'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:24.234970 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-c4122105-0c4f-407d-9578-fd72708c5429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:18:24.315909 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-bbad9596-6652-4a50-8be8-1bb82dc6173f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '513d0124255d430cb95b6435f62c788f'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:24.335693 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1143/2272] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 5 12:18:24 2022] DELETE /identity/v3/users/513d0124255d430cb95b6435f62c788f => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:18:24.345004 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46efdfb-ffee-44ff-9721-331046b4ae9f None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:24.345665 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46efdfb-ffee-44ff-9721-331046b4ae9f None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:24.347847 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46efdfb-ffee-44ff-9721-331046b4ae9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:24.382218 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-e46efdfb-ffee-44ff-9721-331046b4ae9f None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:18:24.383485 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-e46efdfb-ffee-44ff-9721-331046b4ae9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:18:24.391165 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:18:24.433325 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1130/2273] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:18:24 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 12:18:24.453503 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4122105-0c4f-407d-9578-fd72708c5429 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:24.455155 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-c4122105-0c4f-407d-9578-fd72708c5429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:18:24.520983 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1144/2274] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:18:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 12:18:24.532881 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46efdfb-ffee-44ff-9721-331046b4ae9f None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:24.539742 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-e46efdfb-ffee-44ff-9721-331046b4ae9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:18:24.559791 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4122105-0c4f-407d-9578-fd72708c5429 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:24.646024 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e250c0-e35b-41cd-a202-192fb1e8593f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37633bbae0c2423c81ccd61ac3a17ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:24.646993 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e250c0-e35b-41cd-a202-192fb1e8593f service cinder] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:24.648334 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e250c0-e35b-41cd-a202-192fb1e8593f service cinder] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:24.648722 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e250c0-e35b-41cd-a202-192fb1e8593f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:24.666658 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46efdfb-ffee-44ff-9721-331046b4ae9f None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:24.671693 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20874979-7626-4d6e-8630-3b2b67aca9e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4994b4faa4ec4aa088f3dc32c9c5614d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:24.672738 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20874979-7626-4d6e-8630-3b2b67aca9e2 service neutron] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:24.673361 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20874979-7626-4d6e-8630-3b2b67aca9e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:24.673817 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20874979-7626-4d6e-8630-3b2b67aca9e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:24.689366 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20874979-7626-4d6e-8630-3b2b67aca9e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:24.691234 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20874979-7626-4d6e-8630-3b2b67aca9e2 service neutron] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:24.712283 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1145/2275] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:18:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:18:24.818894 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e250c0-e35b-41cd-a202-192fb1e8593f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:24.821400 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e250c0-e35b-41cd-a202-192fb1e8593f service cinder] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:24.842971 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1131/2276] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:18:24 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 12:18:25.211809 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20874979-7626-4d6e-8630-3b2b67aca9e2 service neutron] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:25.215057 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-20874979-7626-4d6e-8630-3b2b67aca9e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:18:25.263512 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20874979-7626-4d6e-8630-3b2b67aca9e2 service neutron] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:25.283093 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94580cf5-8e26-4401-96f5-036e67d85b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:25.283742 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94580cf5-8e26-4401-96f5-036e67d85b51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:25.284042 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94580cf5-8e26-4401-96f5-036e67d85b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:25.284326 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94580cf5-8e26-4401-96f5-036e67d85b51 admin admin] PATH_INFO: `/v3/projects/f99cd373e8d5464c90b410af381f3cf6` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:25.290589 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94580cf5-8e26-4401-96f5-036e67d85b51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f99cd373e8d5464c90b410af381f3cf6)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:25.298753 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94580cf5-8e26-4401-96f5-036e67d85b51 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:25.358049 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:18:25.409440 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-94580cf5-8e26-4401-96f5-036e67d85b51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f99cd373e8d5464c90b410af381f3cf6', 'request_id': 'req-94580cf5-8e26-4401-96f5-036e67d85b51'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:25.421861 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-94580cf5-8e26-4401-96f5-036e67d85b51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f99cd373e8d5464c90b410af381f3cf6', 'request_id': 'req-94580cf5-8e26-4401-96f5-036e67d85b51'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:25.471490 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-94580cf5-8e26-4401-96f5-036e67d85b51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f99cd373e8d5464c90b410af381f3cf6', 'request_id': 'req-94580cf5-8e26-4401-96f5-036e67d85b51'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:25.498663 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-94580cf5-8e26-4401-96f5-036e67d85b51 admin admin] The token cache is being invalidate because project f99cd373e8d5464c90b410af381f3cf6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:18:25.504567 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-94580cf5-8e26-4401-96f5-036e67d85b51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:25.508794 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-94580cf5-8e26-4401-96f5-036e67d85b51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:25.511016 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1146/2277] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 5 12:18:25 2022] DELETE /identity/v3/projects/f99cd373e8d5464c90b410af381f3cf6 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:18:25.515921 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc43691f-3f61-4d0a-9dca-51bc43d99299 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:25.516206 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc43691f-3f61-4d0a-9dca-51bc43d99299 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:25.516755 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc43691f-3f61-4d0a-9dca-51bc43d99299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:25.551578 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-dc43691f-3f61-4d0a-9dca-51bc43d99299 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:18:25.552850 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-dc43691f-3f61-4d0a-9dca-51bc43d99299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:18:25.699611 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:18:25.732452 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1132/2278] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:18:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:18:25.740630 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96f630a-4818-4d9a-9162-2d5cf7c0ec9b None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:25.742579 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96f630a-4818-4d9a-9162-2d5cf7c0ec9b None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:25.743175 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96f630a-4818-4d9a-9162-2d5cf7c0ec9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:25.756978 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e41fcd-afac-4ac0-a4a2-083ab90fa3bf None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:25.757807 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e41fcd-afac-4ac0-a4a2-083ab90fa3bf None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:25.759005 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e41fcd-afac-4ac0-a4a2-083ab90fa3bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:25.799614 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-d96f630a-4818-4d9a-9162-2d5cf7c0ec9b None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:18:25.801169 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-d96f630a-4818-4d9a-9162-2d5cf7c0ec9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:18:25.810803 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-07e41fcd-afac-4ac0-a4a2-083ab90fa3bf None None] MFA Rules not processed for user `09f4ccac184d43b7a519471316dd28b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:18:25.812950 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1147/2279] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:18:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:18:25.813153 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-07e41fcd-afac-4ac0-a4a2-083ab90fa3bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:18:25.817802 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96f630a-4818-4d9a-9162-2d5cf7c0ec9b None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:25.842427 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96f630a-4818-4d9a-9162-2d5cf7c0ec9b None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:25.865607 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd744d9-6b98-4bee-88a1-9eb977006f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:25.866609 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd744d9-6b98-4bee-88a1-9eb977006f49 admin admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:25.866907 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd744d9-6b98-4bee-88a1-9eb977006f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:25.867239 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd744d9-6b98-4bee-88a1-9eb977006f49 admin admin] PATH_INFO: `/v3/domains` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:25.868173 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd744d9-6b98-4bee-88a1-9eb977006f49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:18:25.869371 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd744d9-6b98-4bee-88a1-9eb977006f49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:25.875977 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd744d9-6b98-4bee-88a1-9eb977006f49 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:25.894025 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1148/2280] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Sep 5 12:18:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:18:25.897988 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd744d9-6b98-4bee-88a1-9eb977006f49 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:25.913869 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd744d9-6b98-4bee-88a1-9eb977006f49 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:25.918366 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1133/2281] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:18:25 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:18:25.920221 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1c9a08-24af-409f-a357-f211eeedac8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:25.921324 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1c9a08-24af-409f-a357-f211eeedac8f admin admin] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:25.921576 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1c9a08-24af-409f-a357-f211eeedac8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:25.921966 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1c9a08-24af-409f-a357-f211eeedac8f admin admin] PATH_INFO: `/v3/projects` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:25.922888 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1c9a08-24af-409f-a357-f211eeedac8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:25.925049 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1c9a08-24af-409f-a357-f211eeedac8f admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:25.993368 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1149/2282] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 5 12:18:25 2022] POST /identity/v3/projects => generated 397 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:18:25.998188 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e41fcd-afac-4ac0-a4a2-083ab90fa3bf None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:26.028833 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e41fcd-afac-4ac0-a4a2-083ab90fa3bf None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:26.134488 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a17d84a-8c62-40ee-b3ff-7a18ae4ffbb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:26.135310 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a17d84a-8c62-40ee-b3ff-7a18ae4ffbb7 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:26.135647 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a17d84a-8c62-40ee-b3ff-7a18ae4ffbb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:26.135988 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a17d84a-8c62-40ee-b3ff-7a18ae4ffbb7 admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:26.136578 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a17d84a-8c62-40ee-b3ff-7a18ae4ffbb7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:26.138722 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a17d84a-8c62-40ee-b3ff-7a18ae4ffbb7 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:26.166013 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1134/2283] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 5 12:18:25 2022] POST /identity/v3/users => generated 299 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 12:18:26.178268 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1c9a08-24af-409f-a357-f211eeedac8f admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:26.194773 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1c9a08-24af-409f-a357-f211eeedac8f admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:26.202528 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacd86b7-f650-40e5-b472-8c2ca131caed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:26.203168 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacd86b7-f650-40e5-b472-8c2ca131caed admin admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:26.203452 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacd86b7-f650-40e5-b472-8c2ca131caed admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:26.203727 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacd86b7-f650-40e5-b472-8c2ca131caed admin admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:26.204393 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacd86b7-f650-40e5-b472-8c2ca131caed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:26.206077 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacd86b7-f650-40e5-b472-8c2ca131caed admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:26.222220 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1150/2284] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:18:26 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:18:26.226770 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a17d84a-8c62-40ee-b3ff-7a18ae4ffbb7 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:26.237971 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a17d84a-8c62-40ee-b3ff-7a18ae4ffbb7 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:26.243619 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abec97db-9092-455c-9f68-e95713b8585b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:26.243846 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abec97db-9092-455c-9f68-e95713b8585b admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:26.244127 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abec97db-9092-455c-9f68-e95713b8585b admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:26.244400 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abec97db-9092-455c-9f68-e95713b8585b admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:26.245717 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abec97db-9092-455c-9f68-e95713b8585b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:26.248733 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abec97db-9092-455c-9f68-e95713b8585b admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:26.259574 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1135/2285] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:18:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:18:26.264244 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacd86b7-f650-40e5-b472-8c2ca131caed admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:26.277654 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacd86b7-f650-40e5-b472-8c2ca131caed admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:26.282496 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8da348f-864a-4177-8535-0be4b4f8df26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:26.283160 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8da348f-864a-4177-8535-0be4b4f8df26 admin admin] REQUEST_METHOD: `PUT` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:26.283446 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8da348f-864a-4177-8535-0be4b4f8df26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:26.283722 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8da348f-864a-4177-8535-0be4b4f8df26 admin admin] PATH_INFO: `/v3/projects/f3fa3b7007d84b88b450079accc881e0/users/722a0367db344d0ab4342956a3092c00/roles/ed72181e1403401facb77dcf33644757` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:26.299905 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8da348f-864a-4177-8535-0be4b4f8df26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3fa3b7007d84b88b450079accc881e0, user_id=722a0367db344d0ab4342956a3092c00, role_id=ed72181e1403401facb77dcf33644757)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:26.302616 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8da348f-864a-4177-8535-0be4b4f8df26 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:26.316748 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1151/2286] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 5 12:18:26 2022] PUT /identity/v3/projects/f3fa3b7007d84b88b450079accc881e0/users/722a0367db344d0ab4342956a3092c00/roles/ed72181e1403401facb77dcf33644757 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:18:26.328091 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3439c15c-0d92-4a7d-9b9b-ce03abcb615b None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:26.329537 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3439c15c-0d92-4a7d-9b9b-ce03abcb615b None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:26.329827 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3439c15c-0d92-4a7d-9b9b-ce03abcb615b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:26.363268 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-3439c15c-0d92-4a7d-9b9b-ce03abcb615b None None] MFA Rules not processed for user `722a0367db344d0ab4342956a3092c00`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:18:26.364859 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-3439c15c-0d92-4a7d-9b9b-ce03abcb615b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:18:26.438962 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1136/2287] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:18:26 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:18:26.450343 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8da348f-864a-4177-8535-0be4b4f8df26 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:26.452241 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-e8da348f-864a-4177-8535-0be4b4f8df26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:18:26.515769 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8da348f-864a-4177-8535-0be4b4f8df26 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:26.519785 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d6f728-aeac-4654-ae65-0b2b99069dbf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37633bbae0c2423c81ccd61ac3a17ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:26.520410 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d6f728-aeac-4654-ae65-0b2b99069dbf service cinder] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:26.520749 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d6f728-aeac-4654-ae65-0b2b99069dbf service cinder] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:26.521062 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d6f728-aeac-4654-ae65-0b2b99069dbf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:26.530381 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d6f728-aeac-4654-ae65-0b2b99069dbf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:26.531882 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d6f728-aeac-4654-ae65-0b2b99069dbf service cinder] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:26.545218 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1152/2288] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:18:26 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:18:32.257797 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3439c15c-0d92-4a7d-9b9b-ce03abcb615b None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:32.267561 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:18:32.321986 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3439c15c-0d92-4a7d-9b9b-ce03abcb615b None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:32.327110 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cec26e-6d1f-4ef0-bdf4-ba893ed7fd04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:32.327743 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cec26e-6d1f-4ef0-bdf4-ba893ed7fd04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:32.328020 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cec26e-6d1f-4ef0-bdf4-ba893ed7fd04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:32.328290 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cec26e-6d1f-4ef0-bdf4-ba893ed7fd04 admin admin] PATH_INFO: `/v3/users/722a0367db344d0ab4342956a3092c00` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:32.329433 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cec26e-6d1f-4ef0-bdf4-ba893ed7fd04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=722a0367db344d0ab4342956a3092c00)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:32.331345 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cec26e-6d1f-4ef0-bdf4-ba893ed7fd04 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:32.384230 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-b9cec26e-6d1f-4ef0-bdf4-ba893ed7fd04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '722a0367db344d0ab4342956a3092c00'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:32.385650 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-b9cec26e-6d1f-4ef0-bdf4-ba893ed7fd04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '722a0367db344d0ab4342956a3092c00'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:32.394991 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-b9cec26e-6d1f-4ef0-bdf4-ba893ed7fd04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '722a0367db344d0ab4342956a3092c00'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:32.395595 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-b9cec26e-6d1f-4ef0-bdf4-ba893ed7fd04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '722a0367db344d0ab4342956a3092c00'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:32.410875 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-b9cec26e-6d1f-4ef0-bdf4-ba893ed7fd04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '722a0367db344d0ab4342956a3092c00'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:32.424518 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1137/2289] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 5 12:18:32 2022] DELETE /identity/v3/users/722a0367db344d0ab4342956a3092c00 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:18:32.429214 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39c83ca-588c-43b2-8205-3e080ffa511e None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:32.429721 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39c83ca-588c-43b2-8205-3e080ffa511e None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:32.430095 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39c83ca-588c-43b2-8205-3e080ffa511e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:32.471804 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-c39c83ca-588c-43b2-8205-3e080ffa511e None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:18:32.472642 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-c39c83ca-588c-43b2-8205-3e080ffa511e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:18:32.529292 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=3 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:18:32.580157 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1153/2290] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:18:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:18:32.591689 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cec26e-6d1f-4ef0-bdf4-ba893ed7fd04 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:32.593357 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-b9cec26e-6d1f-4ef0-bdf4-ba893ed7fd04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:18:32.666126 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cec26e-6d1f-4ef0-bdf4-ba893ed7fd04 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:32.671635 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0624cd8-8ac3-48bc-8f80-f8bacecff989 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4994b4faa4ec4aa088f3dc32c9c5614d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:32.672819 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0624cd8-8ac3-48bc-8f80-f8bacecff989 service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:32.673202 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0624cd8-8ac3-48bc-8f80-f8bacecff989 service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:32.673566 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0624cd8-8ac3-48bc-8f80-f8bacecff989 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:32.687742 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0624cd8-8ac3-48bc-8f80-f8bacecff989 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:32.689736 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0624cd8-8ac3-48bc-8f80-f8bacecff989 service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:32.702118 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1138/2291] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:18:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:18:33.264012 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39c83ca-588c-43b2-8205-3e080ffa511e None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:33.265604 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-c39c83ca-588c-43b2-8205-3e080ffa511e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:18:33.288096 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39c83ca-588c-43b2-8205-3e080ffa511e None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:33.297973 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ff4a17-5c47-4d2f-8be6-1a91ef5f52b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:33.299132 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ff4a17-5c47-4d2f-8be6-1a91ef5f52b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:33.299412 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ff4a17-5c47-4d2f-8be6-1a91ef5f52b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:33.299688 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ff4a17-5c47-4d2f-8be6-1a91ef5f52b8 admin admin] PATH_INFO: `/v3/projects/f3fa3b7007d84b88b450079accc881e0` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:33.307253 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ff4a17-5c47-4d2f-8be6-1a91ef5f52b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3fa3b7007d84b88b450079accc881e0)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:33.311789 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ff4a17-5c47-4d2f-8be6-1a91ef5f52b8 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:33.458833 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-14ff4a17-5c47-4d2f-8be6-1a91ef5f52b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3fa3b7007d84b88b450079accc881e0', 'request_id': 'req-14ff4a17-5c47-4d2f-8be6-1a91ef5f52b8'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:33.476649 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-14ff4a17-5c47-4d2f-8be6-1a91ef5f52b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3fa3b7007d84b88b450079accc881e0', 'request_id': 'req-14ff4a17-5c47-4d2f-8be6-1a91ef5f52b8'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:33.485937 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-14ff4a17-5c47-4d2f-8be6-1a91ef5f52b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3fa3b7007d84b88b450079accc881e0', 'request_id': 'req-14ff4a17-5c47-4d2f-8be6-1a91ef5f52b8'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:33.502005 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-14ff4a17-5c47-4d2f-8be6-1a91ef5f52b8 admin admin] The token cache is being invalidate because project f3fa3b7007d84b88b450079accc881e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:18:33.502670 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-14ff4a17-5c47-4d2f-8be6-1a91ef5f52b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:33.503608 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-14ff4a17-5c47-4d2f-8be6-1a91ef5f52b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:33.505811 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1154/2292] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 5 12:18:33 2022] DELETE /identity/v3/projects/f3fa3b7007d84b88b450079accc881e0 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:18:35.943937 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0624cd8-8ac3-48bc-8f80-f8bacecff989 service neutron] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:35.946401 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-b0624cd8-8ac3-48bc-8f80-f8bacecff989 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:18:35.978108 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0624cd8-8ac3-48bc-8f80-f8bacecff989 service neutron] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:36.059400 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:18:36.111585 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4d82a8-0cb8-43e2-a3f3-80100291bf0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:36.115066 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4d82a8-0cb8-43e2-a3f3-80100291bf0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:36.115642 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4d82a8-0cb8-43e2-a3f3-80100291bf0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:36.116108 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4d82a8-0cb8-43e2-a3f3-80100291bf0c admin admin] PATH_INFO: `/v3/users/965f16e40ca44187adcacc6d624faf00` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:36.118998 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4d82a8-0cb8-43e2-a3f3-80100291bf0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=965f16e40ca44187adcacc6d624faf00)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:36.127208 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4d82a8-0cb8-43e2-a3f3-80100291bf0c admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:36.257444 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-6c4d82a8-0cb8-43e2-a3f3-80100291bf0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '965f16e40ca44187adcacc6d624faf00'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:36.258364 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-6c4d82a8-0cb8-43e2-a3f3-80100291bf0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '965f16e40ca44187adcacc6d624faf00'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:36.296959 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-6c4d82a8-0cb8-43e2-a3f3-80100291bf0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '965f16e40ca44187adcacc6d624faf00'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:36.296959 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-6c4d82a8-0cb8-43e2-a3f3-80100291bf0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '965f16e40ca44187adcacc6d624faf00'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:36.331855 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-6c4d82a8-0cb8-43e2-a3f3-80100291bf0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '965f16e40ca44187adcacc6d624faf00'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:36.361134 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1139/2293] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 5 12:18:35 2022] DELETE /identity/v3/users/965f16e40ca44187adcacc6d624faf00 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:18:36.372390 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31744ab-0f1f-4210-8e3a-97a078025e94 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:36.373986 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31744ab-0f1f-4210-8e3a-97a078025e94 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:36.374573 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31744ab-0f1f-4210-8e3a-97a078025e94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:36.438170 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-a31744ab-0f1f-4210-8e3a-97a078025e94 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:18:36.443690 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-a31744ab-0f1f-4210-8e3a-97a078025e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:18:36.567247 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1155/2294] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:18:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:18:36.591855 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4d82a8-0cb8-43e2-a3f3-80100291bf0c admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:36.594335 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-6c4d82a8-0cb8-43e2-a3f3-80100291bf0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:18:36.710262 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4d82a8-0cb8-43e2-a3f3-80100291bf0c admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:36.717421 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d38d97b-8d16-410d-ba26-24fcb13dcbff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4994b4faa4ec4aa088f3dc32c9c5614d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:36.718579 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d38d97b-8d16-410d-ba26-24fcb13dcbff service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:36.719182 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d38d97b-8d16-410d-ba26-24fcb13dcbff service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:36.719759 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d38d97b-8d16-410d-ba26-24fcb13dcbff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:36.740875 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d38d97b-8d16-410d-ba26-24fcb13dcbff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:36.745428 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d38d97b-8d16-410d-ba26-24fcb13dcbff service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:36.767759 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1140/2295] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:18:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 12:18:37.319372 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31744ab-0f1f-4210-8e3a-97a078025e94 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:37.324577 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-a31744ab-0f1f-4210-8e3a-97a078025e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:18:37.391220 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31744ab-0f1f-4210-8e3a-97a078025e94 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:37.398848 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7d5328-58c2-4b65-91f6-51ea2d8cab1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:37.399742 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7d5328-58c2-4b65-91f6-51ea2d8cab1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:37.399994 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7d5328-58c2-4b65-91f6-51ea2d8cab1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:37.401153 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7d5328-58c2-4b65-91f6-51ea2d8cab1e admin admin] PATH_INFO: `/v3/projects/ee9ac3f9ed114b939ad496bfe57808bd` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:37.402473 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7d5328-58c2-4b65-91f6-51ea2d8cab1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee9ac3f9ed114b939ad496bfe57808bd)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:37.405507 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7d5328-58c2-4b65-91f6-51ea2d8cab1e admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:37.486516 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-bb7d5328-58c2-4b65-91f6-51ea2d8cab1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee9ac3f9ed114b939ad496bfe57808bd', 'request_id': 'req-bb7d5328-58c2-4b65-91f6-51ea2d8cab1e'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:37.495234 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:18:37.518956 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-bb7d5328-58c2-4b65-91f6-51ea2d8cab1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee9ac3f9ed114b939ad496bfe57808bd', 'request_id': 'req-bb7d5328-58c2-4b65-91f6-51ea2d8cab1e'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:37.548124 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-bb7d5328-58c2-4b65-91f6-51ea2d8cab1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee9ac3f9ed114b939ad496bfe57808bd', 'request_id': 'req-bb7d5328-58c2-4b65-91f6-51ea2d8cab1e'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:37.593966 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-bb7d5328-58c2-4b65-91f6-51ea2d8cab1e admin admin] The token cache is being invalidate because project ee9ac3f9ed114b939ad496bfe57808bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:18:37.594490 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-bb7d5328-58c2-4b65-91f6-51ea2d8cab1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:37.599395 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-bb7d5328-58c2-4b65-91f6-51ea2d8cab1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:37.601662 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1156/2296] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 5 12:18:37 2022] DELETE /identity/v3/projects/ee9ac3f9ed114b939ad496bfe57808bd => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:18:39.217277 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d38d97b-8d16-410d-ba26-24fcb13dcbff service neutron] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:39.218747 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-3d38d97b-8d16-410d-ba26-24fcb13dcbff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:18:39.234005 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d38d97b-8d16-410d-ba26-24fcb13dcbff service neutron] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:39.307185 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:18:39.329770 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e39fdb-3d6e-49ce-9619-30921bd7bed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:39.331699 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e39fdb-3d6e-49ce-9619-30921bd7bed4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:39.332274 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e39fdb-3d6e-49ce-9619-30921bd7bed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:39.333102 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e39fdb-3d6e-49ce-9619-30921bd7bed4 admin admin] PATH_INFO: `/v3/users/01143d10bf904d259a6c9bf5f46a5c82` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:39.335335 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e39fdb-3d6e-49ce-9619-30921bd7bed4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=01143d10bf904d259a6c9bf5f46a5c82)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:39.339506 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e39fdb-3d6e-49ce-9619-30921bd7bed4 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:39.440831 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-39e39fdb-3d6e-49ce-9619-30921bd7bed4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01143d10bf904d259a6c9bf5f46a5c82'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:39.442256 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-39e39fdb-3d6e-49ce-9619-30921bd7bed4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01143d10bf904d259a6c9bf5f46a5c82'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:39.456642 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-39e39fdb-3d6e-49ce-9619-30921bd7bed4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01143d10bf904d259a6c9bf5f46a5c82'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:39.458300 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-39e39fdb-3d6e-49ce-9619-30921bd7bed4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01143d10bf904d259a6c9bf5f46a5c82'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:39.484688 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-39e39fdb-3d6e-49ce-9619-30921bd7bed4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01143d10bf904d259a6c9bf5f46a5c82'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:39.512363 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1141/2297] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 5 12:18:39 2022] DELETE /identity/v3/users/01143d10bf904d259a6c9bf5f46a5c82 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 12:18:39.518441 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5b292a-9780-42e5-ab0f-3d9248bb3b6b None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:39.518955 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5b292a-9780-42e5-ab0f-3d9248bb3b6b None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:39.519066 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5b292a-9780-42e5-ab0f-3d9248bb3b6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:39.565125 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-ea5b292a-9780-42e5-ab0f-3d9248bb3b6b None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:18:39.566489 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-ea5b292a-9780-42e5-ab0f-3d9248bb3b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:18:39.731057 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1157/2298] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:18:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:18:39.750961 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e39fdb-3d6e-49ce-9619-30921bd7bed4 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:39.754252 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-39e39fdb-3d6e-49ce-9619-30921bd7bed4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:18:39.857854 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e39fdb-3d6e-49ce-9619-30921bd7bed4 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:39.861617 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32510c2b-e575-46a5-b745-436bec4ae761 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4994b4faa4ec4aa088f3dc32c9c5614d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:39.862259 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32510c2b-e575-46a5-b745-436bec4ae761 service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:39.862541 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32510c2b-e575-46a5-b745-436bec4ae761 service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:39.862834 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32510c2b-e575-46a5-b745-436bec4ae761 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:39.873583 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32510c2b-e575-46a5-b745-436bec4ae761 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:39.875054 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32510c2b-e575-46a5-b745-436bec4ae761 service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:39.886030 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1142/2299] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:18:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:18:40.520251 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5b292a-9780-42e5-ab0f-3d9248bb3b6b None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:40.522432 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-ea5b292a-9780-42e5-ab0f-3d9248bb3b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:18:40.548004 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5b292a-9780-42e5-ab0f-3d9248bb3b6b None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:40.554690 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6910894d-7355-46b1-a389-83ceceaa4b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:40.555484 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6910894d-7355-46b1-a389-83ceceaa4b15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:40.555883 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6910894d-7355-46b1-a389-83ceceaa4b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:40.556225 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6910894d-7355-46b1-a389-83ceceaa4b15 admin admin] PATH_INFO: `/v3/projects/7b3ad16aa8eb47a39eb789304d154725` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:40.558128 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6910894d-7355-46b1-a389-83ceceaa4b15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b3ad16aa8eb47a39eb789304d154725)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:40.560454 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6910894d-7355-46b1-a389-83ceceaa4b15 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:40.624037 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-6910894d-7355-46b1-a389-83ceceaa4b15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b3ad16aa8eb47a39eb789304d154725', 'request_id': 'req-6910894d-7355-46b1-a389-83ceceaa4b15'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:40.633765 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-6910894d-7355-46b1-a389-83ceceaa4b15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b3ad16aa8eb47a39eb789304d154725', 'request_id': 'req-6910894d-7355-46b1-a389-83ceceaa4b15'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:40.642510 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-6910894d-7355-46b1-a389-83ceceaa4b15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b3ad16aa8eb47a39eb789304d154725', 'request_id': 'req-6910894d-7355-46b1-a389-83ceceaa4b15'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:40.666169 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-6910894d-7355-46b1-a389-83ceceaa4b15 admin admin] The token cache is being invalidate because project 7b3ad16aa8eb47a39eb789304d154725 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:18:40.666672 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-6910894d-7355-46b1-a389-83ceceaa4b15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:40.667791 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-6910894d-7355-46b1-a389-83ceceaa4b15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:40.671022 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1158/2300] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 5 12:18:40 2022] DELETE /identity/v3/projects/7b3ad16aa8eb47a39eb789304d154725 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:18:40.678267 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b2ba57-ea79-43bb-a7be-22d1a60c10f8 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:40.678778 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b2ba57-ea79-43bb-a7be-22d1a60c10f8 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:40.679131 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b2ba57-ea79-43bb-a7be-22d1a60c10f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:40.709013 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-53b2ba57-ea79-43bb-a7be-22d1a60c10f8 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:18:40.710458 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-53b2ba57-ea79-43bb-a7be-22d1a60c10f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:18:40.848058 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f6da7f-3e56-4d3c-9fbd-024db20f63b4 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:40.848380 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f6da7f-3e56-4d3c-9fbd-024db20f63b4 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:40.848853 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f6da7f-3e56-4d3c-9fbd-024db20f63b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:40.882684 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1143/2301] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:18:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:18:40.895115 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3d472b-0246-4717-a02b-5267d46110fd None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:40.895115 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3d472b-0246-4717-a02b-5267d46110fd None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:40.895386 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3d472b-0246-4717-a02b-5267d46110fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:40.911709 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-68f6da7f-3e56-4d3c-9fbd-024db20f63b4 None None] MFA Rules not processed for user `b7dcead6e9584ab8949678016ed12335`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:18:40.913327 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-68f6da7f-3e56-4d3c-9fbd-024db20f63b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:18:40.927509 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-4e3d472b-0246-4717-a02b-5267d46110fd None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:18:40.928883 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-4e3d472b-0246-4717-a02b-5267d46110fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:18:40.938829 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1144/2302] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:18:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:18:40.943395 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3d472b-0246-4717-a02b-5267d46110fd None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:40.954114 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3d472b-0246-4717-a02b-5267d46110fd None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:40.961650 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da9181c-e6ee-4f66-818a-bc7d5364c16e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:40.962283 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da9181c-e6ee-4f66-818a-bc7d5364c16e admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:40.962564 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da9181c-e6ee-4f66-818a-bc7d5364c16e admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:40.962932 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da9181c-e6ee-4f66-818a-bc7d5364c16e admin admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:40.963576 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da9181c-e6ee-4f66-818a-bc7d5364c16e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:18:40.963938 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da9181c-e6ee-4f66-818a-bc7d5364c16e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:40.966279 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da9181c-e6ee-4f66-818a-bc7d5364c16e admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:40.968530 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:18:40.990600 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1145/2303] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Sep 5 12:18:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:18:40.995268 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da9181c-e6ee-4f66-818a-bc7d5364c16e admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:40.996645 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1159/2304] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:18:40 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:18:41.010261 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da9181c-e6ee-4f66-818a-bc7d5364c16e admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:41.018713 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b5f665-c39f-4dd2-98b9-a4ee5c7c3d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:41.019341 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b5f665-c39f-4dd2-98b9-a4ee5c7c3d7b admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:41.019625 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b5f665-c39f-4dd2-98b9-a4ee5c7c3d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:41.019898 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b5f665-c39f-4dd2-98b9-a4ee5c7c3d7b admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:41.020872 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b5f665-c39f-4dd2-98b9-a4ee5c7c3d7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:41.023896 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b5f665-c39f-4dd2-98b9-a4ee5c7c3d7b admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:41.068351 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1146/2305] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 5 12:18:40 2022] POST /identity/v3/projects => generated 377 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 12:18:41.072850 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f6da7f-3e56-4d3c-9fbd-024db20f63b4 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:41.113120 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f6da7f-3e56-4d3c-9fbd-024db20f63b4 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:41.127631 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:18:41.253092 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e5e3f2-1ac6-4e21-8006-a8cb519d650d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:41.254188 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e5e3f2-1ac6-4e21-8006-a8cb519d650d admin admin] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:41.254654 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e5e3f2-1ac6-4e21-8006-a8cb519d650d admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:41.255121 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e5e3f2-1ac6-4e21-8006-a8cb519d650d admin admin] PATH_INFO: `/v3/users` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:41.256396 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e5e3f2-1ac6-4e21-8006-a8cb519d650d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:41.261045 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e5e3f2-1ac6-4e21-8006-a8cb519d650d admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:41.300072 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1160/2306] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 5 12:18:41 2022] POST /identity/v3/users => generated 289 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 12:18:41.308467 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b5f665-c39f-4dd2-98b9-a4ee5c7c3d7b admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:41.326638 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b5f665-c39f-4dd2-98b9-a4ee5c7c3d7b admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:41.331709 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa53c09-f021-4aa9-9bc5-463293864c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:41.332387 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa53c09-f021-4aa9-9bc5-463293864c85 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:41.332668 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa53c09-f021-4aa9-9bc5-463293864c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:41.332974 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa53c09-f021-4aa9-9bc5-463293864c85 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:41.333638 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa53c09-f021-4aa9-9bc5-463293864c85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:41.336785 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa53c09-f021-4aa9-9bc5-463293864c85 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:41.353357 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e5e3f2-1ac6-4e21-8006-a8cb519d650d admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:41.354947 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1147/2307] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:18:41 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:18:41.384068 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e5e3f2-1ac6-4e21-8006-a8cb519d650d admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:41.398076 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ead1ae-f65d-4541-9722-a1b19187766d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:41.399839 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ead1ae-f65d-4541-9722-a1b19187766d admin admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:41.400369 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ead1ae-f65d-4541-9722-a1b19187766d admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:41.400831 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ead1ae-f65d-4541-9722-a1b19187766d admin admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:41.402251 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ead1ae-f65d-4541-9722-a1b19187766d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:41.406010 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ead1ae-f65d-4541-9722-a1b19187766d admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:41.441107 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1161/2308] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:18:41 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 12:18:41.442961 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa53c09-f021-4aa9-9bc5-463293864c85 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:41.456504 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa53c09-f021-4aa9-9bc5-463293864c85 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:41.468716 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db866a2f-dcdf-4213-818e-818f26a61d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:41.469454 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db866a2f-dcdf-4213-818e-818f26a61d4d admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:41.469745 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db866a2f-dcdf-4213-818e-818f26a61d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:41.470011 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db866a2f-dcdf-4213-818e-818f26a61d4d admin admin] PATH_INFO: `/v3/projects/b19361924d9c4be59c10c178ddb97ce6/users/d3d92f1ba57249c3bb90eca2543e2544/roles/ed72181e1403401facb77dcf33644757` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:41.496245 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db866a2f-dcdf-4213-818e-818f26a61d4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b19361924d9c4be59c10c178ddb97ce6, user_id=d3d92f1ba57249c3bb90eca2543e2544, role_id=ed72181e1403401facb77dcf33644757)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:41.502198 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db866a2f-dcdf-4213-818e-818f26a61d4d admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:41.539570 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1148/2309] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 5 12:18:41 2022] PUT /identity/v3/projects/b19361924d9c4be59c10c178ddb97ce6/users/d3d92f1ba57249c3bb90eca2543e2544/roles/ed72181e1403401facb77dcf33644757 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 12:18:41.544766 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288cea1d-44eb-49d5-87e4-79544620e56a None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:41.545531 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288cea1d-44eb-49d5-87e4-79544620e56a None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:41.545531 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288cea1d-44eb-49d5-87e4-79544620e56a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:41.580823 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-288cea1d-44eb-49d5-87e4-79544620e56a None None] MFA Rules not processed for user `d3d92f1ba57249c3bb90eca2543e2544`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:18:41.582257 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-288cea1d-44eb-49d5-87e4-79544620e56a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:18:41.713140 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1162/2310] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:18:41 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:18:41.721969 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db866a2f-dcdf-4213-818e-818f26a61d4d admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:41.835666 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db866a2f-dcdf-4213-818e-818f26a61d4d admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:41.843048 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1f2aaf-12c1-4c26-83c5-62ce7db97c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:41.843697 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1f2aaf-12c1-4c26-83c5-62ce7db97c49 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:41.843986 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1f2aaf-12c1-4c26-83c5-62ce7db97c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:41.844265 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1f2aaf-12c1-4c26-83c5-62ce7db97c49 admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:41.844977 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1f2aaf-12c1-4c26-83c5-62ce7db97c49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:41.847180 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1f2aaf-12c1-4c26-83c5-62ce7db97c49 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:41.887928 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1149/2311] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 5 12:18:41 2022] POST /identity/v3/projects => generated 377 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:18:41.892603 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288cea1d-44eb-49d5-87e4-79544620e56a None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:41.907093 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288cea1d-44eb-49d5-87e4-79544620e56a None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:41.981306 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603c970e-0730-4288-ad2a-994f22e9d454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:41.981936 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603c970e-0730-4288-ad2a-994f22e9d454 admin admin] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:41.982216 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603c970e-0730-4288-ad2a-994f22e9d454 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:41.982483 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603c970e-0730-4288-ad2a-994f22e9d454 admin admin] PATH_INFO: `/v3/users` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:41.983171 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603c970e-0730-4288-ad2a-994f22e9d454 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:41.985177 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603c970e-0730-4288-ad2a-994f22e9d454 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:42.014734 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1163/2312] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 5 12:18:41 2022] POST /identity/v3/users => generated 289 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:18:42.021920 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1f2aaf-12c1-4c26-83c5-62ce7db97c49 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:42.046693 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1f2aaf-12c1-4c26-83c5-62ce7db97c49 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:42.055430 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76670ad-0be9-4c21-b0c2-447a4d5531f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:42.057172 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76670ad-0be9-4c21-b0c2-447a4d5531f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:42.057745 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76670ad-0be9-4c21-b0c2-447a4d5531f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:42.058324 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76670ad-0be9-4c21-b0c2-447a4d5531f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:42.059603 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76670ad-0be9-4c21-b0c2-447a4d5531f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:42.062857 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76670ad-0be9-4c21-b0c2-447a4d5531f5 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:42.085597 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1150/2313] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:18:42 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:18:42.090200 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603c970e-0730-4288-ad2a-994f22e9d454 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:42.105434 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603c970e-0730-4288-ad2a-994f22e9d454 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:42.115156 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138d3f89-2430-4382-859a-f9a7cce2663d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:42.116169 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138d3f89-2430-4382-859a-f9a7cce2663d admin admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:42.116621 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138d3f89-2430-4382-859a-f9a7cce2663d admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:42.117133 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138d3f89-2430-4382-859a-f9a7cce2663d admin admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:42.118927 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138d3f89-2430-4382-859a-f9a7cce2663d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:42.122061 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138d3f89-2430-4382-859a-f9a7cce2663d admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:42.126038 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:18:42.148956 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1164/2314] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:18:42 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:18:42.151973 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76670ad-0be9-4c21-b0c2-447a4d5531f5 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:42.170341 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76670ad-0be9-4c21-b0c2-447a4d5531f5 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:42.175212 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec1ec3f-2775-4edf-8c1f-1e2f328da543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:42.175936 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec1ec3f-2775-4edf-8c1f-1e2f328da543 admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:42.176222 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec1ec3f-2775-4edf-8c1f-1e2f328da543 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:42.176500 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec1ec3f-2775-4edf-8c1f-1e2f328da543 admin admin] PATH_INFO: `/v3/projects/9e6996a5a1f7457ebad4be025968bea5/users/c18c9d146eeb4f038cd101f92522fc26/roles/ed72181e1403401facb77dcf33644757` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:42.201796 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec1ec3f-2775-4edf-8c1f-1e2f328da543 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e6996a5a1f7457ebad4be025968bea5, user_id=c18c9d146eeb4f038cd101f92522fc26, role_id=ed72181e1403401facb77dcf33644757)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:42.207402 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec1ec3f-2775-4edf-8c1f-1e2f328da543 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:42.231564 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1151/2315] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 5 12:18:42 2022] PUT /identity/v3/projects/9e6996a5a1f7457ebad4be025968bea5/users/c18c9d146eeb4f038cd101f92522fc26/roles/ed72181e1403401facb77dcf33644757 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:18:42.248386 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d8f80b-9647-4afb-8459-ee1229e7770d None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:42.248676 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d8f80b-9647-4afb-8459-ee1229e7770d None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:42.248987 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d8f80b-9647-4afb-8459-ee1229e7770d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:42.285700 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-98d8f80b-9647-4afb-8459-ee1229e7770d None None] MFA Rules not processed for user `c18c9d146eeb4f038cd101f92522fc26`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:18:42.287044 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-98d8f80b-9647-4afb-8459-ee1229e7770d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:18:42.383196 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1165/2316] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:18:42 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:18:42.389517 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec1ec3f-2775-4edf-8c1f-1e2f328da543 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:42.502716 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:18:42.554944 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec1ec3f-2775-4edf-8c1f-1e2f328da543 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:42.576385 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686319d7-9a23-4432-b24c-a5093e61b153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:42.577939 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686319d7-9a23-4432-b24c-a5093e61b153 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:42.578699 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686319d7-9a23-4432-b24c-a5093e61b153 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:42.579403 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686319d7-9a23-4432-b24c-a5093e61b153 admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:42.580670 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686319d7-9a23-4432-b24c-a5093e61b153 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:42.583151 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686319d7-9a23-4432-b24c-a5093e61b153 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:42.640969 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1152/2317] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 5 12:18:42 2022] POST /identity/v3/projects => generated 375 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:18:42.646587 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d8f80b-9647-4afb-8459-ee1229e7770d None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:42.662963 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d8f80b-9647-4afb-8459-ee1229e7770d None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:42.843401 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1688c755-b43d-42fd-ad5f-87a1a15b91a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:42.844863 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1688c755-b43d-42fd-ad5f-87a1a15b91a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:42.845815 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1688c755-b43d-42fd-ad5f-87a1a15b91a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:42.846563 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1688c755-b43d-42fd-ad5f-87a1a15b91a6 admin admin] PATH_INFO: `/v3/users` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:42.847845 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1688c755-b43d-42fd-ad5f-87a1a15b91a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:42.852734 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1688c755-b43d-42fd-ad5f-87a1a15b91a6 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:42.965212 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1166/2318] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 5 12:18:42 2022] POST /identity/v3/users => generated 294 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:18:42.972200 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686319d7-9a23-4432-b24c-a5093e61b153 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:43.025014 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686319d7-9a23-4432-b24c-a5093e61b153 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:43.044942 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d1b2ed-ee0e-49cc-98ce-f20e7483b311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:43.045717 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d1b2ed-ee0e-49cc-98ce-f20e7483b311 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:43.046047 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d1b2ed-ee0e-49cc-98ce-f20e7483b311 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:43.046324 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d1b2ed-ee0e-49cc-98ce-f20e7483b311 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:43.047050 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d1b2ed-ee0e-49cc-98ce-f20e7483b311 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:43.048705 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d1b2ed-ee0e-49cc-98ce-f20e7483b311 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:43.116357 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1153/2319] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:18:42 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 12:18:43.124124 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1688c755-b43d-42fd-ad5f-87a1a15b91a6 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:43.152641 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1688c755-b43d-42fd-ad5f-87a1a15b91a6 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:43.198430 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a050bf19-50b0-46a1-9c00-3bdbb37e6dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:43.199601 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a050bf19-50b0-46a1-9c00-3bdbb37e6dfa admin admin] REQUEST_METHOD: `PUT` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:43.200091 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a050bf19-50b0-46a1-9c00-3bdbb37e6dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:43.200904 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a050bf19-50b0-46a1-9c00-3bdbb37e6dfa admin admin] PATH_INFO: `/v3/projects/07f2827fcb9643e7bb53871acc11b9b6/users/eb40609937f84ee1b201bcd7e09c13eb/roles/16e2ccc8bd1b497d8cee780c1c7df0d2` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:43.279534 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a050bf19-50b0-46a1-9c00-3bdbb37e6dfa admin admin] RBAC: Authorizing `identity:create_grant(project_id=07f2827fcb9643e7bb53871acc11b9b6, user_id=eb40609937f84ee1b201bcd7e09c13eb, role_id=16e2ccc8bd1b497d8cee780c1c7df0d2)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:43.303944 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a050bf19-50b0-46a1-9c00-3bdbb37e6dfa admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:43.353127 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1167/2320] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 5 12:18:43 2022] PUT /identity/v3/projects/07f2827fcb9643e7bb53871acc11b9b6/users/eb40609937f84ee1b201bcd7e09c13eb/roles/16e2ccc8bd1b497d8cee780c1c7df0d2 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:18:43.360472 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d1b2ed-ee0e-49cc-98ce-f20e7483b311 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:43.395643 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d1b2ed-ee0e-49cc-98ce-f20e7483b311 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:43.545811 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4901c3-20ae-4e4a-9754-c6871079984a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:43.546739 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4901c3-20ae-4e4a-9754-c6871079984a admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:43.547022 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4901c3-20ae-4e4a-9754-c6871079984a admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:43.547967 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4901c3-20ae-4e4a-9754-c6871079984a admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:43.547967 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4901c3-20ae-4e4a-9754-c6871079984a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:43.549952 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4901c3-20ae-4e4a-9754-c6871079984a admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:43.566361 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1154/2321] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:18:43 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:18:43.572819 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a050bf19-50b0-46a1-9c00-3bdbb37e6dfa admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:43.617329 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a050bf19-50b0-46a1-9c00-3bdbb37e6dfa admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:43.631580 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce27afe-7909-421c-8f90-06bccbc86b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:43.632502 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce27afe-7909-421c-8f90-06bccbc86b5c admin admin] REQUEST_METHOD: `PUT` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:43.633412 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce27afe-7909-421c-8f90-06bccbc86b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:43.635403 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce27afe-7909-421c-8f90-06bccbc86b5c admin admin] PATH_INFO: `/v3/projects/07f2827fcb9643e7bb53871acc11b9b6/users/eb40609937f84ee1b201bcd7e09c13eb/roles/16e2ccc8bd1b497d8cee780c1c7df0d2` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:43.638093 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce27afe-7909-421c-8f90-06bccbc86b5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=07f2827fcb9643e7bb53871acc11b9b6, user_id=eb40609937f84ee1b201bcd7e09c13eb, role_id=16e2ccc8bd1b497d8cee780c1c7df0d2)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:43.641940 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce27afe-7909-421c-8f90-06bccbc86b5c admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:43.658342 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1168/2322] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 5 12:18:43 2022] PUT /identity/v3/projects/07f2827fcb9643e7bb53871acc11b9b6/users/eb40609937f84ee1b201bcd7e09c13eb/roles/16e2ccc8bd1b497d8cee780c1c7df0d2 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:18:43.675831 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06571d2b-dbbc-48d4-b355-79a241fedbcf None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:43.677073 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06571d2b-dbbc-48d4-b355-79a241fedbcf None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:43.677073 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06571d2b-dbbc-48d4-b355-79a241fedbcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:43.745427 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-06571d2b-dbbc-48d4-b355-79a241fedbcf None None] MFA Rules not processed for user `eb40609937f84ee1b201bcd7e09c13eb`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:18:43.749518 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-06571d2b-dbbc-48d4-b355-79a241fedbcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:18:43.904334 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1155/2323] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:18:43 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:18:43.921081 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce27afe-7909-421c-8f90-06bccbc86b5c admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:43.923926 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-cce27afe-7909-421c-8f90-06bccbc86b5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:18:44.014065 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:18:44.049811 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce27afe-7909-421c-8f90-06bccbc86b5c admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:44.056209 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91f6cf2-e4ff-4835-8b53-bb9c8036281e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37633bbae0c2423c81ccd61ac3a17ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:44.057887 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91f6cf2-e4ff-4835-8b53-bb9c8036281e service cinder] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:44.058334 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91f6cf2-e4ff-4835-8b53-bb9c8036281e service cinder] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:44.058720 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91f6cf2-e4ff-4835-8b53-bb9c8036281e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:44.183622 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91f6cf2-e4ff-4835-8b53-bb9c8036281e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:44.186267 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91f6cf2-e4ff-4835-8b53-bb9c8036281e service cinder] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:44.203518 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1169/2324] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:18:43 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:18:46.407315 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06571d2b-dbbc-48d4-b355-79a241fedbcf None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:46.419208 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06571d2b-dbbc-48d4-b355-79a241fedbcf None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:46.425264 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceed757-3b59-42ca-9be8-7a61c83a3c9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37633bbae0c2423c81ccd61ac3a17ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:46.426152 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceed757-3b59-42ca-9be8-7a61c83a3c9c service cinder] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:46.426573 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceed757-3b59-42ca-9be8-7a61c83a3c9c service cinder] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:46.426984 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceed757-3b59-42ca-9be8-7a61c83a3c9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:46.527153 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:18:46.576621 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ceed757-3b59-42ca-9be8-7a61c83a3c9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:46.578487 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ceed757-3b59-42ca-9be8-7a61c83a3c9c service cinder] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:46.590129 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1156/2325] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:18:46 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 12:18:47.668620 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91f6cf2-e4ff-4835-8b53-bb9c8036281e service cinder] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:47.684771 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91f6cf2-e4ff-4835-8b53-bb9c8036281e service cinder] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:47.693722 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc19c64-dff2-4de3-92f7-12a234267e6c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37633bbae0c2423c81ccd61ac3a17ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:47.695549 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc19c64-dff2-4de3-92f7-12a234267e6c service cinder] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:47.696257 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc19c64-dff2-4de3-92f7-12a234267e6c service cinder] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:47.696983 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc19c64-dff2-4de3-92f7-12a234267e6c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:47.718349 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc19c64-dff2-4de3-92f7-12a234267e6c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:47.721592 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc19c64-dff2-4de3-92f7-12a234267e6c service cinder] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:47.741934 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1170/2326] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:18:47 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:18:51.659067 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceed757-3b59-42ca-9be8-7a61c83a3c9c service cinder] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:51.662959 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-1ceed757-3b59-42ca-9be8-7a61c83a3c9c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:18:51.781369 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceed757-3b59-42ca-9be8-7a61c83a3c9c service cinder] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:51.804889 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7662afb3-bff6-49be-b59a-5b7fab2e3768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:51.805610 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7662afb3-bff6-49be-b59a-5b7fab2e3768 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:51.805896 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7662afb3-bff6-49be-b59a-5b7fab2e3768 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:51.806177 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7662afb3-bff6-49be-b59a-5b7fab2e3768 admin admin] PATH_INFO: `/v3/users/4b109f814c2241da8848bf3ecbc2c206` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:51.807603 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7662afb3-bff6-49be-b59a-5b7fab2e3768 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b109f814c2241da8848bf3ecbc2c206)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:51.809761 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7662afb3-bff6-49be-b59a-5b7fab2e3768 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:51.901142 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-7662afb3-bff6-49be-b59a-5b7fab2e3768 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b109f814c2241da8848bf3ecbc2c206'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:51.901858 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-7662afb3-bff6-49be-b59a-5b7fab2e3768 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b109f814c2241da8848bf3ecbc2c206'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:51.917922 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-7662afb3-bff6-49be-b59a-5b7fab2e3768 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b109f814c2241da8848bf3ecbc2c206'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:51.919228 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-7662afb3-bff6-49be-b59a-5b7fab2e3768 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b109f814c2241da8848bf3ecbc2c206'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:51.944064 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-7662afb3-bff6-49be-b59a-5b7fab2e3768 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b109f814c2241da8848bf3ecbc2c206'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:51.975196 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1157/2327] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 5 12:18:51 2022] DELETE /identity/v3/users/4b109f814c2241da8848bf3ecbc2c206 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:18:51.981433 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51444137-e0ca-4146-9e3b-15507e6f8cde None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:51.981950 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51444137-e0ca-4146-9e3b-15507e6f8cde None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:51.982453 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51444137-e0ca-4146-9e3b-15507e6f8cde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:52.024840 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-51444137-e0ca-4146-9e3b-15507e6f8cde None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:18:52.026688 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-51444137-e0ca-4146-9e3b-15507e6f8cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:18:52.155002 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1171/2328] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:18:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 12:18:52.168686 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7662afb3-bff6-49be-b59a-5b7fab2e3768 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:52.170273 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-7662afb3-bff6-49be-b59a-5b7fab2e3768 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:18:52.265745 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7662afb3-bff6-49be-b59a-5b7fab2e3768 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:52.274218 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2de55b-ca15-4c4d-8970-a9cfa9170b40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4994b4faa4ec4aa088f3dc32c9c5614d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:52.275881 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2de55b-ca15-4c4d-8970-a9cfa9170b40 service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:52.276505 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2de55b-ca15-4c4d-8970-a9cfa9170b40 service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:52.277143 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2de55b-ca15-4c4d-8970-a9cfa9170b40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:52.302396 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2de55b-ca15-4c4d-8970-a9cfa9170b40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:52.306062 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2de55b-ca15-4c4d-8970-a9cfa9170b40 service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:52.330934 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1158/2329] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:18:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:18:52.414033 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51444137-e0ca-4146-9e3b-15507e6f8cde None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:52.415608 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-51444137-e0ca-4146-9e3b-15507e6f8cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:18:52.443118 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51444137-e0ca-4146-9e3b-15507e6f8cde None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:52.456587 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e9dc27-7df3-420f-b3d6-8900b4cb668b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:52.459236 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e9dc27-7df3-420f-b3d6-8900b4cb668b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:52.459878 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e9dc27-7df3-420f-b3d6-8900b4cb668b admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:52.460516 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e9dc27-7df3-420f-b3d6-8900b4cb668b admin admin] PATH_INFO: `/v3/users/d3d92f1ba57249c3bb90eca2543e2544` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:52.463663 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e9dc27-7df3-420f-b3d6-8900b4cb668b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3d92f1ba57249c3bb90eca2543e2544)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:52.469620 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e9dc27-7df3-420f-b3d6-8900b4cb668b admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:52.598835 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-11e9dc27-7df3-420f-b3d6-8900b4cb668b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3d92f1ba57249c3bb90eca2543e2544'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:52.600130 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-11e9dc27-7df3-420f-b3d6-8900b4cb668b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3d92f1ba57249c3bb90eca2543e2544'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:52.613471 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-11e9dc27-7df3-420f-b3d6-8900b4cb668b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3d92f1ba57249c3bb90eca2543e2544'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:52.614577 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-11e9dc27-7df3-420f-b3d6-8900b4cb668b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3d92f1ba57249c3bb90eca2543e2544'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:52.633682 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-11e9dc27-7df3-420f-b3d6-8900b4cb668b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3d92f1ba57249c3bb90eca2543e2544'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:52.641963 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:18:52.664982 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1172/2330] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 5 12:18:52 2022] DELETE /identity/v3/users/d3d92f1ba57249c3bb90eca2543e2544 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:18:52.666908 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a99631-26ed-47da-ba34-83af8b1f7149 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:52.667686 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a99631-26ed-47da-ba34-83af8b1f7149 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:52.667686 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a99631-26ed-47da-ba34-83af8b1f7149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:52.679457 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:18:52.702659 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-e3a99631-26ed-47da-ba34-83af8b1f7149 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:18:52.705470 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-e3a99631-26ed-47da-ba34-83af8b1f7149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:18:52.874665 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1159/2331] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:18:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:18:52.875750 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e9dc27-7df3-420f-b3d6-8900b4cb668b admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:52.878365 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-11e9dc27-7df3-420f-b3d6-8900b4cb668b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:18:52.906299 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a99631-26ed-47da-ba34-83af8b1f7149 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:52.907837 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-e3a99631-26ed-47da-ba34-83af8b1f7149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:18:52.932518 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a99631-26ed-47da-ba34-83af8b1f7149 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:52.951275 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972acf27-2d2c-4f54-9e30-22ca64434aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:52.952068 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972acf27-2d2c-4f54-9e30-22ca64434aa9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:52.952377 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972acf27-2d2c-4f54-9e30-22ca64434aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:52.952661 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972acf27-2d2c-4f54-9e30-22ca64434aa9 admin admin] PATH_INFO: `/v3/projects/adca5e76f1e343229393c744dca6acc4` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:52.954071 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972acf27-2d2c-4f54-9e30-22ca64434aa9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=adca5e76f1e343229393c744dca6acc4)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:52.956412 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972acf27-2d2c-4f54-9e30-22ca64434aa9 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:53.030487 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e9dc27-7df3-420f-b3d6-8900b4cb668b admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:53.043543 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08bb72d-3106-4f66-819b-5aae640bc638 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4994b4faa4ec4aa088f3dc32c9c5614d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:53.044486 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08bb72d-3106-4f66-819b-5aae640bc638 service neutron] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:53.047918 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08bb72d-3106-4f66-819b-5aae640bc638 service neutron] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:53.048333 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08bb72d-3106-4f66-819b-5aae640bc638 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:53.075435 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08bb72d-3106-4f66-819b-5aae640bc638 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:53.077024 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08bb72d-3106-4f66-819b-5aae640bc638 service neutron] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:53.089293 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1173/2332] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:18:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 12:18:53.104878 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-972acf27-2d2c-4f54-9e30-22ca64434aa9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'adca5e76f1e343229393c744dca6acc4', 'request_id': 'req-972acf27-2d2c-4f54-9e30-22ca64434aa9'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:53.139200 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-972acf27-2d2c-4f54-9e30-22ca64434aa9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'adca5e76f1e343229393c744dca6acc4', 'request_id': 'req-972acf27-2d2c-4f54-9e30-22ca64434aa9'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:53.156092 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-972acf27-2d2c-4f54-9e30-22ca64434aa9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'adca5e76f1e343229393c744dca6acc4', 'request_id': 'req-972acf27-2d2c-4f54-9e30-22ca64434aa9'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:53.172660 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-972acf27-2d2c-4f54-9e30-22ca64434aa9 admin admin] The token cache is being invalidate because project adca5e76f1e343229393c744dca6acc4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:18:53.173115 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-972acf27-2d2c-4f54-9e30-22ca64434aa9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:53.175996 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-972acf27-2d2c-4f54-9e30-22ca64434aa9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:53.184673 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d204a6-510b-4e51-ac33-b75de27d544f None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:53.185241 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d204a6-510b-4e51-ac33-b75de27d544f None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:53.185697 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d204a6-510b-4e51-ac33-b75de27d544f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:53.189623 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1160/2333] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 5 12:18:52 2022] DELETE /identity/v3/projects/adca5e76f1e343229393c744dca6acc4 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:18:53.230093 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-94d204a6-510b-4e51-ac33-b75de27d544f None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:18:53.231518 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-94d204a6-510b-4e51-ac33-b75de27d544f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:18:53.349395 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1174/2334] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:18:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:18:53.357729 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b42c8dd-b5ce-475e-9519-258a1958f247 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:53.358134 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b42c8dd-b5ce-475e-9519-258a1958f247 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:53.359047 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b42c8dd-b5ce-475e-9519-258a1958f247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:53.382926 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-6b42c8dd-b5ce-475e-9519-258a1958f247 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:18:53.385023 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-6b42c8dd-b5ce-475e-9519-258a1958f247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:18:53.418183 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1161/2335] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:18:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:18:53.422649 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d204a6-510b-4e51-ac33-b75de27d544f None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:53.437489 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d204a6-510b-4e51-ac33-b75de27d544f None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:53.452362 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2547c1-8a9d-47ca-a5a5-b2ca57b0340d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:53.455715 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2547c1-8a9d-47ca-a5a5-b2ca57b0340d admin admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:53.456060 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2547c1-8a9d-47ca-a5a5-b2ca57b0340d admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:53.456347 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2547c1-8a9d-47ca-a5a5-b2ca57b0340d admin admin] PATH_INFO: `/v3/domains` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:53.457125 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2547c1-8a9d-47ca-a5a5-b2ca57b0340d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:18:53.457437 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2547c1-8a9d-47ca-a5a5-b2ca57b0340d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:53.459147 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2547c1-8a9d-47ca-a5a5-b2ca57b0340d admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:53.498949 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1175/2336] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Sep 5 12:18:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:18:53.510817 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b42c8dd-b5ce-475e-9519-258a1958f247 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:53.521899 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b42c8dd-b5ce-475e-9519-258a1958f247 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:53.537156 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a27e52d-a39e-435b-94d0-50a909ee55df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:53.538252 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a27e52d-a39e-435b-94d0-50a909ee55df admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:53.538797 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a27e52d-a39e-435b-94d0-50a909ee55df admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:53.539275 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a27e52d-a39e-435b-94d0-50a909ee55df admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:53.540562 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a27e52d-a39e-435b-94d0-50a909ee55df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:53.545593 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a27e52d-a39e-435b-94d0-50a909ee55df admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:53.606537 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2547c1-8a9d-47ca-a5a5-b2ca57b0340d admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:53.620408 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1162/2337] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 5 12:18:53 2022] POST /identity/v3/projects => generated 373 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:18:53.622022 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a27e52d-a39e-435b-94d0-50a909ee55df admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:53.630266 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-6a27e52d-a39e-435b-94d0-50a909ee55df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:18:53.636495 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2547c1-8a9d-47ca-a5a5-b2ca57b0340d admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:53.764971 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:18:53.771577 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a27e52d-a39e-435b-94d0-50a909ee55df admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:53.779004 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23067db6-29ab-467c-853a-3ebe61ee5844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:53.780049 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23067db6-29ab-467c-853a-3ebe61ee5844 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:53.780409 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23067db6-29ab-467c-853a-3ebe61ee5844 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:53.781193 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23067db6-29ab-467c-853a-3ebe61ee5844 admin admin] PATH_INFO: `/v3/projects/b19361924d9c4be59c10c178ddb97ce6` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:53.783947 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23067db6-29ab-467c-853a-3ebe61ee5844 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b19361924d9c4be59c10c178ddb97ce6)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:53.786369 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23067db6-29ab-467c-853a-3ebe61ee5844 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:53.808684 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2a625d-71c2-4150-906f-56fdbf68c254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:53.809586 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2a625d-71c2-4150-906f-56fdbf68c254 admin admin] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:53.810048 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2a625d-71c2-4150-906f-56fdbf68c254 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:53.810335 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2a625d-71c2-4150-906f-56fdbf68c254 admin admin] PATH_INFO: `/v3/users` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:53.811525 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2a625d-71c2-4150-906f-56fdbf68c254 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:53.813526 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2a625d-71c2-4150-906f-56fdbf68c254 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:53.853753 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1176/2338] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 5 12:18:53 2022] POST /identity/v3/users => generated 287 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:18:53.861657 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2a625d-71c2-4150-906f-56fdbf68c254 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:53.873545 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-23067db6-29ab-467c-853a-3ebe61ee5844 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b19361924d9c4be59c10c178ddb97ce6', 'request_id': 'req-23067db6-29ab-467c-853a-3ebe61ee5844'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:53.881795 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2a625d-71c2-4150-906f-56fdbf68c254 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:53.883336 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-23067db6-29ab-467c-853a-3ebe61ee5844 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b19361924d9c4be59c10c178ddb97ce6', 'request_id': 'req-23067db6-29ab-467c-853a-3ebe61ee5844'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:53.891559 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-23067db6-29ab-467c-853a-3ebe61ee5844 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b19361924d9c4be59c10c178ddb97ce6', 'request_id': 'req-23067db6-29ab-467c-853a-3ebe61ee5844'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:53.902026 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:18:53.906270 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-23067db6-29ab-467c-853a-3ebe61ee5844 admin admin] The token cache is being invalidate because project b19361924d9c4be59c10c178ddb97ce6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:18:53.906750 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-23067db6-29ab-467c-853a-3ebe61ee5844 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:53.907509 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-23067db6-29ab-467c-853a-3ebe61ee5844 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:53.909789 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1163/2339] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 5 12:18:53 2022] DELETE /identity/v3/projects/b19361924d9c4be59c10c178ddb97ce6 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:18:53.918005 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23067db6-29ab-467c-853a-3ebe61ee5844 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:53.919866 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-23067db6-29ab-467c-853a-3ebe61ee5844 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:18:53.978117 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5bdfd1-2546-4533-80d9-fac244d09034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:53.979254 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5bdfd1-2546-4533-80d9-fac244d09034 admin admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:53.979544 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5bdfd1-2546-4533-80d9-fac244d09034 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:53.979816 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5bdfd1-2546-4533-80d9-fac244d09034 admin admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:53.980493 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5bdfd1-2546-4533-80d9-fac244d09034 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:53.982203 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5bdfd1-2546-4533-80d9-fac244d09034 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:53.995591 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1177/2340] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:18:53 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:18:54.000388 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5bdfd1-2546-4533-80d9-fac244d09034 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:54.002962 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-ef5bdfd1-2546-4533-80d9-fac244d09034 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:18:54.017400 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5bdfd1-2546-4533-80d9-fac244d09034 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:54.020804 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23067db6-29ab-467c-853a-3ebe61ee5844 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:54.022797 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5da6a0-4c49-4040-a980-3e5adff5896f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:54.023506 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5da6a0-4c49-4040-a980-3e5adff5896f admin admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:54.023793 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5da6a0-4c49-4040-a980-3e5adff5896f admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:54.024068 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5da6a0-4c49-4040-a980-3e5adff5896f admin admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:54.026492 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5da6a0-4c49-4040-a980-3e5adff5896f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:54.026868 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947d03fc-98d7-4395-848b-c6f48f4f0f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:54.027532 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947d03fc-98d7-4395-848b-c6f48f4f0f5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:54.027808 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947d03fc-98d7-4395-848b-c6f48f4f0f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:54.028149 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5da6a0-4c49-4040-a980-3e5adff5896f admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:54.028792 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947d03fc-98d7-4395-848b-c6f48f4f0f5c admin admin] PATH_INFO: `/v3/users/c18c9d146eeb4f038cd101f92522fc26` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:54.030399 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947d03fc-98d7-4395-848b-c6f48f4f0f5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c18c9d146eeb4f038cd101f92522fc26)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:54.032871 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947d03fc-98d7-4395-848b-c6f48f4f0f5c admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:54.040639 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1178/2341] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:18:53 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:18:54.046048 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5da6a0-4c49-4040-a980-3e5adff5896f admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:54.057108 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5da6a0-4c49-4040-a980-3e5adff5896f admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:54.062095 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a577b397-1ab6-43e7-a1a1-6e3f4aa0b54d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:54.063119 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a577b397-1ab6-43e7-a1a1-6e3f4aa0b54d admin admin] REQUEST_METHOD: `PUT` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:54.063404 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a577b397-1ab6-43e7-a1a1-6e3f4aa0b54d admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:54.063873 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a577b397-1ab6-43e7-a1a1-6e3f4aa0b54d admin admin] PATH_INFO: `/v3/projects/0b33648f6060479f8ea0a2ad7497060a/users/74f3508c41f74e9eb98b6aef46f6afb2/roles/ed72181e1403401facb77dcf33644757` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:54.083246 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a577b397-1ab6-43e7-a1a1-6e3f4aa0b54d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b33648f6060479f8ea0a2ad7497060a, user_id=74f3508c41f74e9eb98b6aef46f6afb2, role_id=ed72181e1403401facb77dcf33644757)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:54.086616 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a577b397-1ab6-43e7-a1a1-6e3f4aa0b54d admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:54.102821 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-947d03fc-98d7-4395-848b-c6f48f4f0f5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c18c9d146eeb4f038cd101f92522fc26'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:54.104107 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-947d03fc-98d7-4395-848b-c6f48f4f0f5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c18c9d146eeb4f038cd101f92522fc26'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:54.111066 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1179/2342] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 5 12:18:54 2022] PUT /identity/v3/projects/0b33648f6060479f8ea0a2ad7497060a/users/74f3508c41f74e9eb98b6aef46f6afb2/roles/ed72181e1403401facb77dcf33644757 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:18:54.123283 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83225bac-a1a5-4355-a4ab-668ab325c2b0 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:54.123899 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83225bac-a1a5-4355-a4ab-668ab325c2b0 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:54.124286 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83225bac-a1a5-4355-a4ab-668ab325c2b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:54.125215 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-947d03fc-98d7-4395-848b-c6f48f4f0f5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c18c9d146eeb4f038cd101f92522fc26'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:54.133535 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-947d03fc-98d7-4395-848b-c6f48f4f0f5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c18c9d146eeb4f038cd101f92522fc26'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:54.159134 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-947d03fc-98d7-4395-848b-c6f48f4f0f5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c18c9d146eeb4f038cd101f92522fc26'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:54.173717 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-83225bac-a1a5-4355-a4ab-668ab325c2b0 None None] MFA Rules not processed for user `74f3508c41f74e9eb98b6aef46f6afb2`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:18:54.175472 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-83225bac-a1a5-4355-a4ab-668ab325c2b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:18:54.186351 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1164/2343] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 5 12:18:53 2022] DELETE /identity/v3/users/c18c9d146eeb4f038cd101f92522fc26 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:18:54.340688 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1180/2344] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:18:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 12:18:54.354959 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947d03fc-98d7-4395-848b-c6f48f4f0f5c admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:54.358950 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-947d03fc-98d7-4395-848b-c6f48f4f0f5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:18:54.380378 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:18:54.513055 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947d03fc-98d7-4395-848b-c6f48f4f0f5c admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:54.521664 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff7a82e-4d78-4c84-8ece-d3c9b97f6b81 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37633bbae0c2423c81ccd61ac3a17ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:54.521897 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff7a82e-4d78-4c84-8ece-d3c9b97f6b81 service cinder] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:54.522278 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff7a82e-4d78-4c84-8ece-d3c9b97f6b81 service cinder] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:54.522698 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff7a82e-4d78-4c84-8ece-d3c9b97f6b81 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:54.626234 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff7a82e-4d78-4c84-8ece-d3c9b97f6b81 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:54.628084 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff7a82e-4d78-4c84-8ece-d3c9b97f6b81 service cinder] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:54.640840 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1165/2345] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:18:54 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:18:54.694695 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83225bac-a1a5-4355-a4ab-668ab325c2b0 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:54.696525 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-83225bac-a1a5-4355-a4ab-668ab325c2b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:18:54.844839 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83225bac-a1a5-4355-a4ab-668ab325c2b0 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:54.860934 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:18:54.930803 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac6912d-3dcc-4b5a-a161-c0cec70f0fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:54.931523 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac6912d-3dcc-4b5a-a161-c0cec70f0fe5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:54.931806 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac6912d-3dcc-4b5a-a161-c0cec70f0fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:54.932083 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac6912d-3dcc-4b5a-a161-c0cec70f0fe5 admin admin] PATH_INFO: `/v3/projects/9e6996a5a1f7457ebad4be025968bea5` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:54.933365 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac6912d-3dcc-4b5a-a161-c0cec70f0fe5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e6996a5a1f7457ebad4be025968bea5)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:54.935449 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac6912d-3dcc-4b5a-a161-c0cec70f0fe5 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:55.020120 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-dac6912d-3dcc-4b5a-a161-c0cec70f0fe5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e6996a5a1f7457ebad4be025968bea5', 'request_id': 'req-dac6912d-3dcc-4b5a-a161-c0cec70f0fe5'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:55.053552 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-dac6912d-3dcc-4b5a-a161-c0cec70f0fe5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e6996a5a1f7457ebad4be025968bea5', 'request_id': 'req-dac6912d-3dcc-4b5a-a161-c0cec70f0fe5'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:55.062596 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-dac6912d-3dcc-4b5a-a161-c0cec70f0fe5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e6996a5a1f7457ebad4be025968bea5', 'request_id': 'req-dac6912d-3dcc-4b5a-a161-c0cec70f0fe5'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:55.080789 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-dac6912d-3dcc-4b5a-a161-c0cec70f0fe5 admin admin] The token cache is being invalidate because project 9e6996a5a1f7457ebad4be025968bea5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:18:55.081528 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-dac6912d-3dcc-4b5a-a161-c0cec70f0fe5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:55.082492 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-dac6912d-3dcc-4b5a-a161-c0cec70f0fe5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:55.084563 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1181/2346] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 5 12:18:54 2022] DELETE /identity/v3/projects/9e6996a5a1f7457ebad4be025968bea5 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:18:55.089184 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff7a82e-4d78-4c84-8ece-d3c9b97f6b81 service cinder] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:55.102030 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff7a82e-4d78-4c84-8ece-d3c9b97f6b81 service cinder] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:55.187998 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b0c628-1bf7-41ca-bf9d-86d077b269d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:55.189427 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b0c628-1bf7-41ca-bf9d-86d077b269d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:55.189868 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b0c628-1bf7-41ca-bf9d-86d077b269d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:55.190356 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b0c628-1bf7-41ca-bf9d-86d077b269d4 admin admin] PATH_INFO: `/v3/users/eb40609937f84ee1b201bcd7e09c13eb` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:55.193024 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b0c628-1bf7-41ca-bf9d-86d077b269d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb40609937f84ee1b201bcd7e09c13eb)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:55.198489 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b0c628-1bf7-41ca-bf9d-86d077b269d4 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:55.284013 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-88b0c628-1bf7-41ca-bf9d-86d077b269d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb40609937f84ee1b201bcd7e09c13eb'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:55.285138 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-88b0c628-1bf7-41ca-bf9d-86d077b269d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb40609937f84ee1b201bcd7e09c13eb'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:55.296280 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-88b0c628-1bf7-41ca-bf9d-86d077b269d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb40609937f84ee1b201bcd7e09c13eb'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:55.297245 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-88b0c628-1bf7-41ca-bf9d-86d077b269d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb40609937f84ee1b201bcd7e09c13eb'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:55.306804 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:18:55.316717 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-88b0c628-1bf7-41ca-bf9d-86d077b269d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb40609937f84ee1b201bcd7e09c13eb'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:55.333227 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1166/2347] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 5 12:18:55 2022] DELETE /identity/v3/users/eb40609937f84ee1b201bcd7e09c13eb => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:18:55.774095 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac6912d-3dcc-4b5a-a161-c0cec70f0fe5 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:55.775732 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-dac6912d-3dcc-4b5a-a161-c0cec70f0fe5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:18:55.834489 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac6912d-3dcc-4b5a-a161-c0cec70f0fe5 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:55.917840 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b420c861-35c8-41ef-9163-6314c23ab522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:55.918562 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b420c861-35c8-41ef-9163-6314c23ab522 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:55.918845 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b420c861-35c8-41ef-9163-6314c23ab522 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:55.919120 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b420c861-35c8-41ef-9163-6314c23ab522 admin admin] PATH_INFO: `/v3/projects/07f2827fcb9643e7bb53871acc11b9b6` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:55.920399 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b420c861-35c8-41ef-9163-6314c23ab522 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07f2827fcb9643e7bb53871acc11b9b6)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:55.923669 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b420c861-35c8-41ef-9163-6314c23ab522 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:55.992546 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:18:55.999479 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-b420c861-35c8-41ef-9163-6314c23ab522 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07f2827fcb9643e7bb53871acc11b9b6', 'request_id': 'req-b420c861-35c8-41ef-9163-6314c23ab522'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:56.012006 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-b420c861-35c8-41ef-9163-6314c23ab522 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07f2827fcb9643e7bb53871acc11b9b6', 'request_id': 'req-b420c861-35c8-41ef-9163-6314c23ab522'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:56.019817 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-b420c861-35c8-41ef-9163-6314c23ab522 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07f2827fcb9643e7bb53871acc11b9b6', 'request_id': 'req-b420c861-35c8-41ef-9163-6314c23ab522'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:56.063115 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-b420c861-35c8-41ef-9163-6314c23ab522 admin admin] The token cache is being invalidate because project 07f2827fcb9643e7bb53871acc11b9b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:18:56.077342 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-b420c861-35c8-41ef-9163-6314c23ab522 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:56.077342 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-b420c861-35c8-41ef-9163-6314c23ab522 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:18:56.082565 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1182/2348] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 5 12:18:55 2022] DELETE /identity/v3/projects/07f2827fcb9643e7bb53871acc11b9b6 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:18:56.091814 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb02f73-bca8-4a75-a382-96f48affec95 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:56.092499 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb02f73-bca8-4a75-a382-96f48affec95 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:56.093109 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb02f73-bca8-4a75-a382-96f48affec95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:56.131629 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-5bb02f73-bca8-4a75-a382-96f48affec95 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:18:56.134693 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-5bb02f73-bca8-4a75-a382-96f48affec95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:18:56.247053 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1167/2349] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:18:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:18:56.254968 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f31190e-439f-4497-8787-f929911d4ce5 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:56.255456 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f31190e-439f-4497-8787-f929911d4ce5 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:56.256225 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f31190e-439f-4497-8787-f929911d4ce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:56.280446 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-2f31190e-439f-4497-8787-f929911d4ce5 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:18:56.281779 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-2f31190e-439f-4497-8787-f929911d4ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:18:56.291471 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1183/2350] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:18:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:18:56.295852 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb02f73-bca8-4a75-a382-96f48affec95 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:56.307643 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb02f73-bca8-4a75-a382-96f48affec95 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:56.314075 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb18c24-0669-4779-b3cd-60015efb6df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:56.314720 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb18c24-0669-4779-b3cd-60015efb6df5 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:56.315002 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb18c24-0669-4779-b3cd-60015efb6df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:56.315336 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb18c24-0669-4779-b3cd-60015efb6df5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:56.315955 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb18c24-0669-4779-b3cd-60015efb6df5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:18:56.316267 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb18c24-0669-4779-b3cd-60015efb6df5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:56.318005 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb18c24-0669-4779-b3cd-60015efb6df5 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:56.331912 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1168/2351] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Sep 5 12:18:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:18:56.336942 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f31190e-439f-4497-8787-f929911d4ce5 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:56.357054 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f31190e-439f-4497-8787-f929911d4ce5 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:56.357054 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897d5843-6171-4349-aee8-895870539fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:56.357054 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897d5843-6171-4349-aee8-895870539fb3 admin admin] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:56.357054 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897d5843-6171-4349-aee8-895870539fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:56.357758 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897d5843-6171-4349-aee8-895870539fb3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:56.357758 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897d5843-6171-4349-aee8-895870539fb3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:56.358030 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897d5843-6171-4349-aee8-895870539fb3 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:56.394522 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1184/2352] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 5 12:18:56 2022] POST /identity/v3/projects => generated 373 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 12:18:56.399142 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb18c24-0669-4779-b3cd-60015efb6df5 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:56.411186 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb18c24-0669-4779-b3cd-60015efb6df5 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:56.522039 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cab259-439d-4cd2-97a4-88a02cc3a4b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:56.523103 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cab259-439d-4cd2-97a4-88a02cc3a4b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:56.523569 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cab259-439d-4cd2-97a4-88a02cc3a4b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:56.524019 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cab259-439d-4cd2-97a4-88a02cc3a4b3 admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:56.525789 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cab259-439d-4cd2-97a4-88a02cc3a4b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:56.529645 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cab259-439d-4cd2-97a4-88a02cc3a4b3 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:56.574897 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1169/2353] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 5 12:18:56 2022] POST /identity/v3/users => generated 287 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:18:56.577075 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897d5843-6171-4349-aee8-895870539fb3 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:56.592962 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897d5843-6171-4349-aee8-895870539fb3 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:56.598041 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ac9620-1e80-4d6c-9731-97bc0717c834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:56.598906 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ac9620-1e80-4d6c-9731-97bc0717c834 admin admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:56.599082 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ac9620-1e80-4d6c-9731-97bc0717c834 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:56.599433 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ac9620-1e80-4d6c-9731-97bc0717c834 admin admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:56.600037 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ac9620-1e80-4d6c-9731-97bc0717c834 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:56.603047 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ac9620-1e80-4d6c-9731-97bc0717c834 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:56.617127 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1185/2354] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:18:56 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 12:18:56.622634 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cab259-439d-4cd2-97a4-88a02cc3a4b3 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:56.639889 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cab259-439d-4cd2-97a4-88a02cc3a4b3 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:56.651246 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebf1501-82bd-473b-a021-c33fd3e35a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:56.652544 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebf1501-82bd-473b-a021-c33fd3e35a04 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:56.653135 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebf1501-82bd-473b-a021-c33fd3e35a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:56.653614 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebf1501-82bd-473b-a021-c33fd3e35a04 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:56.655125 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebf1501-82bd-473b-a021-c33fd3e35a04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:56.657992 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebf1501-82bd-473b-a021-c33fd3e35a04 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:56.676434 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1170/2355] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:18:56 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:18:56.681912 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ac9620-1e80-4d6c-9731-97bc0717c834 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:56.704188 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ac9620-1e80-4d6c-9731-97bc0717c834 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:56.713628 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4b40b8-05ff-4a76-8c73-d139a40ecda7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:56.714802 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4b40b8-05ff-4a76-8c73-d139a40ecda7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:56.715299 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4b40b8-05ff-4a76-8c73-d139a40ecda7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:56.715798 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4b40b8-05ff-4a76-8c73-d139a40ecda7 admin admin] PATH_INFO: `/v3/projects/55c8314ca7794ef0af957541d674b55f/users/35168fd8c073412c86600441fd6c03b0/roles/ed72181e1403401facb77dcf33644757` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:56.746684 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4b40b8-05ff-4a76-8c73-d139a40ecda7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55c8314ca7794ef0af957541d674b55f, user_id=35168fd8c073412c86600441fd6c03b0, role_id=ed72181e1403401facb77dcf33644757)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:56.752653 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4b40b8-05ff-4a76-8c73-d139a40ecda7 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:56.787260 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1186/2356] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 5 12:18:56 2022] PUT /identity/v3/projects/55c8314ca7794ef0af957541d674b55f/users/35168fd8c073412c86600441fd6c03b0/roles/ed72181e1403401facb77dcf33644757 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:18:56.794753 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb959ad9-252a-47c2-b59e-06dc89fd8673 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:56.795048 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb959ad9-252a-47c2-b59e-06dc89fd8673 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:56.795302 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb959ad9-252a-47c2-b59e-06dc89fd8673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:56.826923 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-fb959ad9-252a-47c2-b59e-06dc89fd8673 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:18:56.829508 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-fb959ad9-252a-47c2-b59e-06dc89fd8673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:18:56.973631 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:18:57.048769 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1171/2357] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:18:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 12:18:57.061446 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4b40b8-05ff-4a76-8c73-d139a40ecda7 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:57.064558 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-0f4b40b8-05ff-4a76-8c73-d139a40ecda7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:18:57.241356 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4b40b8-05ff-4a76-8c73-d139a40ecda7 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:18:57.254842 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2edd3c-ed6b-4f77-8a77-02f7d904e18b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4994b4faa4ec4aa088f3dc32c9c5614d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:18:57.258519 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2edd3c-ed6b-4f77-8a77-02f7d904e18b service neutron] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:57.258895 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2edd3c-ed6b-4f77-8a77-02f7d904e18b service neutron] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:57.261349 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2edd3c-ed6b-4f77-8a77-02f7d904e18b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:57.282150 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2edd3c-ed6b-4f77-8a77-02f7d904e18b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:18:57.286777 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2edd3c-ed6b-4f77-8a77-02f7d904e18b service neutron] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:18:57.310384 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1187/2358] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:18:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:18:59.552500 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcf9b0a-5ce7-4338-943a-ee37cd05f096 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:18:59.553212 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcf9b0a-5ce7-4338-943a-ee37cd05f096 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:18:59.553758 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcf9b0a-5ce7-4338-943a-ee37cd05f096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:18:59.715428 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-4fcf9b0a-5ce7-4338-943a-ee37cd05f096 None None] MFA Rules not processed for user `35168fd8c073412c86600441fd6c03b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:18:59.717673 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-4fcf9b0a-5ce7-4338-943a-ee37cd05f096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:18:59.930090 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1172/2359] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:18:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 381 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:18:59.944765 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2edd3c-ed6b-4f77-8a77-02f7d904e18b service neutron] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:18:59.947348 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-ed2edd3c-ed6b-4f77-8a77-02f7d904e18b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:19:00.043880 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2edd3c-ed6b-4f77-8a77-02f7d904e18b service neutron] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:19:00.050637 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e716cfee-f997-459f-af93-4aaf98162b7e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37633bbae0c2423c81ccd61ac3a17ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:19:00.052004 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e716cfee-f997-459f-af93-4aaf98162b7e service cinder] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:19:00.052768 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e716cfee-f997-459f-af93-4aaf98162b7e service cinder] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:19:00.053560 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e716cfee-f997-459f-af93-4aaf98162b7e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:19:00.071064 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e716cfee-f997-459f-af93-4aaf98162b7e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:19:00.074737 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e716cfee-f997-459f-af93-4aaf98162b7e service cinder] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:19:00.093546 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1188/2360] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:18:59 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 12:19:01.935625 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47c168d-a13a-4dc8-b646-81bd8d0178c0 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:19:01.936929 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47c168d-a13a-4dc8-b646-81bd8d0178c0 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:19:01.937504 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47c168d-a13a-4dc8-b646-81bd8d0178c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:19:01.971135 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-f47c168d-a13a-4dc8-b646-81bd8d0178c0 None None] MFA Rules not processed for user `35168fd8c073412c86600441fd6c03b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:19:01.973901 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-f47c168d-a13a-4dc8-b646-81bd8d0178c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:19:01.993208 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1173/2361] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:19:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:19:07.171674 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e716cfee-f997-459f-af93-4aaf98162b7e service cinder] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:19:07.174267 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-e716cfee-f997-459f-af93-4aaf98162b7e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:19:07.202098 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e716cfee-f997-459f-af93-4aaf98162b7e service cinder] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:19:07.217024 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3fb9a5-71d3-4a64-b3f1-c0ecf7e4c2bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:19:07.218269 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3fb9a5-71d3-4a64-b3f1-c0ecf7e4c2bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:19:07.218771 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3fb9a5-71d3-4a64-b3f1-c0ecf7e4c2bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:19:07.220207 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3fb9a5-71d3-4a64-b3f1-c0ecf7e4c2bd admin admin] PATH_INFO: `/v3/users/74f3508c41f74e9eb98b6aef46f6afb2` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:19:07.222694 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3fb9a5-71d3-4a64-b3f1-c0ecf7e4c2bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=74f3508c41f74e9eb98b6aef46f6afb2)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:19:07.226637 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3fb9a5-71d3-4a64-b3f1-c0ecf7e4c2bd admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:19:07.238924 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:19:07.364828 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-4a3fb9a5-71d3-4a64-b3f1-c0ecf7e4c2bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74f3508c41f74e9eb98b6aef46f6afb2'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:19:07.365593 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-4a3fb9a5-71d3-4a64-b3f1-c0ecf7e4c2bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74f3508c41f74e9eb98b6aef46f6afb2'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:19:07.377544 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-4a3fb9a5-71d3-4a64-b3f1-c0ecf7e4c2bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74f3508c41f74e9eb98b6aef46f6afb2'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:19:07.378504 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-4a3fb9a5-71d3-4a64-b3f1-c0ecf7e4c2bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74f3508c41f74e9eb98b6aef46f6afb2'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:19:07.413320 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-4a3fb9a5-71d3-4a64-b3f1-c0ecf7e4c2bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74f3508c41f74e9eb98b6aef46f6afb2'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:19:07.450121 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1189/2362] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 5 12:19:07 2022] DELETE /identity/v3/users/74f3508c41f74e9eb98b6aef46f6afb2 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:19:07.456850 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ca3561-d658-45d7-81e4-5c639be0e101 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:19:07.457780 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ca3561-d658-45d7-81e4-5c639be0e101 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:19:07.457967 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ca3561-d658-45d7-81e4-5c639be0e101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:19:07.496981 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-48ca3561-d658-45d7-81e4-5c639be0e101 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:19:07.501003 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-48ca3561-d658-45d7-81e4-5c639be0e101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:19:07.636255 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1174/2363] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:19:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:19:07.658372 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3fb9a5-71d3-4a64-b3f1-c0ecf7e4c2bd admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:19:07.662224 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-4a3fb9a5-71d3-4a64-b3f1-c0ecf7e4c2bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:19:07.838018 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3fb9a5-71d3-4a64-b3f1-c0ecf7e4c2bd admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:19:07.848560 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5e2c98-abfa-4461-995c-8b8e20049b61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4994b4faa4ec4aa088f3dc32c9c5614d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:19:07.849642 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5e2c98-abfa-4461-995c-8b8e20049b61 service neutron] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:19:07.850210 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5e2c98-abfa-4461-995c-8b8e20049b61 service neutron] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:19:07.850729 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5e2c98-abfa-4461-995c-8b8e20049b61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:19:07.870246 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5e2c98-abfa-4461-995c-8b8e20049b61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:19:07.874557 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5e2c98-abfa-4461-995c-8b8e20049b61 service neutron] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:19:07.891810 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1190/2364] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:19:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 12:19:08.381388 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ca3561-d658-45d7-81e4-5c639be0e101 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:19:08.384075 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-48ca3561-d658-45d7-81e4-5c639be0e101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:19:08.435127 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ca3561-d658-45d7-81e4-5c639be0e101 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:19:08.448359 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720c88ae-243f-49dd-a47b-4344bf851840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:19:08.449070 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720c88ae-243f-49dd-a47b-4344bf851840 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:19:08.449355 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720c88ae-243f-49dd-a47b-4344bf851840 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:19:08.449613 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720c88ae-243f-49dd-a47b-4344bf851840 admin admin] PATH_INFO: `/v3/projects/0b33648f6060479f8ea0a2ad7497060a` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:19:08.451648 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720c88ae-243f-49dd-a47b-4344bf851840 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b33648f6060479f8ea0a2ad7497060a)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:19:08.453699 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720c88ae-243f-49dd-a47b-4344bf851840 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:19:08.570769 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-720c88ae-243f-49dd-a47b-4344bf851840 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b33648f6060479f8ea0a2ad7497060a', 'request_id': 'req-720c88ae-243f-49dd-a47b-4344bf851840'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:19:08.584462 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-720c88ae-243f-49dd-a47b-4344bf851840 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b33648f6060479f8ea0a2ad7497060a', 'request_id': 'req-720c88ae-243f-49dd-a47b-4344bf851840'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:19:08.596168 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-720c88ae-243f-49dd-a47b-4344bf851840 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b33648f6060479f8ea0a2ad7497060a', 'request_id': 'req-720c88ae-243f-49dd-a47b-4344bf851840'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:19:08.602828 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:19:08.615352 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-720c88ae-243f-49dd-a47b-4344bf851840 admin admin] The token cache is being invalidate because project 0b33648f6060479f8ea0a2ad7497060a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:19:08.615804 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-720c88ae-243f-49dd-a47b-4344bf851840 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:19:08.616693 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-720c88ae-243f-49dd-a47b-4344bf851840 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:19:08.621782 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1175/2365] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 5 12:19:08 2022] DELETE /identity/v3/projects/0b33648f6060479f8ea0a2ad7497060a => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:19:08.628034 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4925fa-f787-40b1-90f2-e3d96c27a062 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:19:08.628621 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4925fa-f787-40b1-90f2-e3d96c27a062 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:19:08.629389 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4925fa-f787-40b1-90f2-e3d96c27a062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:19:08.664974 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-1f4925fa-f787-40b1-90f2-e3d96c27a062 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:19:08.666525 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-1f4925fa-f787-40b1-90f2-e3d96c27a062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:19:08.767787 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1191/2366] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:19:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:19:08.780326 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae443d65-49f5-403a-ba86-54a70cf47a2c None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:19:08.780871 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae443d65-49f5-403a-ba86-54a70cf47a2c None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:19:08.781389 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae443d65-49f5-403a-ba86-54a70cf47a2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:19:08.811254 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-ae443d65-49f5-403a-ba86-54a70cf47a2c None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:19:08.813117 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-ae443d65-49f5-403a-ba86-54a70cf47a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:19:08.823234 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1176/2367] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:19:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:19:08.828815 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4925fa-f787-40b1-90f2-e3d96c27a062 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:19:08.842320 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4925fa-f787-40b1-90f2-e3d96c27a062 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:19:08.848453 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c016974c-ab2a-452c-a60a-abb7b61f2138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:19:08.849467 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c016974c-ab2a-452c-a60a-abb7b61f2138 admin admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:19:08.849934 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c016974c-ab2a-452c-a60a-abb7b61f2138 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:19:08.850296 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c016974c-ab2a-452c-a60a-abb7b61f2138 admin admin] PATH_INFO: `/v3/domains` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:19:08.851112 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c016974c-ab2a-452c-a60a-abb7b61f2138 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:19:08.851539 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c016974c-ab2a-452c-a60a-abb7b61f2138 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:19:08.853513 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c016974c-ab2a-452c-a60a-abb7b61f2138 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:19:08.877168 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1192/2368] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Sep 5 12:19:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:19:08.883385 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae443d65-49f5-403a-ba86-54a70cf47a2c None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:19:08.896412 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae443d65-49f5-403a-ba86-54a70cf47a2c None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:19:08.903291 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf2f240-44e5-4016-ab93-7b5f4b1be0c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:19:08.904747 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf2f240-44e5-4016-ab93-7b5f4b1be0c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:19:08.906588 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf2f240-44e5-4016-ab93-7b5f4b1be0c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:19:08.908119 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf2f240-44e5-4016-ab93-7b5f4b1be0c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:19:08.909766 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf2f240-44e5-4016-ab93-7b5f4b1be0c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:19:08.913239 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf2f240-44e5-4016-ab93-7b5f4b1be0c3 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:19:08.965027 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1177/2369] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 5 12:19:08 2022] POST /identity/v3/projects => generated 385 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:19:08.968860 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c016974c-ab2a-452c-a60a-abb7b61f2138 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:19:08.997143 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c016974c-ab2a-452c-a60a-abb7b61f2138 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:19:09.021530 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:19:09.119448 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720c48a1-1d01-42a7-9a9b-2d75484fb98f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:19:09.120801 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720c48a1-1d01-42a7-9a9b-2d75484fb98f admin admin] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:19:09.121572 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720c48a1-1d01-42a7-9a9b-2d75484fb98f admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:19:09.122137 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720c48a1-1d01-42a7-9a9b-2d75484fb98f admin admin] PATH_INFO: `/v3/users` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:19:09.124528 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720c48a1-1d01-42a7-9a9b-2d75484fb98f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:19:09.129334 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720c48a1-1d01-42a7-9a9b-2d75484fb98f admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:19:09.162388 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1193/2370] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 5 12:19:08 2022] POST /identity/v3/users => generated 293 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:19:09.166811 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf2f240-44e5-4016-ab93-7b5f4b1be0c3 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:19:09.178403 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf2f240-44e5-4016-ab93-7b5f4b1be0c3 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:19:09.184670 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a6a2f9-f6a3-4597-bba0-c8ca13986f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:19:09.185822 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a6a2f9-f6a3-4597-bba0-c8ca13986f3c admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:19:09.186099 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a6a2f9-f6a3-4597-bba0-c8ca13986f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:19:09.186369 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a6a2f9-f6a3-4597-bba0-c8ca13986f3c admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:19:09.187041 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a6a2f9-f6a3-4597-bba0-c8ca13986f3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:19:09.188739 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a6a2f9-f6a3-4597-bba0-c8ca13986f3c admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:19:09.207257 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720c48a1-1d01-42a7-9a9b-2d75484fb98f admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:19:09.216953 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1178/2371] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:19:09 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:19:09.219262 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720c48a1-1d01-42a7-9a9b-2d75484fb98f admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:19:09.230442 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064b217d-2402-45e6-874b-c6137eb54e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:19:09.232841 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064b217d-2402-45e6-874b-c6137eb54e15 admin admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:19:09.233542 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064b217d-2402-45e6-874b-c6137eb54e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:19:09.234164 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064b217d-2402-45e6-874b-c6137eb54e15 admin admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:19:09.236514 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064b217d-2402-45e6-874b-c6137eb54e15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:19:09.240586 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064b217d-2402-45e6-874b-c6137eb54e15 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:19:09.260185 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1194/2372] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:19:09 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:19:09.264205 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a6a2f9-f6a3-4597-bba0-c8ca13986f3c admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:19:09.275555 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a6a2f9-f6a3-4597-bba0-c8ca13986f3c admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:19:09.281221 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e75fb9c-f61d-4b98-9466-a521b32ed30b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:19:09.282071 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e75fb9c-f61d-4b98-9466-a521b32ed30b admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:19:09.282482 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e75fb9c-f61d-4b98-9466-a521b32ed30b admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:19:09.282732 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e75fb9c-f61d-4b98-9466-a521b32ed30b admin admin] PATH_INFO: `/v3/projects/2a381a8799a84dbeb1953fcd87b52096/users/7101851e4b3841e29cdc98c330e09d76/roles/ed72181e1403401facb77dcf33644757` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:19:09.304465 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e75fb9c-f61d-4b98-9466-a521b32ed30b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a381a8799a84dbeb1953fcd87b52096, user_id=7101851e4b3841e29cdc98c330e09d76, role_id=ed72181e1403401facb77dcf33644757)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:19:09.308332 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e75fb9c-f61d-4b98-9466-a521b32ed30b admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:19:09.337212 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1179/2373] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 5 12:19:09 2022] PUT /identity/v3/projects/2a381a8799a84dbeb1953fcd87b52096/users/7101851e4b3841e29cdc98c330e09d76/roles/ed72181e1403401facb77dcf33644757 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:19:09.342850 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5978ff-a7de-4c58-9de0-abd8c91ab6de None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:19:09.343272 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5978ff-a7de-4c58-9de0-abd8c91ab6de None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:19:09.343554 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5978ff-a7de-4c58-9de0-abd8c91ab6de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:19:09.387530 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-ee5978ff-a7de-4c58-9de0-abd8c91ab6de None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:19:09.388491 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-ee5978ff-a7de-4c58-9de0-abd8c91ab6de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:19:09.462406 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1195/2374] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:19:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:19:09.468536 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e75fb9c-f61d-4b98-9466-a521b32ed30b admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:19:09.470463 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-3e75fb9c-f61d-4b98-9466-a521b32ed30b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:19:09.538173 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e75fb9c-f61d-4b98-9466-a521b32ed30b admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:19:09.542795 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2909f47-92f4-4cf9-a70a-e0faa2815dd3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4994b4faa4ec4aa088f3dc32c9c5614d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:19:09.543429 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2909f47-92f4-4cf9-a70a-e0faa2815dd3 service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:19:09.543709 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2909f47-92f4-4cf9-a70a-e0faa2815dd3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:19:09.543980 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2909f47-92f4-4cf9-a70a-e0faa2815dd3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:19:09.554604 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2909f47-92f4-4cf9-a70a-e0faa2815dd3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:19:09.556867 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2909f47-92f4-4cf9-a70a-e0faa2815dd3 service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:19:09.568138 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1180/2375] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:19:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:19:10.723011 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5978ff-a7de-4c58-9de0-abd8c91ab6de None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:19:10.727808 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-ee5978ff-a7de-4c58-9de0-abd8c91ab6de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:19:10.759840 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5978ff-a7de-4c58-9de0-abd8c91ab6de None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:19:10.770193 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850a49dd-33d4-4abb-b56c-76f8609760ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4994b4faa4ec4aa088f3dc32c9c5614d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:19:10.771982 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850a49dd-33d4-4abb-b56c-76f8609760ad service neutron] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:19:10.772792 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850a49dd-33d4-4abb-b56c-76f8609760ad service neutron] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:19:10.773642 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850a49dd-33d4-4abb-b56c-76f8609760ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:19:10.779604 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-850a49dd-33d4-4abb-b56c-76f8609760ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:19:10.910249 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850a49dd-33d4-4abb-b56c-76f8609760ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:19:10.912832 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850a49dd-33d4-4abb-b56c-76f8609760ad service neutron] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:19:10.934040 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1196/2376] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:19:10 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 12:19:12.321145 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cfb1ee-7c15-4ca6-932d-4754d136f364 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:19:12.322949 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cfb1ee-7c15-4ca6-932d-4754d136f364 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:19:12.323583 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cfb1ee-7c15-4ca6-932d-4754d136f364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:19:12.375490 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-d8cfb1ee-7c15-4ca6-932d-4754d136f364 None None] MFA Rules not processed for user `95c65245dd614ebb9b9ebf2fcc620cea`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:19:12.377819 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-d8cfb1ee-7c15-4ca6-932d-4754d136f364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:19:12.492967 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1181/2377] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:19:12 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:19:18.550440 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc1675b-bc36-4a3a-80a0-0b6e2ec8f741 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:19:18.552400 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc1675b-bc36-4a3a-80a0-0b6e2ec8f741 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:19:18.553177 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc1675b-bc36-4a3a-80a0-0b6e2ec8f741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:19:18.630662 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-5cc1675b-bc36-4a3a-80a0-0b6e2ec8f741 None None] MFA Rules not processed for user `7101851e4b3841e29cdc98c330e09d76`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:19:18.632945 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-5cc1675b-bc36-4a3a-80a0-0b6e2ec8f741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:19:18.688795 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:19:18.807454 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1197/2378] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:19:18 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:19:18.809447 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cfb1ee-7c15-4ca6-932d-4754d136f364 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:19:18.831195 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cfb1ee-7c15-4ca6-932d-4754d136f364 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:19:18.840777 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852abbc8-2396-430c-aeff-45d142cc8874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:19:18.842351 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852abbc8-2396-430c-aeff-45d142cc8874 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:19:18.844159 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852abbc8-2396-430c-aeff-45d142cc8874 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:19:18.845135 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852abbc8-2396-430c-aeff-45d142cc8874 admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:19:18.846675 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852abbc8-2396-430c-aeff-45d142cc8874 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:19:18.850624 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852abbc8-2396-430c-aeff-45d142cc8874 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:19:18.902031 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1182/2379] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 5 12:19:18 2022] POST /identity/v3/projects => generated 385 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:19:18.909305 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc1675b-bc36-4a3a-80a0-0b6e2ec8f741 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:19:18.963896 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc1675b-bc36-4a3a-80a0-0b6e2ec8f741 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:19:19.160166 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c612d2-3631-47ef-9c9e-1c2b6f0d0357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:19:19.160789 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c612d2-3631-47ef-9c9e-1c2b6f0d0357 admin admin] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:19:19.161060 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c612d2-3631-47ef-9c9e-1c2b6f0d0357 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:19:19.161374 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c612d2-3631-47ef-9c9e-1c2b6f0d0357 admin admin] PATH_INFO: `/v3/users` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:19:19.162082 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c612d2-3631-47ef-9c9e-1c2b6f0d0357 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:19:19.167377 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c612d2-3631-47ef-9c9e-1c2b6f0d0357 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:19:19.198252 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1198/2380] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 5 12:19:18 2022] POST /identity/v3/users => generated 299 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:19:19.204888 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852abbc8-2396-430c-aeff-45d142cc8874 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:19:19.234933 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852abbc8-2396-430c-aeff-45d142cc8874 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:19:19.261535 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc5d248-79d5-4c74-9224-a3ff7528c3b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:19:19.263093 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc5d248-79d5-4c74-9224-a3ff7528c3b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:19:19.263789 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc5d248-79d5-4c74-9224-a3ff7528c3b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:19:19.264729 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc5d248-79d5-4c74-9224-a3ff7528c3b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:19:19.266752 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc5d248-79d5-4c74-9224-a3ff7528c3b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:19:19.278403 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc5d248-79d5-4c74-9224-a3ff7528c3b9 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:19:19.333161 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1183/2381] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:19:19 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:19:19.339622 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c612d2-3631-47ef-9c9e-1c2b6f0d0357 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:19:19.360180 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c612d2-3631-47ef-9c9e-1c2b6f0d0357 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:19:19.382078 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c4a862-d5c4-4324-bcbb-3fde14db3e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:19:19.382871 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c4a862-d5c4-4324-bcbb-3fde14db3e93 admin admin] REQUEST_METHOD: `PUT` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:19:19.383254 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c4a862-d5c4-4324-bcbb-3fde14db3e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:19:19.383595 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c4a862-d5c4-4324-bcbb-3fde14db3e93 admin admin] PATH_INFO: `/v3/projects/955438048d454f0fa1888c80353310b8/users/6136aca79fb64fe4af66933ac2e86768/roles/16e2ccc8bd1b497d8cee780c1c7df0d2` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:19:19.404720 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c4a862-d5c4-4324-bcbb-3fde14db3e93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=955438048d454f0fa1888c80353310b8, user_id=6136aca79fb64fe4af66933ac2e86768, role_id=16e2ccc8bd1b497d8cee780c1c7df0d2)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:19:19.408287 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c4a862-d5c4-4324-bcbb-3fde14db3e93 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:19:19.428076 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1199/2382] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 5 12:19:19 2022] PUT /identity/v3/projects/955438048d454f0fa1888c80353310b8/users/6136aca79fb64fe4af66933ac2e86768/roles/16e2ccc8bd1b497d8cee780c1c7df0d2 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:19:19.440294 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc5d248-79d5-4c74-9224-a3ff7528c3b9 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:19:19.466874 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:19:19.471443 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc5d248-79d5-4c74-9224-a3ff7528c3b9 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:19:19.621980 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f3ffde-77cb-4ef5-9178-2833a64b988f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:19:19.622628 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f3ffde-77cb-4ef5-9178-2833a64b988f admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:19:19.622910 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f3ffde-77cb-4ef5-9178-2833a64b988f admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:19:19.623185 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f3ffde-77cb-4ef5-9178-2833a64b988f admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:19:19.623857 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f3ffde-77cb-4ef5-9178-2833a64b988f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:19:19.625596 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f3ffde-77cb-4ef5-9178-2833a64b988f admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:19:19.640556 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1184/2383] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:19:19 2022] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:19:19.653033 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c4a862-d5c4-4324-bcbb-3fde14db3e93 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:19:19.678656 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c4a862-d5c4-4324-bcbb-3fde14db3e93 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:19:19.689678 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cba1e9-362c-4ee0-b874-a3fdf66cda38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:19:19.691012 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cba1e9-362c-4ee0-b874-a3fdf66cda38 admin admin] REQUEST_METHOD: `PUT` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:19:19.691345 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cba1e9-362c-4ee0-b874-a3fdf66cda38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:19:19.691720 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cba1e9-362c-4ee0-b874-a3fdf66cda38 admin admin] PATH_INFO: `/v3/projects/955438048d454f0fa1888c80353310b8/users/6136aca79fb64fe4af66933ac2e86768/roles/16e2ccc8bd1b497d8cee780c1c7df0d2` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:19:19.697559 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cba1e9-362c-4ee0-b874-a3fdf66cda38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=955438048d454f0fa1888c80353310b8, user_id=6136aca79fb64fe4af66933ac2e86768, role_id=16e2ccc8bd1b497d8cee780c1c7df0d2)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:19:19.702537 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cba1e9-362c-4ee0-b874-a3fdf66cda38 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:19:19.725049 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1200/2384] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 5 12:19:19 2022] PUT /identity/v3/projects/955438048d454f0fa1888c80353310b8/users/6136aca79fb64fe4af66933ac2e86768/roles/16e2ccc8bd1b497d8cee780c1c7df0d2 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:19:26.402326 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ec5ea3-dd41-4b00-8f7f-8cbcd379b8a5 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:19:26.403221 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ec5ea3-dd41-4b00-8f7f-8cbcd379b8a5 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:19:26.406505 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ec5ea3-dd41-4b00-8f7f-8cbcd379b8a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:19:26.456947 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-b9ec5ea3-dd41-4b00-8f7f-8cbcd379b8a5 None None] MFA Rules not processed for user `6136aca79fb64fe4af66933ac2e86768`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:19:26.459107 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-b9ec5ea3-dd41-4b00-8f7f-8cbcd379b8a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:19:26.607484 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1185/2385] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:19:26 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 12:19:26.619826 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cba1e9-362c-4ee0-b874-a3fdf66cda38 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:19:26.635193 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-46cba1e9-362c-4ee0-b874-a3fdf66cda38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:19:26.832153 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cba1e9-362c-4ee0-b874-a3fdf66cda38 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:19:26.839620 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b39a703-6e21-475a-8193-da22880cec6c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b08e831af84a658b0f5b28ad03e4f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:19:26.840307 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b39a703-6e21-475a-8193-da22880cec6c service glance] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:19:26.840575 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b39a703-6e21-475a-8193-da22880cec6c service glance] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:19:26.840846 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b39a703-6e21-475a-8193-da22880cec6c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:19:26.883007 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:19:26.981726 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b39a703-6e21-475a-8193-da22880cec6c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:19:26.984740 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b39a703-6e21-475a-8193-da22880cec6c service glance] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:19:27.011708 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1201/2386] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:19:26 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:19:27.311655 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa795a2-1d0f-4168-9802-4b8dc70010f0 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:19:27.312092 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa795a2-1d0f-4168-9802-4b8dc70010f0 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:19:27.312449 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa795a2-1d0f-4168-9802-4b8dc70010f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:19:27.340801 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-6fa795a2-1d0f-4168-9802-4b8dc70010f0 None None] MFA Rules not processed for user `bacc8ece8df24bf498c1d55ca2918224`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:19:27.350679 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-6fa795a2-1d0f-4168-9802-4b8dc70010f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:19:27.445660 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1186/2387] 10.222.0.50 () {58 vars in 1009 bytes} [Mon Sep 5 12:19:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:19:27.495018 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b39a703-6e21-475a-8193-da22880cec6c service glance] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:19:27.497512 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-8b39a703-6e21-475a-8193-da22880cec6c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:19:27.576097 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b39a703-6e21-475a-8193-da22880cec6c service glance] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:19:27.581415 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff96af0c-1530-45e1-acb8-c89aa3e00410 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2b32d58d964585a24e7c5784a8355f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:19:27.582073 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff96af0c-1530-45e1-acb8-c89aa3e00410 service swift] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:19:27.582352 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff96af0c-1530-45e1-acb8-c89aa3e00410 service swift] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:19:27.582622 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff96af0c-1530-45e1-acb8-c89aa3e00410 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:19:27.592391 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff96af0c-1530-45e1-acb8-c89aa3e00410 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:19:27.594074 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff96af0c-1530-45e1-acb8-c89aa3e00410 service swift] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:19:27.603110 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1202/2388] 10.222.0.50 () {60 vars in 1384 bytes} [Mon Sep 5 12:19:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 05 12:19:29.388385 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd805dd-c839-4261-a9f3-2697ff1778a2 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:19:29.389054 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd805dd-c839-4261-a9f3-2697ff1778a2 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:19:29.389054 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd805dd-c839-4261-a9f3-2697ff1778a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:19:29.442639 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-fdd805dd-c839-4261-a9f3-2697ff1778a2 None None] MFA Rules not processed for user `35168fd8c073412c86600441fd6c03b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:19:29.443964 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-fdd805dd-c839-4261-a9f3-2697ff1778a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:19:29.510566 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:19:29.617045 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1187/2389] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:19:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:19:37.599528 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=48 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:19:39.595247 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=11 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:19:40.941448 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037237e4-2089-41fd-9aab-b9b77049ea22 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:19:40.942114 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037237e4-2089-41fd-9aab-b9b77049ea22 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:19:40.942114 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037237e4-2089-41fd-9aab-b9b77049ea22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:19:40.963006 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-037237e4-2089-41fd-9aab-b9b77049ea22 None None] MFA Rules not processed for user `7101851e4b3841e29cdc98c330e09d76`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:19:40.964267 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-037237e4-2089-41fd-9aab-b9b77049ea22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:19:40.971657 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1203/2390] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:19:40 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:19:44.082258 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7f4820-7d01-4277-8882-39b339affa12 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:19:44.083150 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7f4820-7d01-4277-8882-39b339affa12 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:19:44.083150 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7f4820-7d01-4277-8882-39b339affa12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:19:44.105898 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-be7f4820-7d01-4277-8882-39b339affa12 None None] MFA Rules not processed for user `bacc8ece8df24bf498c1d55ca2918224`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:19:44.107157 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-be7f4820-7d01-4277-8882-39b339affa12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:19:44.115006 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1188/2391] 10.222.0.50 () {58 vars in 1009 bytes} [Mon Sep 5 12:19:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 12:19:44.136886 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037237e4-2089-41fd-9aab-b9b77049ea22 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:19:44.161862 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037237e4-2089-41fd-9aab-b9b77049ea22 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:19:44.175497 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d3ef9e-db99-44c7-8727-b5155331bda0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2b32d58d964585a24e7c5784a8355f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:19:44.179118 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d3ef9e-db99-44c7-8727-b5155331bda0 service swift] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:19:44.179633 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d3ef9e-db99-44c7-8727-b5155331bda0 service swift] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:19:44.180301 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d3ef9e-db99-44c7-8727-b5155331bda0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:19:44.192708 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d3ef9e-db99-44c7-8727-b5155331bda0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:19:44.195628 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d3ef9e-db99-44c7-8727-b5155331bda0 service swift] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:19:44.214207 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1204/2392] 10.222.0.50 () {60 vars in 1384 bytes} [Mon Sep 5 12:19:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 05 12:19:54.098763 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=3 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:19:54.204926 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=9 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:20:05.360670 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04de8719-9471-4be7-924d-1cce1fee0ab0 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:20:05.361190 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04de8719-9471-4be7-924d-1cce1fee0ab0 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:20:05.361389 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04de8719-9471-4be7-924d-1cce1fee0ab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:20:05.412013 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-04de8719-9471-4be7-924d-1cce1fee0ab0 None None] MFA Rules not processed for user `bacc8ece8df24bf498c1d55ca2918224`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:20:05.414452 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-04de8719-9471-4be7-924d-1cce1fee0ab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:20:05.433133 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1189/2393] 10.222.0.50 () {58 vars in 1009 bytes} [Mon Sep 5 12:20:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:20:05.436980 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d3ef9e-db99-44c7-8727-b5155331bda0 service swift] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:20:05.449777 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d3ef9e-db99-44c7-8727-b5155331bda0 service swift] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:20:05.455747 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41ea678-8599-4466-b186-f6bbb324a52c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2b32d58d964585a24e7c5784a8355f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:20:05.456467 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41ea678-8599-4466-b186-f6bbb324a52c service swift] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:20:05.456781 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41ea678-8599-4466-b186-f6bbb324a52c service swift] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:20:05.457340 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41ea678-8599-4466-b186-f6bbb324a52c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:20:05.468609 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41ea678-8599-4466-b186-f6bbb324a52c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:20:05.472011 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41ea678-8599-4466-b186-f6bbb324a52c service swift] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:20:05.486508 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1205/2394] 10.222.0.50 () {60 vars in 1384 bytes} [Mon Sep 5 12:20:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 05 12:20:06.004769 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4834aac7-3c46-489c-abfe-83c5bade04d2 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:20:06.005053 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4834aac7-3c46-489c-abfe-83c5bade04d2 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:20:06.005270 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4834aac7-3c46-489c-abfe-83c5bade04d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:20:06.028588 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-4834aac7-3c46-489c-abfe-83c5bade04d2 None None] MFA Rules not processed for user `bacc8ece8df24bf498c1d55ca2918224`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:20:06.030208 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-4834aac7-3c46-489c-abfe-83c5bade04d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:20:06.049128 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1190/2395] 10.222.0.50 () {58 vars in 1009 bytes} [Mon Sep 5 12:20:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:20:06.062694 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41ea678-8599-4466-b186-f6bbb324a52c service swift] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:20:06.078354 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41ea678-8599-4466-b186-f6bbb324a52c service swift] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:20:06.088511 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604f2d0e-0912-4c37-b7a8-3688008b93f6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2b32d58d964585a24e7c5784a8355f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:20:06.089164 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604f2d0e-0912-4c37-b7a8-3688008b93f6 service swift] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:20:06.089627 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604f2d0e-0912-4c37-b7a8-3688008b93f6 service swift] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:20:06.090083 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604f2d0e-0912-4c37-b7a8-3688008b93f6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:20:06.099628 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604f2d0e-0912-4c37-b7a8-3688008b93f6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:20:06.104934 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604f2d0e-0912-4c37-b7a8-3688008b93f6 service swift] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:20:06.116347 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1206/2396] 10.222.0.50 () {60 vars in 1384 bytes} [Mon Sep 5 12:20:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 05 12:20:06.348019 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4834aac7-3c46-489c-abfe-83c5bade04d2 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:20:06.349524 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-4834aac7-3c46-489c-abfe-83c5bade04d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:20:06.530303 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4834aac7-3c46-489c-abfe-83c5bade04d2 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:20:06.555545 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f5125c-cce4-4b16-a9c7-7de2c3fafa4b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5427d0752de4817b6aa25e28c2d9a30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:20:06.556495 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f5125c-cce4-4b16-a9c7-7de2c3fafa4b service placement] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:20:06.557985 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f5125c-cce4-4b16-a9c7-7de2c3fafa4b service placement] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:20:06.558459 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f5125c-cce4-4b16-a9c7-7de2c3fafa4b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:20:06.571789 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-16f5125c-cce4-4b16-a9c7-7de2c3fafa4b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:20:06.610735 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f5125c-cce4-4b16-a9c7-7de2c3fafa4b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:20:06.612721 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f5125c-cce4-4b16-a9c7-7de2c3fafa4b service placement] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:20:06.646946 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1191/2397] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:20:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:20:16.114300 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=12 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:20:16.629391 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=38 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:20:18.809904 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604f2d0e-0912-4c37-b7a8-3688008b93f6 service swift] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:20:18.945081 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604f2d0e-0912-4c37-b7a8-3688008b93f6 service swift] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:20:18.949442 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5665040-d24d-4a1e-b123-43393aa7a7fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4994b4faa4ec4aa088f3dc32c9c5614d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:20:18.950067 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5665040-d24d-4a1e-b123-43393aa7a7fd service neutron] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:20:18.950348 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5665040-d24d-4a1e-b123-43393aa7a7fd service neutron] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:20:18.950628 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5665040-d24d-4a1e-b123-43393aa7a7fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:20:18.960394 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5665040-d24d-4a1e-b123-43393aa7a7fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:20:18.961966 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5665040-d24d-4a1e-b123-43393aa7a7fd service neutron] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:20:18.976046 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1207/2398] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:20:18 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:20:20.946256 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0930d8-a005-42ca-84be-d0ab110ee7c3 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:20:20.946985 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0930d8-a005-42ca-84be-d0ab110ee7c3 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:20:20.946985 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0930d8-a005-42ca-84be-d0ab110ee7c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:20:20.987315 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-ee0930d8-a005-42ca-84be-d0ab110ee7c3 None None] MFA Rules not processed for user `b7dcead6e9584ab8949678016ed12335`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:20:20.989586 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-ee0930d8-a005-42ca-84be-d0ab110ee7c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:20:21.092098 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1192/2399] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:20:20 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:20:24.854847 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4b0549-f104-4dc5-b73d-3bc6e99a8e6e None None] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:20:24.856321 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4b0549-f104-4dc5-b73d-3bc6e99a8e6e None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:20:24.856694 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4b0549-f104-4dc5-b73d-3bc6e99a8e6e None None] PATH_INFO: `/` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:20:24.860216 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1208/2400] 10.222.0.50 () {54 vars in 921 bytes} [Mon Sep 5 12:20:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:20:24.864651 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecf43a9-2f41-4735-bf0a-8f7862226a82 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:20:24.865247 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecf43a9-2f41-4735-bf0a-8f7862226a82 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:20:24.865491 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecf43a9-2f41-4735-bf0a-8f7862226a82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:20:24.896288 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-5ecf43a9-2f41-4735-bf0a-8f7862226a82 None None] MFA Rules not processed for user `cb060ff495bc4abb83ff88992fb7be09`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:20:24.897928 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-5ecf43a9-2f41-4735-bf0a-8f7862226a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:20:25.000070 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1193/2401] 10.222.0.50 () {58 vars in 1018 bytes} [Mon Sep 5 12:20:24 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:20:25.015107 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4b0549-f104-4dc5-b73d-3bc6e99a8e6e None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:20:25.017609 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-ca4b0549-f104-4dc5-b73d-3bc6e99a8e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:20:25.049595 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4b0549-f104-4dc5-b73d-3bc6e99a8e6e None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:20:25.061408 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c09b5e-1c05-49be-a812-a65428590c87 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b08e831af84a658b0f5b28ad03e4f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:20:25.063334 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c09b5e-1c05-49be-a812-a65428590c87 service glance] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:20:25.064281 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c09b5e-1c05-49be-a812-a65428590c87 service glance] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:20:25.065721 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c09b5e-1c05-49be-a812-a65428590c87 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:20:25.084794 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c09b5e-1c05-49be-a812-a65428590c87 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:20:25.087694 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c09b5e-1c05-49be-a812-a65428590c87 service glance] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:20:25.103483 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1209/2402] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:20:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:20:25.245033 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d2c20b-2fa4-4dcc-bd54-bb691f206d35 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:20:25.245643 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d2c20b-2fa4-4dcc-bd54-bb691f206d35 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:20:25.246263 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d2c20b-2fa4-4dcc-bd54-bb691f206d35 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:20:25.248176 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1194/2403] 10.222.0.50 () {54 vars in 921 bytes} [Mon Sep 5 12:20:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:20:25.261431 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d41793-1f4e-4d17-bc4f-853c7768f0a5 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:20:25.270255 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d41793-1f4e-4d17-bc4f-853c7768f0a5 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:20:25.271418 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d41793-1f4e-4d17-bc4f-853c7768f0a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:20:25.351115 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-a3d41793-1f4e-4d17-bc4f-853c7768f0a5 None None] MFA Rules not processed for user `4994b4faa4ec4aa088f3dc32c9c5614d`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:20:25.358436 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-a3d41793-1f4e-4d17-bc4f-853c7768f0a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:20:25.402408 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1210/2404] 10.222.0.50 () {58 vars in 1018 bytes} [Mon Sep 5 12:20:25 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:20:25.413566 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d2c20b-2fa4-4dcc-bd54-bb691f206d35 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:20:25.438360 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d2c20b-2fa4-4dcc-bd54-bb691f206d35 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:20:25.453859 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4444e042-d278-4241-ad81-cde0cc8b5ad0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4994b4faa4ec4aa088f3dc32c9c5614d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:20:25.454724 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4444e042-d278-4241-ad81-cde0cc8b5ad0 service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:20:25.456955 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4444e042-d278-4241-ad81-cde0cc8b5ad0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:20:25.457740 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4444e042-d278-4241-ad81-cde0cc8b5ad0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:20:25.476780 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4444e042-d278-4241-ad81-cde0cc8b5ad0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:20:25.479373 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4444e042-d278-4241-ad81-cde0cc8b5ad0 service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:20:25.509670 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1195/2405] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:20:25 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:20:25.753494 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8c5334-ba3d-482b-8794-ad82d7a540ec None None] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:20:25.753773 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8c5334-ba3d-482b-8794-ad82d7a540ec None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:20:25.754052 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8c5334-ba3d-482b-8794-ad82d7a540ec None None] PATH_INFO: `/` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:20:25.755670 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1211/2406] 10.222.0.50 () {54 vars in 921 bytes} [Mon Sep 5 12:20:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:20:25.765581 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1d4873-70bc-4acc-a3f7-47c59c2e78b1 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:20:25.765875 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1d4873-70bc-4acc-a3f7-47c59c2e78b1 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:20:25.766422 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1d4873-70bc-4acc-a3f7-47c59c2e78b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:20:25.810285 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-2a1d4873-70bc-4acc-a3f7-47c59c2e78b1 None None] MFA Rules not processed for user `cb060ff495bc4abb83ff88992fb7be09`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:20:25.811906 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-2a1d4873-70bc-4acc-a3f7-47c59c2e78b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:20:25.835381 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1196/2407] 10.222.0.50 () {58 vars in 1018 bytes} [Mon Sep 5 12:20:25 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:20:25.864164 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8c5334-ba3d-482b-8794-ad82d7a540ec None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:20:25.908843 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8c5334-ba3d-482b-8794-ad82d7a540ec None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:20:25.924323 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42aa3957-048b-4ba2-83c0-442654ffe494 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4994b4faa4ec4aa088f3dc32c9c5614d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:20:25.925084 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aa3957-048b-4ba2-83c0-442654ffe494 service neutron] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:20:25.925350 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aa3957-048b-4ba2-83c0-442654ffe494 service neutron] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:20:25.925624 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aa3957-048b-4ba2-83c0-442654ffe494 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:20:25.947913 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42aa3957-048b-4ba2-83c0-442654ffe494 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:20:25.949438 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42aa3957-048b-4ba2-83c0-442654ffe494 service neutron] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:20:25.963300 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1212/2408] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:20:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:20:30.092625 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d74b4dc-6ada-42d4-9613-71c36d13b5a6 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:20:30.093149 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d74b4dc-6ada-42d4-9613-71c36d13b5a6 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:20:30.093261 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d74b4dc-6ada-42d4-9613-71c36d13b5a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:20:30.114233 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-0d74b4dc-6ada-42d4-9613-71c36d13b5a6 None None] MFA Rules not processed for user `bacc8ece8df24bf498c1d55ca2918224`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:20:30.115355 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-0d74b4dc-6ada-42d4-9613-71c36d13b5a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:20:30.123157 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1197/2409] 10.222.0.50 () {58 vars in 967 bytes} [Mon Sep 5 12:20:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:20:30.136816 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42aa3957-048b-4ba2-83c0-442654ffe494 service neutron] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:20:30.149806 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42aa3957-048b-4ba2-83c0-442654ffe494 service neutron] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:20:30.155268 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a08b9d-602b-4314-8cbd-39befa7ab51f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2b32d58d964585a24e7c5784a8355f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:20:30.156000 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a08b9d-602b-4314-8cbd-39befa7ab51f service swift] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:20:30.156359 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a08b9d-602b-4314-8cbd-39befa7ab51f service swift] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:20:30.156719 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a08b9d-602b-4314-8cbd-39befa7ab51f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:20:30.166895 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a08b9d-602b-4314-8cbd-39befa7ab51f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:20:30.168512 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a08b9d-602b-4314-8cbd-39befa7ab51f service swift] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:20:30.177391 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1213/2410] 10.222.0.50 () {60 vars in 1384 bytes} [Mon Sep 5 12:20:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 05 12:20:31.107189 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241ff998-7868-4d5b-924c-3db41dfb5694 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:20:31.107694 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241ff998-7868-4d5b-924c-3db41dfb5694 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:20:31.107785 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241ff998-7868-4d5b-924c-3db41dfb5694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:20:31.126632 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-241ff998-7868-4d5b-924c-3db41dfb5694 None None] MFA Rules not processed for user `bacc8ece8df24bf498c1d55ca2918224`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:20:31.127826 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-241ff998-7868-4d5b-924c-3db41dfb5694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:20:31.136115 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1198/2411] 10.222.0.50 () {58 vars in 1009 bytes} [Mon Sep 5 12:20:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:20:31.148485 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a08b9d-602b-4314-8cbd-39befa7ab51f service swift] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:20:31.159816 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a08b9d-602b-4314-8cbd-39befa7ab51f service swift] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:20:31.164886 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0a0af6-5055-4600-94e9-d47beb5acc3f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2b32d58d964585a24e7c5784a8355f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:20:31.165562 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0a0af6-5055-4600-94e9-d47beb5acc3f service swift] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:20:31.165818 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0a0af6-5055-4600-94e9-d47beb5acc3f service swift] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:20:31.166088 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0a0af6-5055-4600-94e9-d47beb5acc3f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:20:31.174564 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0a0af6-5055-4600-94e9-d47beb5acc3f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:20:31.176143 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0a0af6-5055-4600-94e9-d47beb5acc3f service swift] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:20:31.184549 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1214/2412] 10.222.0.50 () {60 vars in 1384 bytes} [Mon Sep 5 12:20:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 05 12:20:32.265141 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241ff998-7868-4d5b-924c-3db41dfb5694 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:20:32.267264 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-241ff998-7868-4d5b-924c-3db41dfb5694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:20:32.354787 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241ff998-7868-4d5b-924c-3db41dfb5694 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:20:32.361562 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208901b4-a651-4566-a2a0-1f6d3a959e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:20:32.362478 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208901b4-a651-4566-a2a0-1f6d3a959e30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:20:32.362914 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208901b4-a651-4566-a2a0-1f6d3a959e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:20:32.363340 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208901b4-a651-4566-a2a0-1f6d3a959e30 admin admin] PATH_INFO: `/v3/users/35168fd8c073412c86600441fd6c03b0` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:20:32.364740 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208901b4-a651-4566-a2a0-1f6d3a959e30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35168fd8c073412c86600441fd6c03b0)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:20:32.367307 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208901b4-a651-4566-a2a0-1f6d3a959e30 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:20:32.374581 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:20:32.440159 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-208901b4-a651-4566-a2a0-1f6d3a959e30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35168fd8c073412c86600441fd6c03b0'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:20:32.440945 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-208901b4-a651-4566-a2a0-1f6d3a959e30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35168fd8c073412c86600441fd6c03b0'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:20:32.449618 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-208901b4-a651-4566-a2a0-1f6d3a959e30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35168fd8c073412c86600441fd6c03b0'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:20:32.450321 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-208901b4-a651-4566-a2a0-1f6d3a959e30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35168fd8c073412c86600441fd6c03b0'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:20:32.472959 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-208901b4-a651-4566-a2a0-1f6d3a959e30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35168fd8c073412c86600441fd6c03b0'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:20:32.498759 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1199/2413] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 5 12:20:32 2022] DELETE /identity/v3/users/35168fd8c073412c86600441fd6c03b0 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:20:32.713876 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0a0af6-5055-4600-94e9-d47beb5acc3f service swift] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:20:32.726567 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0a0af6-5055-4600-94e9-d47beb5acc3f service swift] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:20:32.817791 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799474b2-9def-49ae-a1ff-e99ad5478ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:20:32.818517 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799474b2-9def-49ae-a1ff-e99ad5478ec3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:20:32.818801 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799474b2-9def-49ae-a1ff-e99ad5478ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:20:32.819152 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799474b2-9def-49ae-a1ff-e99ad5478ec3 admin admin] PATH_INFO: `/v3/projects/55c8314ca7794ef0af957541d674b55f` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:20:32.820975 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799474b2-9def-49ae-a1ff-e99ad5478ec3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55c8314ca7794ef0af957541d674b55f)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:20:32.823744 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799474b2-9def-49ae-a1ff-e99ad5478ec3 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:20:32.886717 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:20:32.891569 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-799474b2-9def-49ae-a1ff-e99ad5478ec3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55c8314ca7794ef0af957541d674b55f', 'request_id': 'req-799474b2-9def-49ae-a1ff-e99ad5478ec3'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:20:32.903070 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-799474b2-9def-49ae-a1ff-e99ad5478ec3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55c8314ca7794ef0af957541d674b55f', 'request_id': 'req-799474b2-9def-49ae-a1ff-e99ad5478ec3'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:20:32.910215 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-799474b2-9def-49ae-a1ff-e99ad5478ec3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55c8314ca7794ef0af957541d674b55f', 'request_id': 'req-799474b2-9def-49ae-a1ff-e99ad5478ec3'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:20:32.925882 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-799474b2-9def-49ae-a1ff-e99ad5478ec3 admin admin] The token cache is being invalidate because project 55c8314ca7794ef0af957541d674b55f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:20:32.926293 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-799474b2-9def-49ae-a1ff-e99ad5478ec3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:20:32.927084 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-799474b2-9def-49ae-a1ff-e99ad5478ec3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:20:32.928641 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1215/2414] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 5 12:20:32 2022] DELETE /identity/v3/projects/55c8314ca7794ef0af957541d674b55f => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:20:42.489660 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=24,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:20:42.921785 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:DELETE=4,keystone:SELECT=7,keystone:INSERT=1 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:20:48.360394 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca26b495-0adb-4379-9743-272b2ef7eff5 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:20:48.361550 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca26b495-0adb-4379-9743-272b2ef7eff5 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:20:48.361550 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca26b495-0adb-4379-9743-272b2ef7eff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:20:48.392047 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-ca26b495-0adb-4379-9743-272b2ef7eff5 None None] MFA Rules not processed for user `bacc8ece8df24bf498c1d55ca2918224`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:20:48.393338 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-ca26b495-0adb-4379-9743-272b2ef7eff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:20:48.458619 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1200/2415] 10.222.0.50 () {58 vars in 967 bytes} [Mon Sep 5 12:20:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:20:48.472088 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799474b2-9def-49ae-a1ff-e99ad5478ec3 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:20:48.473524 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-799474b2-9def-49ae-a1ff-e99ad5478ec3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:20:48.564013 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799474b2-9def-49ae-a1ff-e99ad5478ec3 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:20:48.569308 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d9f09e-0736-4b78-9589-ef9be9b9ca6b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2b32d58d964585a24e7c5784a8355f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:20:48.569940 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d9f09e-0736-4b78-9589-ef9be9b9ca6b service swift] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:20:48.570224 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d9f09e-0736-4b78-9589-ef9be9b9ca6b service swift] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:20:48.570506 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d9f09e-0736-4b78-9589-ef9be9b9ca6b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:20:48.585207 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d9f09e-0736-4b78-9589-ef9be9b9ca6b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:20:48.586832 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d9f09e-0736-4b78-9589-ef9be9b9ca6b service swift] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:20:48.596247 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1216/2416] 10.222.0.50 () {60 vars in 1384 bytes} [Mon Sep 5 12:20:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 05 12:20:50.630198 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad90a81-c26b-4cf3-85a7-b7d7b288251a None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:20:50.630739 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad90a81-c26b-4cf3-85a7-b7d7b288251a None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:20:50.630834 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad90a81-c26b-4cf3-85a7-b7d7b288251a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:20:50.656147 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-dad90a81-c26b-4cf3-85a7-b7d7b288251a None None] MFA Rules not processed for user `95c65245dd614ebb9b9ebf2fcc620cea`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:20:50.657556 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-dad90a81-c26b-4cf3-85a7-b7d7b288251a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:20:50.713890 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1201/2417] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:20:50 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:20:58.592249 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=32 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:21:00.706510 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=50 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:21:45.529530 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a217a6-3cb4-48de-ac60-4be8ca53c03c None None] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:21:45.530126 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a217a6-3cb4-48de-ac60-4be8ca53c03c None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:21:45.530126 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a217a6-3cb4-48de-ac60-4be8ca53c03c None None] PATH_INFO: `/` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:21:45.531778 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1217/2418] 10.222.0.50 () {54 vars in 921 bytes} [Mon Sep 5 12:21:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:21:45.540464 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688d53e6-75a2-4753-a0fc-3d40a96338cc None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:21:45.541236 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688d53e6-75a2-4753-a0fc-3d40a96338cc None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:21:45.542025 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688d53e6-75a2-4753-a0fc-3d40a96338cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:21:45.638439 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-688d53e6-75a2-4753-a0fc-3d40a96338cc None None] MFA Rules not processed for user `4994b4faa4ec4aa088f3dc32c9c5614d`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:21:45.641631 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-688d53e6-75a2-4753-a0fc-3d40a96338cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:21:45.721082 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1202/2419] 10.222.0.50 () {58 vars in 1018 bytes} [Mon Sep 5 12:21:45 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:21:45.734666 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a217a6-3cb4-48de-ac60-4be8ca53c03c None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:21:45.736834 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-83a217a6-3cb4-48de-ac60-4be8ca53c03c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:21:45.751826 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a217a6-3cb4-48de-ac60-4be8ca53c03c None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:21:45.762991 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe443807-396f-4aae-8354-cef0a109239b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4994b4faa4ec4aa088f3dc32c9c5614d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:21:45.763586 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe443807-396f-4aae-8354-cef0a109239b service neutron] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:21:45.763867 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe443807-396f-4aae-8354-cef0a109239b service neutron] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:21:45.764168 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe443807-396f-4aae-8354-cef0a109239b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:21:45.784416 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe443807-396f-4aae-8354-cef0a109239b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:21:45.786049 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe443807-396f-4aae-8354-cef0a109239b service neutron] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:21:45.823601 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1218/2420] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:21:45 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 12:21:45.992989 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae96d3a-d623-4814-85e2-735b96f98c75 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:21:45.993274 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae96d3a-d623-4814-85e2-735b96f98c75 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:21:45.993526 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae96d3a-d623-4814-85e2-735b96f98c75 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:21:45.995181 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1203/2421] 10.222.0.50 () {54 vars in 921 bytes} [Mon Sep 5 12:21:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:21:46.004337 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ebf79f-9f47-4cb4-af57-83d3717c8455 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:21:46.004621 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ebf79f-9f47-4cb4-af57-83d3717c8455 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:21:46.005159 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ebf79f-9f47-4cb4-af57-83d3717c8455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:21:46.069071 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-f8ebf79f-9f47-4cb4-af57-83d3717c8455 None None] MFA Rules not processed for user `cb060ff495bc4abb83ff88992fb7be09`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:21:46.071963 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-f8ebf79f-9f47-4cb4-af57-83d3717c8455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:21:46.175433 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1219/2422] 10.222.0.50 () {58 vars in 1018 bytes} [Mon Sep 5 12:21:46 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:21:46.189732 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae96d3a-d623-4814-85e2-735b96f98c75 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:21:46.191632 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-8ae96d3a-d623-4814-85e2-735b96f98c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:21:46.210437 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae96d3a-d623-4814-85e2-735b96f98c75 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:21:46.215537 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacec4f4-5f18-4c38-a458-df762b917fd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4994b4faa4ec4aa088f3dc32c9c5614d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:21:46.216167 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacec4f4-5f18-4c38-a458-df762b917fd6 service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:21:46.216446 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacec4f4-5f18-4c38-a458-df762b917fd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:21:46.216720 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacec4f4-5f18-4c38-a458-df762b917fd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:21:46.234040 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacec4f4-5f18-4c38-a458-df762b917fd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:21:46.237190 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacec4f4-5f18-4c38-a458-df762b917fd6 service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:21:46.259831 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1204/2423] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:21:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:21:47.766134 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c4db02-c0ea-49a6-893b-ec7b137daa0d None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:21:47.767766 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c4db02-c0ea-49a6-893b-ec7b137daa0d None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:21:47.768055 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c4db02-c0ea-49a6-893b-ec7b137daa0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:21:47.795848 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-48c4db02-c0ea-49a6-893b-ec7b137daa0d None None] MFA Rules not processed for user `09f4ccac184d43b7a519471316dd28b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:21:47.797359 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-48c4db02-c0ea-49a6-893b-ec7b137daa0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:21:47.872334 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1220/2424] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:21:47 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:21:49.093058 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9cdb10-4962-473f-812b-f7bd9a65634e None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:21:49.093545 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9cdb10-4962-473f-812b-f7bd9a65634e None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:21:49.093632 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9cdb10-4962-473f-812b-f7bd9a65634e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:21:49.115167 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-ba9cdb10-4962-473f-812b-f7bd9a65634e None None] MFA Rules not processed for user `b7dcead6e9584ab8949678016ed12335`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:21:49.117589 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-ba9cdb10-4962-473f-812b-f7bd9a65634e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:21:49.190044 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1205/2425] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:21:49 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:21:57.864292 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=62 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:21:59.176380 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=54 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:21:59.267228 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c4db02-c0ea-49a6-893b-ec7b137daa0d None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:21:59.305995 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c4db02-c0ea-49a6-893b-ec7b137daa0d None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:21:59.318686 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379ac13d-4b5f-49c2-b119-4b8a3cecdbfc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4994b4faa4ec4aa088f3dc32c9c5614d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:21:59.321158 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379ac13d-4b5f-49c2-b119-4b8a3cecdbfc service neutron] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:21:59.323941 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379ac13d-4b5f-49c2-b119-4b8a3cecdbfc service neutron] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:21:59.325781 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379ac13d-4b5f-49c2-b119-4b8a3cecdbfc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:21:59.332119 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-379ac13d-4b5f-49c2-b119-4b8a3cecdbfc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:21:59.350678 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379ac13d-4b5f-49c2-b119-4b8a3cecdbfc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:21:59.356193 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379ac13d-4b5f-49c2-b119-4b8a3cecdbfc service neutron] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:21:59.372343 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1221/2426] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:21:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 12:21:59.833045 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9cdb10-4962-473f-812b-f7bd9a65634e None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:21:59.843025 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9cdb10-4962-473f-812b-f7bd9a65634e None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:21:59.846836 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7104ed-b143-4c33-8c1f-812d67e304a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4994b4faa4ec4aa088f3dc32c9c5614d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:21:59.847566 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7104ed-b143-4c33-8c1f-812d67e304a9 service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:21:59.847830 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7104ed-b143-4c33-8c1f-812d67e304a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:21:59.848221 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7104ed-b143-4c33-8c1f-812d67e304a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:21:59.850374 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-2f7104ed-b143-4c33-8c1f-812d67e304a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:21:59.865360 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7104ed-b143-4c33-8c1f-812d67e304a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:21:59.866898 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7104ed-b143-4c33-8c1f-812d67e304a9 service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:21:59.881801 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1206/2427] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:21:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:22:03.714389 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379ac13d-4b5f-49c2-b119-4b8a3cecdbfc service neutron] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:22:03.724263 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379ac13d-4b5f-49c2-b119-4b8a3cecdbfc service neutron] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:22:03.728051 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200ed3d9-63a5-4e65-a11f-c7d9a3e8c758 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4994b4faa4ec4aa088f3dc32c9c5614d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:22:03.729341 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200ed3d9-63a5-4e65-a11f-c7d9a3e8c758 service neutron] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:22:03.729626 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200ed3d9-63a5-4e65-a11f-c7d9a3e8c758 service neutron] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:22:03.729901 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200ed3d9-63a5-4e65-a11f-c7d9a3e8c758 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:22:03.731748 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-200ed3d9-63a5-4e65-a11f-c7d9a3e8c758 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:22:03.822367 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200ed3d9-63a5-4e65-a11f-c7d9a3e8c758 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:22:03.825146 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200ed3d9-63a5-4e65-a11f-c7d9a3e8c758 service neutron] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:22:03.849299 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1222/2428] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:22:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:22:08.738238 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7104ed-b143-4c33-8c1f-812d67e304a9 service neutron] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:22:08.739970 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-2f7104ed-b143-4c33-8c1f-812d67e304a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:22:08.761159 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7104ed-b143-4c33-8c1f-812d67e304a9 service neutron] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:22:08.771613 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6db8763-fe29-41c9-ab00-6ae6512200b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:22:08.773261 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6db8763-fe29-41c9-ab00-6ae6512200b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:22:08.774127 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6db8763-fe29-41c9-ab00-6ae6512200b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:22:08.774822 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6db8763-fe29-41c9-ab00-6ae6512200b5 admin admin] PATH_INFO: `/v3/users/95c65245dd614ebb9b9ebf2fcc620cea` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:22:08.780031 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6db8763-fe29-41c9-ab00-6ae6512200b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95c65245dd614ebb9b9ebf2fcc620cea)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:22:08.784110 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6db8763-fe29-41c9-ab00-6ae6512200b5 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:22:08.893932 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-b6db8763-fe29-41c9-ab00-6ae6512200b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95c65245dd614ebb9b9ebf2fcc620cea'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:22:08.894768 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-b6db8763-fe29-41c9-ab00-6ae6512200b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95c65245dd614ebb9b9ebf2fcc620cea'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:22:08.906432 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-b6db8763-fe29-41c9-ab00-6ae6512200b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95c65245dd614ebb9b9ebf2fcc620cea'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:22:08.907481 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-b6db8763-fe29-41c9-ab00-6ae6512200b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95c65245dd614ebb9b9ebf2fcc620cea'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:22:08.933370 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-b6db8763-fe29-41c9-ab00-6ae6512200b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95c65245dd614ebb9b9ebf2fcc620cea'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:22:08.956102 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1207/2429] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 5 12:22:08 2022] DELETE /identity/v3/users/95c65245dd614ebb9b9ebf2fcc620cea => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:22:09.482337 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200ed3d9-63a5-4e65-a11f-c7d9a3e8c758 service neutron] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:22:09.499131 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200ed3d9-63a5-4e65-a11f-c7d9a3e8c758 service neutron] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:22:09.625030 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dee1c7-1721-4d54-8957-cc425c660da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:22:09.625683 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dee1c7-1721-4d54-8957-cc425c660da1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:22:09.625956 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dee1c7-1721-4d54-8957-cc425c660da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:22:09.626234 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dee1c7-1721-4d54-8957-cc425c660da1 admin admin] PATH_INFO: `/v3/projects/f400bce0b7b948daa162431f575193fc` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:22:09.627411 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dee1c7-1721-4d54-8957-cc425c660da1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f400bce0b7b948daa162431f575193fc)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:22:09.629432 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dee1c7-1721-4d54-8957-cc425c660da1 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:22:09.698134 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-58dee1c7-1721-4d54-8957-cc425c660da1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f400bce0b7b948daa162431f575193fc', 'request_id': 'req-58dee1c7-1721-4d54-8957-cc425c660da1'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:22:09.712222 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-58dee1c7-1721-4d54-8957-cc425c660da1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f400bce0b7b948daa162431f575193fc', 'request_id': 'req-58dee1c7-1721-4d54-8957-cc425c660da1'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:22:09.720565 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-58dee1c7-1721-4d54-8957-cc425c660da1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f400bce0b7b948daa162431f575193fc', 'request_id': 'req-58dee1c7-1721-4d54-8957-cc425c660da1'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:22:09.738873 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-58dee1c7-1721-4d54-8957-cc425c660da1 admin admin] The token cache is being invalidate because project f400bce0b7b948daa162431f575193fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:22:09.739164 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-58dee1c7-1721-4d54-8957-cc425c660da1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:22:09.739882 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-58dee1c7-1721-4d54-8957-cc425c660da1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:22:09.741603 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1223/2430] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 5 12:22:09 2022] DELETE /identity/v3/projects/f400bce0b7b948daa162431f575193fc => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:22:09.747154 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5991af14-2b10-4ae1-b1a4-84ce70bc4162 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:22:09.747718 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5991af14-2b10-4ae1-b1a4-84ce70bc4162 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:22:09.747718 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5991af14-2b10-4ae1-b1a4-84ce70bc4162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:22:09.770595 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-5991af14-2b10-4ae1-b1a4-84ce70bc4162 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:22:09.772189 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-5991af14-2b10-4ae1-b1a4-84ce70bc4162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:22:09.883025 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1208/2431] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:22:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:22:09.895492 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1256b7c6-f184-4798-9dd2-acd188ff8582 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:22:09.895973 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1256b7c6-f184-4798-9dd2-acd188ff8582 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:22:09.896454 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1256b7c6-f184-4798-9dd2-acd188ff8582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:22:09.951712 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-1256b7c6-f184-4798-9dd2-acd188ff8582 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:22:09.959295 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-1256b7c6-f184-4798-9dd2-acd188ff8582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:22:09.975333 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1224/2432] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:22:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:22:09.981824 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5991af14-2b10-4ae1-b1a4-84ce70bc4162 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:22:10.000828 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5991af14-2b10-4ae1-b1a4-84ce70bc4162 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:22:10.010679 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2af3627-6a59-47c6-bc4d-6ffc956b9241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:22:10.013267 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2af3627-6a59-47c6-bc4d-6ffc956b9241 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:22:10.014371 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2af3627-6a59-47c6-bc4d-6ffc956b9241 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:22:10.015255 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2af3627-6a59-47c6-bc4d-6ffc956b9241 admin admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:22:10.016753 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2af3627-6a59-47c6-bc4d-6ffc956b9241 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:22:10.017340 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2af3627-6a59-47c6-bc4d-6ffc956b9241 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:22:10.020489 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2af3627-6a59-47c6-bc4d-6ffc956b9241 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:22:10.050015 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1209/2433] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Sep 5 12:22:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:22:10.057406 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1256b7c6-f184-4798-9dd2-acd188ff8582 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:22:10.067649 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:22:10.075542 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1256b7c6-f184-4798-9dd2-acd188ff8582 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:22:10.083793 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47d264e-5dde-41e5-aa5a-109c77cf29b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:22:10.084926 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47d264e-5dde-41e5-aa5a-109c77cf29b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:22:10.085454 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47d264e-5dde-41e5-aa5a-109c77cf29b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:22:10.086501 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47d264e-5dde-41e5-aa5a-109c77cf29b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:22:10.087601 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47d264e-5dde-41e5-aa5a-109c77cf29b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:22:10.090859 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47d264e-5dde-41e5-aa5a-109c77cf29b8 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:22:10.127972 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1225/2434] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 5 12:22:10 2022] POST /identity/v3/projects => generated 377 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 12:22:10.129677 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2af3627-6a59-47c6-bc4d-6ffc956b9241 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:22:10.142550 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2af3627-6a59-47c6-bc4d-6ffc956b9241 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:22:10.219660 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:22:10.241564 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2324be25-f936-471b-8f87-c4e8983597fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:22:10.242300 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2324be25-f936-471b-8f87-c4e8983597fa admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:22:10.242744 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2324be25-f936-471b-8f87-c4e8983597fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:22:10.243080 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2324be25-f936-471b-8f87-c4e8983597fa admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:22:10.244283 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2324be25-f936-471b-8f87-c4e8983597fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:22:10.248272 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2324be25-f936-471b-8f87-c4e8983597fa admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:22:10.298642 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1210/2435] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 5 12:22:10 2022] POST /identity/v3/users => generated 289 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:22:10.305544 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47d264e-5dde-41e5-aa5a-109c77cf29b8 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:22:10.329630 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47d264e-5dde-41e5-aa5a-109c77cf29b8 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:22:10.340304 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffed0f9-59fb-4bba-9ec2-bd055ec0e20b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:22:10.342445 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffed0f9-59fb-4bba-9ec2-bd055ec0e20b admin admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:22:10.343370 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffed0f9-59fb-4bba-9ec2-bd055ec0e20b admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:22:10.344292 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffed0f9-59fb-4bba-9ec2-bd055ec0e20b admin admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:22:10.345876 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffed0f9-59fb-4bba-9ec2-bd055ec0e20b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:22:10.349414 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffed0f9-59fb-4bba-9ec2-bd055ec0e20b admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:22:10.371623 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1226/2436] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:22:10 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 12:22:10.376100 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2324be25-f936-471b-8f87-c4e8983597fa admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:22:10.392144 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2324be25-f936-471b-8f87-c4e8983597fa admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:22:10.403851 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb619d7-9f41-4908-87c2-b6d04261b281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:22:10.404391 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb619d7-9f41-4908-87c2-b6d04261b281 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:22:10.404678 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb619d7-9f41-4908-87c2-b6d04261b281 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:22:10.404986 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb619d7-9f41-4908-87c2-b6d04261b281 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:22:10.405680 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb619d7-9f41-4908-87c2-b6d04261b281 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:22:10.407468 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb619d7-9f41-4908-87c2-b6d04261b281 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:22:10.422921 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1211/2437] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:22:10 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 12:22:10.433296 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffed0f9-59fb-4bba-9ec2-bd055ec0e20b admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:22:10.448452 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffed0f9-59fb-4bba-9ec2-bd055ec0e20b admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:22:10.453788 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4686e009-1f98-4a57-b4fc-d19735cca2d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:22:10.454494 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4686e009-1f98-4a57-b4fc-d19735cca2d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:22:10.454785 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4686e009-1f98-4a57-b4fc-d19735cca2d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:22:10.455067 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4686e009-1f98-4a57-b4fc-d19735cca2d4 admin admin] PATH_INFO: `/v3/projects/439a9c1d9bf04c0f86fed3fc93e67e40/users/60c08df8e0b34c568b2d1f740947f6f4/roles/ed72181e1403401facb77dcf33644757` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:22:10.476546 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4686e009-1f98-4a57-b4fc-d19735cca2d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=439a9c1d9bf04c0f86fed3fc93e67e40, user_id=60c08df8e0b34c568b2d1f740947f6f4, role_id=ed72181e1403401facb77dcf33644757)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:22:10.479404 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4686e009-1f98-4a57-b4fc-d19735cca2d4 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:22:10.497678 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1227/2438] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 5 12:22:10 2022] PUT /identity/v3/projects/439a9c1d9bf04c0f86fed3fc93e67e40/users/60c08df8e0b34c568b2d1f740947f6f4/roles/ed72181e1403401facb77dcf33644757 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:22:10.505527 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797efa44-fb95-4f1d-b222-1cee9a24dcb2 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:22:10.505824 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797efa44-fb95-4f1d-b222-1cee9a24dcb2 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:22:10.506125 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797efa44-fb95-4f1d-b222-1cee9a24dcb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:22:10.529251 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-797efa44-fb95-4f1d-b222-1cee9a24dcb2 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:22:10.530619 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-797efa44-fb95-4f1d-b222-1cee9a24dcb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:22:10.643820 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1212/2439] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:22:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:22:10.651252 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4686e009-1f98-4a57-b4fc-d19735cca2d4 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:22:10.655174 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-4686e009-1f98-4a57-b4fc-d19735cca2d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:22:10.790220 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4686e009-1f98-4a57-b4fc-d19735cca2d4 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:22:10.795647 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad40e031-1958-40cd-b1b2-94c6db54ec2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4994b4faa4ec4aa088f3dc32c9c5614d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:22:10.796307 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad40e031-1958-40cd-b1b2-94c6db54ec2d service neutron] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:22:10.796594 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad40e031-1958-40cd-b1b2-94c6db54ec2d service neutron] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:22:10.796879 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad40e031-1958-40cd-b1b2-94c6db54ec2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:22:10.810354 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad40e031-1958-40cd-b1b2-94c6db54ec2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:22:10.811886 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad40e031-1958-40cd-b1b2-94c6db54ec2d service neutron] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:22:10.824205 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1228/2440] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:22:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:22:10.917766 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b1756c-4d1f-4e34-8cd5-19477ca3a8d6 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:22:10.918286 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b1756c-4d1f-4e34-8cd5-19477ca3a8d6 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:22:10.918396 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b1756c-4d1f-4e34-8cd5-19477ca3a8d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:22:10.941754 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-f6b1756c-4d1f-4e34-8cd5-19477ca3a8d6 None None] MFA Rules not processed for user `bacc8ece8df24bf498c1d55ca2918224`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:22:10.943036 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-f6b1756c-4d1f-4e34-8cd5-19477ca3a8d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:22:11.094969 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1213/2441] 10.222.0.50 () {58 vars in 967 bytes} [Mon Sep 5 12:22:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:22:11.196337 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad40e031-1958-40cd-b1b2-94c6db54ec2d service neutron] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:22:11.198629 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-ad40e031-1958-40cd-b1b2-94c6db54ec2d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:22:11.325878 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad40e031-1958-40cd-b1b2-94c6db54ec2d service neutron] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:22:11.338251 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b383f50-3d1b-438e-a354-81e8b730fbd2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2b32d58d964585a24e7c5784a8355f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:22:11.338898 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b383f50-3d1b-438e-a354-81e8b730fbd2 service swift] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:22:11.339177 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b383f50-3d1b-438e-a354-81e8b730fbd2 service swift] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:22:11.339457 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b383f50-3d1b-438e-a354-81e8b730fbd2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:22:11.357891 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b383f50-3d1b-438e-a354-81e8b730fbd2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:22:11.360591 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b383f50-3d1b-438e-a354-81e8b730fbd2 service swift] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:22:11.377683 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1229/2442] 10.222.0.50 () {60 vars in 1384 bytes} [Mon Sep 5 12:22:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 05 12:22:19.001526 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf42b3d6-2681-405f-a6e7-38006e16aa87 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:22:19.002111 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf42b3d6-2681-405f-a6e7-38006e16aa87 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:22:19.002213 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf42b3d6-2681-405f-a6e7-38006e16aa87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:22:19.042126 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-cf42b3d6-2681-405f-a6e7-38006e16aa87 None None] MFA Rules not processed for user `60c08df8e0b34c568b2d1f740947f6f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:22:19.055901 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-cf42b3d6-2681-405f-a6e7-38006e16aa87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:22:19.183133 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:22:19.190121 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1214/2443] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:22:18 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:22:19.203879 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b383f50-3d1b-438e-a354-81e8b730fbd2 service swift] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:22:19.205926 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-3b383f50-3d1b-438e-a354-81e8b730fbd2 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:22:19.285492 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:22:19.332524 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b383f50-3d1b-438e-a354-81e8b730fbd2 service swift] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:22:19.343066 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4405c08-a8ad-44f2-9c03-8eb0e78d763a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb060ff495bc4abb83ff88992fb7be09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:22:19.344706 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4405c08-a8ad-44f2-9c03-8eb0e78d763a service nova] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:22:19.345294 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4405c08-a8ad-44f2-9c03-8eb0e78d763a service nova] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:22:19.345796 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4405c08-a8ad-44f2-9c03-8eb0e78d763a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:22:19.370812 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4405c08-a8ad-44f2-9c03-8eb0e78d763a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:22:19.372540 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4405c08-a8ad-44f2-9c03-8eb0e78d763a service nova] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:22:19.386754 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1230/2444] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:22:19 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:22:21.273509 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9014aad4-e8e2-44ba-a73a-08c021315d1c None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:22:21.274481 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9014aad4-e8e2-44ba-a73a-08c021315d1c None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:22:21.275722 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9014aad4-e8e2-44ba-a73a-08c021315d1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:22:21.301267 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-9014aad4-e8e2-44ba-a73a-08c021315d1c None None] MFA Rules not processed for user `60c08df8e0b34c568b2d1f740947f6f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:22:21.302806 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-9014aad4-e8e2-44ba-a73a-08c021315d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:22:21.311043 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1215/2445] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:22:21 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 12:22:22.232683 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4405c08-a8ad-44f2-9c03-8eb0e78d763a service nova] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:22:22.234854 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-d4405c08-a8ad-44f2-9c03-8eb0e78d763a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:22:22.254268 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4405c08-a8ad-44f2-9c03-8eb0e78d763a service nova] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:22:22.261222 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57264d3-ecb5-4044-8df4-0328b3a57b1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4994b4faa4ec4aa088f3dc32c9c5614d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:22:22.262575 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57264d3-ecb5-4044-8df4-0328b3a57b1f service neutron] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:22:22.263208 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57264d3-ecb5-4044-8df4-0328b3a57b1f service neutron] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:22:22.264513 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57264d3-ecb5-4044-8df4-0328b3a57b1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:22:22.268098 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-c57264d3-ecb5-4044-8df4-0328b3a57b1f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:22:22.283256 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57264d3-ecb5-4044-8df4-0328b3a57b1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:22:22.284741 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57264d3-ecb5-4044-8df4-0328b3a57b1f service neutron] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:22:22.304408 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1231/2446] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:22:22 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:22:22.992038 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9014aad4-e8e2-44ba-a73a-08c021315d1c None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:22:22.994440 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-9014aad4-e8e2-44ba-a73a-08c021315d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:22:23.130098 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9014aad4-e8e2-44ba-a73a-08c021315d1c None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:22:23.137403 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c2634d-2cd5-4aa7-963e-be77cbfa1cf2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5427d0752de4817b6aa25e28c2d9a30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:22:23.143809 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c2634d-2cd5-4aa7-963e-be77cbfa1cf2 service placement] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:22:23.144178 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c2634d-2cd5-4aa7-963e-be77cbfa1cf2 service placement] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:22:23.144462 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c2634d-2cd5-4aa7-963e-be77cbfa1cf2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:22:23.146711 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-26c2634d-2cd5-4aa7-963e-be77cbfa1cf2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:22:23.162177 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c2634d-2cd5-4aa7-963e-be77cbfa1cf2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:22:23.165297 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c2634d-2cd5-4aa7-963e-be77cbfa1cf2 service placement] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:22:23.189416 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1216/2447] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:22:22 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:22:23.946129 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5457c7-3eaf-4575-8af3-513bde81f174 None None] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:22:23.946661 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5457c7-3eaf-4575-8af3-513bde81f174 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:22:23.947189 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5457c7-3eaf-4575-8af3-513bde81f174 None None] PATH_INFO: `/` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:22:23.949309 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1232/2448] 10.222.0.50 () {54 vars in 921 bytes} [Mon Sep 5 12:22:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:22:23.962105 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c0b069-5ce5-41ed-b5ce-4f1d50cb27cd None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:22:23.963071 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c0b069-5ce5-41ed-b5ce-4f1d50cb27cd None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:22:23.963320 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c0b069-5ce5-41ed-b5ce-4f1d50cb27cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:22:23.990142 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-93c0b069-5ce5-41ed-b5ce-4f1d50cb27cd None None] MFA Rules not processed for user `c5427d0752de4817b6aa25e28c2d9a30`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:22:23.991363 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-93c0b069-5ce5-41ed-b5ce-4f1d50cb27cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:22:24.015333 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1217/2449] 10.222.0.50 () {58 vars in 1018 bytes} [Mon Sep 5 12:22:23 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:22:24.042036 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5457c7-3eaf-4575-8af3-513bde81f174 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:22:24.058811 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5457c7-3eaf-4575-8af3-513bde81f174 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:22:24.065327 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c0b069-5ce5-41ed-b5ce-4f1d50cb27cd None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:22:24.067537 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-93c0b069-5ce5-41ed-b5ce-4f1d50cb27cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:22:24.073978 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86087454-fe16-4d97-876a-b056ec4a7552 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5427d0752de4817b6aa25e28c2d9a30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:22:24.075215 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86087454-fe16-4d97-876a-b056ec4a7552 service placement] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:22:24.076639 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86087454-fe16-4d97-876a-b056ec4a7552 service placement] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:22:24.077457 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86087454-fe16-4d97-876a-b056ec4a7552 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:22:24.100621 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c0b069-5ce5-41ed-b5ce-4f1d50cb27cd None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:22:24.103337 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86087454-fe16-4d97-876a-b056ec4a7552 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:22:24.108263 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86087454-fe16-4d97-876a-b056ec4a7552 service placement] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:22:24.110041 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caf79c0-419f-4393-8088-19b570b041db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:22:24.110918 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caf79c0-419f-4393-8088-19b570b041db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:22:24.111837 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caf79c0-419f-4393-8088-19b570b041db admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:22:24.112242 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caf79c0-419f-4393-8088-19b570b041db admin admin] PATH_INFO: `/v3/users/7101851e4b3841e29cdc98c330e09d76` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:22:24.114101 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caf79c0-419f-4393-8088-19b570b041db admin admin] RBAC: Authorizing `identity:delete_user(user_id=7101851e4b3841e29cdc98c330e09d76)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:22:24.116712 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caf79c0-419f-4393-8088-19b570b041db admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:22:24.136397 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1233/2450] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:22:24 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 12:22:24.218492 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-9caf79c0-419f-4393-8088-19b570b041db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7101851e4b3841e29cdc98c330e09d76'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:22:24.219598 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-9caf79c0-419f-4393-8088-19b570b041db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7101851e4b3841e29cdc98c330e09d76'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:22:24.232245 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-9caf79c0-419f-4393-8088-19b570b041db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7101851e4b3841e29cdc98c330e09d76'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:22:24.233166 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-9caf79c0-419f-4393-8088-19b570b041db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7101851e4b3841e29cdc98c330e09d76'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:22:24.254928 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-9caf79c0-419f-4393-8088-19b570b041db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7101851e4b3841e29cdc98c330e09d76'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:22:24.268759 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1218/2451] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 5 12:22:24 2022] DELETE /identity/v3/users/7101851e4b3841e29cdc98c330e09d76 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:22:24.456626 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86087454-fe16-4d97-876a-b056ec4a7552 service placement] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:22:24.468545 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86087454-fe16-4d97-876a-b056ec4a7552 service placement] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:22:24.541497 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f13d80-9872-470c-8c77-57fbbd0014ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:22:24.542507 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f13d80-9872-470c-8c77-57fbbd0014ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:22:24.542878 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f13d80-9872-470c-8c77-57fbbd0014ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:22:24.543295 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f13d80-9872-470c-8c77-57fbbd0014ef admin admin] PATH_INFO: `/v3/projects/2a381a8799a84dbeb1953fcd87b52096` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:22:24.545383 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f13d80-9872-470c-8c77-57fbbd0014ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a381a8799a84dbeb1953fcd87b52096)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:22:24.547558 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f13d80-9872-470c-8c77-57fbbd0014ef admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:22:24.604730 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-c8f13d80-9872-470c-8c77-57fbbd0014ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a381a8799a84dbeb1953fcd87b52096', 'request_id': 'req-c8f13d80-9872-470c-8c77-57fbbd0014ef'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:22:24.613771 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-c8f13d80-9872-470c-8c77-57fbbd0014ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a381a8799a84dbeb1953fcd87b52096', 'request_id': 'req-c8f13d80-9872-470c-8c77-57fbbd0014ef'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:22:24.625971 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-c8f13d80-9872-470c-8c77-57fbbd0014ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a381a8799a84dbeb1953fcd87b52096', 'request_id': 'req-c8f13d80-9872-470c-8c77-57fbbd0014ef'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:22:24.640377 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-c8f13d80-9872-470c-8c77-57fbbd0014ef admin admin] The token cache is being invalidate because project 2a381a8799a84dbeb1953fcd87b52096 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:22:24.641070 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-c8f13d80-9872-470c-8c77-57fbbd0014ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:22:24.642043 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-c8f13d80-9872-470c-8c77-57fbbd0014ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:22:24.644354 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1234/2452] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 5 12:22:24 2022] DELETE /identity/v3/projects/2a381a8799a84dbeb1953fcd87b52096 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:22:24.648865 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caf79c0-419f-4393-8088-19b570b041db admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:22:24.651434 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-9caf79c0-419f-4393-8088-19b570b041db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:22:24.677438 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caf79c0-419f-4393-8088-19b570b041db admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:22:24.750605 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:22:24.775851 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e305869-83df-4543-a455-d44b73d931b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:22:24.778841 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e305869-83df-4543-a455-d44b73d931b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:22:24.779206 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e305869-83df-4543-a455-d44b73d931b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:22:24.779554 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e305869-83df-4543-a455-d44b73d931b6 admin admin] PATH_INFO: `/v3/users/6136aca79fb64fe4af66933ac2e86768` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:22:24.780963 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e305869-83df-4543-a455-d44b73d931b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6136aca79fb64fe4af66933ac2e86768)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:22:24.784302 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e305869-83df-4543-a455-d44b73d931b6 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:22:24.881426 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-9e305869-83df-4543-a455-d44b73d931b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6136aca79fb64fe4af66933ac2e86768'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:22:24.882391 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-9e305869-83df-4543-a455-d44b73d931b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6136aca79fb64fe4af66933ac2e86768'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:22:24.892563 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-9e305869-83df-4543-a455-d44b73d931b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6136aca79fb64fe4af66933ac2e86768'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:22:24.893305 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-9e305869-83df-4543-a455-d44b73d931b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6136aca79fb64fe4af66933ac2e86768'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:22:24.909134 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-9e305869-83df-4543-a455-d44b73d931b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6136aca79fb64fe4af66933ac2e86768'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:22:24.923953 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1219/2453] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 5 12:22:24 2022] DELETE /identity/v3/users/6136aca79fb64fe4af66933ac2e86768 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:22:25.122426 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f13d80-9872-470c-8c77-57fbbd0014ef admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:22:25.124590 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-c8f13d80-9872-470c-8c77-57fbbd0014ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:22:25.141065 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f13d80-9872-470c-8c77-57fbbd0014ef admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:22:25.177762 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:22:25.215925 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df59c4da-7257-4cc9-a601-6da8ff3e4399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:22:25.216840 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df59c4da-7257-4cc9-a601-6da8ff3e4399 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:22:25.217261 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df59c4da-7257-4cc9-a601-6da8ff3e4399 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:22:25.217640 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df59c4da-7257-4cc9-a601-6da8ff3e4399 admin admin] PATH_INFO: `/v3/projects/955438048d454f0fa1888c80353310b8` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:22:25.219079 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df59c4da-7257-4cc9-a601-6da8ff3e4399 admin admin] RBAC: Authorizing `identity:delete_project(project_id=955438048d454f0fa1888c80353310b8)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:22:25.221955 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df59c4da-7257-4cc9-a601-6da8ff3e4399 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:22:25.288943 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-df59c4da-7257-4cc9-a601-6da8ff3e4399 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '955438048d454f0fa1888c80353310b8', 'request_id': 'req-df59c4da-7257-4cc9-a601-6da8ff3e4399'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:22:25.299673 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-df59c4da-7257-4cc9-a601-6da8ff3e4399 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '955438048d454f0fa1888c80353310b8', 'request_id': 'req-df59c4da-7257-4cc9-a601-6da8ff3e4399'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:22:25.307631 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-df59c4da-7257-4cc9-a601-6da8ff3e4399 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '955438048d454f0fa1888c80353310b8', 'request_id': 'req-df59c4da-7257-4cc9-a601-6da8ff3e4399'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:22:25.324275 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-df59c4da-7257-4cc9-a601-6da8ff3e4399 admin admin] The token cache is being invalidate because project 955438048d454f0fa1888c80353310b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:22:25.324575 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-df59c4da-7257-4cc9-a601-6da8ff3e4399 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:22:25.325270 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-df59c4da-7257-4cc9-a601-6da8ff3e4399 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:22:25.327046 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1235/2454] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 5 12:22:25 2022] DELETE /identity/v3/projects/955438048d454f0fa1888c80353310b8 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:22:32.292572 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e305869-83df-4543-a455-d44b73d931b6 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:22:32.294163 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-9e305869-83df-4543-a455-d44b73d931b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:22:32.352682 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e305869-83df-4543-a455-d44b73d931b6 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:22:32.412531 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a875d77-b570-4b9a-a684-79e1e42c193a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4994b4faa4ec4aa088f3dc32c9c5614d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:22:32.413195 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a875d77-b570-4b9a-a684-79e1e42c193a service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:22:32.413477 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a875d77-b570-4b9a-a684-79e1e42c193a service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:22:32.413748 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a875d77-b570-4b9a-a684-79e1e42c193a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:22:32.415638 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-0a875d77-b570-4b9a-a684-79e1e42c193a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:22:32.427049 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a875d77-b570-4b9a-a684-79e1e42c193a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:22:32.428522 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a875d77-b570-4b9a-a684-79e1e42c193a service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:22:32.437812 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1220/2455] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:22:32 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:22:35.317385 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=38,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:22:36.115538 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df59c4da-7257-4cc9-a601-6da8ff3e4399 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:22:36.117443 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-df59c4da-7257-4cc9-a601-6da8ff3e4399 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:22:36.195078 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df59c4da-7257-4cc9-a601-6da8ff3e4399 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:22:36.200628 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c633ac44-287f-4e5a-8950-d72a7981eb5e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb060ff495bc4abb83ff88992fb7be09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:22:36.201268 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c633ac44-287f-4e5a-8950-d72a7981eb5e service nova] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:22:36.201547 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c633ac44-287f-4e5a-8950-d72a7981eb5e service nova] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:22:36.201818 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c633ac44-287f-4e5a-8950-d72a7981eb5e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:22:36.203548 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-c633ac44-287f-4e5a-8950-d72a7981eb5e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:22:36.216540 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c633ac44-287f-4e5a-8950-d72a7981eb5e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:22:36.218242 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c633ac44-287f-4e5a-8950-d72a7981eb5e service nova] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:22:36.230003 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1236/2456] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:22:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:22:42.433919 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=77,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:22:46.224619 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=34 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:22:50.228554 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a875d77-b570-4b9a-a684-79e1e42c193a service neutron] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:22:50.242280 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a875d77-b570-4b9a-a684-79e1e42c193a service neutron] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:22:50.248251 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ca4a4a-f71d-498e-ba08-ade63f420dd1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb060ff495bc4abb83ff88992fb7be09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:22:50.248851 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ca4a4a-f71d-498e-ba08-ade63f420dd1 service nova] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:22:50.249174 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ca4a4a-f71d-498e-ba08-ade63f420dd1 service nova] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:22:50.249443 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ca4a4a-f71d-498e-ba08-ade63f420dd1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:22:50.251195 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-52ca4a4a-f71d-498e-ba08-ade63f420dd1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:22:50.311528 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ca4a4a-f71d-498e-ba08-ade63f420dd1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:22:50.313157 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ca4a4a-f71d-498e-ba08-ade63f420dd1 service nova] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:22:50.322625 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1221/2457] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:22:50 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:22:58.681686 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c633ac44-287f-4e5a-8950-d72a7981eb5e service nova] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:22:58.694480 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c633ac44-287f-4e5a-8950-d72a7981eb5e service nova] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:22:58.701823 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ae4ad1-aa68-4efa-986d-660823cd370f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb060ff495bc4abb83ff88992fb7be09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:22:58.702463 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ae4ad1-aa68-4efa-986d-660823cd370f service nova] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:22:58.702746 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ae4ad1-aa68-4efa-986d-660823cd370f service nova] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:22:58.703021 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ae4ad1-aa68-4efa-986d-660823cd370f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:22:58.704980 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-d1ae4ad1-aa68-4efa-986d-660823cd370f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:22:58.721415 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ae4ad1-aa68-4efa-986d-660823cd370f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:22:58.723417 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ae4ad1-aa68-4efa-986d-660823cd370f service nova] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:22:58.736648 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1237/2458] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:22:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 12:23:00.318141 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=28 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:23:02.199784 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cab87aa-e1af-4df0-8a37-c6bff0c78475 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:23:02.200436 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cab87aa-e1af-4df0-8a37-c6bff0c78475 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:23:02.201067 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cab87aa-e1af-4df0-8a37-c6bff0c78475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:23:02.221214 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-4cab87aa-e1af-4df0-8a37-c6bff0c78475 None None] MFA Rules not processed for user `bacc8ece8df24bf498c1d55ca2918224`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:23:02.222479 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-4cab87aa-e1af-4df0-8a37-c6bff0c78475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:23:02.281427 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1222/2459] 10.222.0.50 () {58 vars in 1009 bytes} [Mon Sep 5 12:23:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:23:02.293595 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ae4ad1-aa68-4efa-986d-660823cd370f service nova] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:23:02.295145 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-d1ae4ad1-aa68-4efa-986d-660823cd370f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:23:02.368871 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ae4ad1-aa68-4efa-986d-660823cd370f service nova] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:23:02.374492 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6187ff-da13-4ba7-8230-11a280735579 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2b32d58d964585a24e7c5784a8355f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:23:02.375182 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6187ff-da13-4ba7-8230-11a280735579 service swift] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:23:02.375466 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6187ff-da13-4ba7-8230-11a280735579 service swift] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:23:02.375737 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6187ff-da13-4ba7-8230-11a280735579 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:23:02.385080 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6187ff-da13-4ba7-8230-11a280735579 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:23:02.386677 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6187ff-da13-4ba7-8230-11a280735579 service swift] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:23:02.396237 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1238/2460] 10.222.0.50 () {60 vars in 1384 bytes} [Mon Sep 5 12:23:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 05 12:23:04.164663 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cab87aa-e1af-4df0-8a37-c6bff0c78475 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:23:04.166199 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-4cab87aa-e1af-4df0-8a37-c6bff0c78475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:23:04.186285 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cab87aa-e1af-4df0-8a37-c6bff0c78475 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:23:04.192121 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79d064b-bbf9-497c-9419-7677e1e2533e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4994b4faa4ec4aa088f3dc32c9c5614d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:23:04.193607 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79d064b-bbf9-497c-9419-7677e1e2533e service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:23:04.194169 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79d064b-bbf9-497c-9419-7677e1e2533e service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:23:04.195002 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79d064b-bbf9-497c-9419-7677e1e2533e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:23:04.201013 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-a79d064b-bbf9-497c-9419-7677e1e2533e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:23:04.314695 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79d064b-bbf9-497c-9419-7677e1e2533e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:23:04.317242 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79d064b-bbf9-497c-9419-7677e1e2533e service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:23:04.330672 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1223/2461] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:23:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:23:04.403061 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6187ff-da13-4ba7-8230-11a280735579 service swift] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:23:04.424786 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6187ff-da13-4ba7-8230-11a280735579 service swift] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:23:04.453917 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f03daf7-3dbe-4e36-aede-c3c90c908510 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb060ff495bc4abb83ff88992fb7be09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:23:04.460198 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f03daf7-3dbe-4e36-aede-c3c90c908510 service nova] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:23:04.460834 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f03daf7-3dbe-4e36-aede-c3c90c908510 service nova] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:23:04.461392 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f03daf7-3dbe-4e36-aede-c3c90c908510 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:23:04.464434 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-6f03daf7-3dbe-4e36-aede-c3c90c908510 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:23:04.490861 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f03daf7-3dbe-4e36-aede-c3c90c908510 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:23:04.494347 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f03daf7-3dbe-4e36-aede-c3c90c908510 service nova] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:23:04.535376 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1239/2462] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:23:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:23:08.991843 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79d064b-bbf9-497c-9419-7677e1e2533e service neutron] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:23:08.993516 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-a79d064b-bbf9-497c-9419-7677e1e2533e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:23:09.015859 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79d064b-bbf9-497c-9419-7677e1e2533e service neutron] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:23:09.020973 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0975c2fb-9e30-4d9d-b894-3ae191e4f8d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:23:09.021852 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0975c2fb-9e30-4d9d-b894-3ae191e4f8d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:23:09.022196 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0975c2fb-9e30-4d9d-b894-3ae191e4f8d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:23:09.022632 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0975c2fb-9e30-4d9d-b894-3ae191e4f8d6 admin admin] PATH_INFO: `/v3/users/b7dcead6e9584ab8949678016ed12335` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:23:09.023946 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0975c2fb-9e30-4d9d-b894-3ae191e4f8d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7dcead6e9584ab8949678016ed12335)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:23:09.026075 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0975c2fb-9e30-4d9d-b894-3ae191e4f8d6 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:23:09.121312 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-0975c2fb-9e30-4d9d-b894-3ae191e4f8d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7dcead6e9584ab8949678016ed12335'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:23:09.122822 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-0975c2fb-9e30-4d9d-b894-3ae191e4f8d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7dcead6e9584ab8949678016ed12335'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:23:09.134649 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-0975c2fb-9e30-4d9d-b894-3ae191e4f8d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7dcead6e9584ab8949678016ed12335'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:23:09.135334 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-0975c2fb-9e30-4d9d-b894-3ae191e4f8d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7dcead6e9584ab8949678016ed12335'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:23:09.150532 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-0975c2fb-9e30-4d9d-b894-3ae191e4f8d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7dcead6e9584ab8949678016ed12335'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:23:09.180924 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1224/2463] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 5 12:23:08 2022] DELETE /identity/v3/users/b7dcead6e9584ab8949678016ed12335 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:23:09.433049 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f03daf7-3dbe-4e36-aede-c3c90c908510 service nova] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:23:09.448269 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f03daf7-3dbe-4e36-aede-c3c90c908510 service nova] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:23:09.574262 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3943163a-07b0-4f56-a64a-68c44f390ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:23:09.576116 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3943163a-07b0-4f56-a64a-68c44f390ea1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:23:09.576875 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3943163a-07b0-4f56-a64a-68c44f390ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:23:09.577571 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3943163a-07b0-4f56-a64a-68c44f390ea1 admin admin] PATH_INFO: `/v3/projects/7903364dc1c64f56a504fee2db647055` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:23:09.579700 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3943163a-07b0-4f56-a64a-68c44f390ea1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7903364dc1c64f56a504fee2db647055)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:23:09.581846 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3943163a-07b0-4f56-a64a-68c44f390ea1 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:23:09.648068 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-3943163a-07b0-4f56-a64a-68c44f390ea1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7903364dc1c64f56a504fee2db647055', 'request_id': 'req-3943163a-07b0-4f56-a64a-68c44f390ea1'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:23:09.659270 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-3943163a-07b0-4f56-a64a-68c44f390ea1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7903364dc1c64f56a504fee2db647055', 'request_id': 'req-3943163a-07b0-4f56-a64a-68c44f390ea1'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:23:09.666363 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-3943163a-07b0-4f56-a64a-68c44f390ea1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7903364dc1c64f56a504fee2db647055', 'request_id': 'req-3943163a-07b0-4f56-a64a-68c44f390ea1'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:23:09.667688 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:23:09.686475 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-3943163a-07b0-4f56-a64a-68c44f390ea1 admin admin] The token cache is being invalidate because project 7903364dc1c64f56a504fee2db647055 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:23:09.687057 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-3943163a-07b0-4f56-a64a-68c44f390ea1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:23:09.688238 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-3943163a-07b0-4f56-a64a-68c44f390ea1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:23:09.689981 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1240/2464] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 5 12:23:09 2022] DELETE /identity/v3/projects/7903364dc1c64f56a504fee2db647055 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:23:09.695023 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d48a508-320a-445d-9c6a-e49c80d0c631 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:23:09.695335 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d48a508-320a-445d-9c6a-e49c80d0c631 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:23:09.695610 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d48a508-320a-445d-9c6a-e49c80d0c631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:23:09.723649 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-3d48a508-320a-445d-9c6a-e49c80d0c631 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:23:09.725015 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-3d48a508-320a-445d-9c6a-e49c80d0c631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:23:09.743604 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:23:09.849140 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1225/2465] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:23:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:23:09.857050 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a544de-6162-44b0-b0ff-5f86b0c53216 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:23:09.857336 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a544de-6162-44b0-b0ff-5f86b0c53216 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:23:09.857611 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a544de-6162-44b0-b0ff-5f86b0c53216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:23:09.885947 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-64a544de-6162-44b0-b0ff-5f86b0c53216 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:23:09.886594 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-64a544de-6162-44b0-b0ff-5f86b0c53216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:23:09.895783 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1241/2466] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:23:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:23:09.900209 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d48a508-320a-445d-9c6a-e49c80d0c631 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:23:09.911340 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d48a508-320a-445d-9c6a-e49c80d0c631 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:23:09.916235 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9688468b-666e-4f59-87f6-2a357bae3522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:23:09.916851 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9688468b-666e-4f59-87f6-2a357bae3522 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:23:09.917166 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9688468b-666e-4f59-87f6-2a357bae3522 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:23:09.917440 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9688468b-666e-4f59-87f6-2a357bae3522 admin admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:23:09.918092 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9688468b-666e-4f59-87f6-2a357bae3522 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:23:09.918403 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9688468b-666e-4f59-87f6-2a357bae3522 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:23:09.920676 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9688468b-666e-4f59-87f6-2a357bae3522 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:23:09.934423 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1226/2467] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Sep 5 12:23:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:23:09.939415 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a544de-6162-44b0-b0ff-5f86b0c53216 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:23:09.950652 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a544de-6162-44b0-b0ff-5f86b0c53216 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:23:09.955555 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076472e0-d916-40fe-9cb6-2f2ac7425bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:23:09.956658 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076472e0-d916-40fe-9cb6-2f2ac7425bbb admin admin] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:23:09.957234 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076472e0-d916-40fe-9cb6-2f2ac7425bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:23:09.957783 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076472e0-d916-40fe-9cb6-2f2ac7425bbb admin admin] PATH_INFO: `/v3/projects` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:23:09.958507 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076472e0-d916-40fe-9cb6-2f2ac7425bbb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:23:09.960419 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076472e0-d916-40fe-9cb6-2f2ac7425bbb admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:23:09.990840 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1242/2468] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 5 12:23:09 2022] POST /identity/v3/projects => generated 371 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:23:09.994830 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9688468b-666e-4f59-87f6-2a357bae3522 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:23:10.007324 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9688468b-666e-4f59-87f6-2a357bae3522 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:23:10.081727 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562fb53f-05c2-4966-b458-aab1590a701e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:23:10.082704 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562fb53f-05c2-4966-b458-aab1590a701e admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:23:10.083065 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562fb53f-05c2-4966-b458-aab1590a701e admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:23:10.083339 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562fb53f-05c2-4966-b458-aab1590a701e admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:23:10.083985 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562fb53f-05c2-4966-b458-aab1590a701e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:23:10.085939 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562fb53f-05c2-4966-b458-aab1590a701e admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:23:10.117329 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1227/2469] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 5 12:23:09 2022] POST /identity/v3/users => generated 286 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 12:23:10.121438 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076472e0-d916-40fe-9cb6-2f2ac7425bbb admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:23:10.134775 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076472e0-d916-40fe-9cb6-2f2ac7425bbb admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:23:10.141514 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f19cc62-846d-4331-9315-0ae8feb95e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:23:10.142290 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f19cc62-846d-4331-9315-0ae8feb95e9d admin admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:23:10.142671 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f19cc62-846d-4331-9315-0ae8feb95e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:23:10.143010 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f19cc62-846d-4331-9315-0ae8feb95e9d admin admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:23:10.143800 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f19cc62-846d-4331-9315-0ae8feb95e9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:23:10.145789 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f19cc62-846d-4331-9315-0ae8feb95e9d admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:23:10.157669 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1243/2470] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:23:10 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:23:10.162887 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562fb53f-05c2-4966-b458-aab1590a701e admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:23:10.174262 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562fb53f-05c2-4966-b458-aab1590a701e admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:23:10.178890 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3c85a5-5069-453d-9cb9-ab3e41520ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:23:10.179497 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3c85a5-5069-453d-9cb9-ab3e41520ca0 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:23:10.180481 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3c85a5-5069-453d-9cb9-ab3e41520ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:23:10.181424 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3c85a5-5069-453d-9cb9-ab3e41520ca0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:23:10.182683 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3c85a5-5069-453d-9cb9-ab3e41520ca0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:23:10.186017 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3c85a5-5069-453d-9cb9-ab3e41520ca0 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:23:10.199534 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1228/2471] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:23:10 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:23:10.204939 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f19cc62-846d-4331-9315-0ae8feb95e9d admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:23:10.220677 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f19cc62-846d-4331-9315-0ae8feb95e9d admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:23:10.227517 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9964db58-b0cf-4d9d-acb5-8a1f1b873d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:23:10.229240 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9964db58-b0cf-4d9d-acb5-8a1f1b873d3d admin admin] REQUEST_METHOD: `PUT` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:23:10.229743 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9964db58-b0cf-4d9d-acb5-8a1f1b873d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:23:10.230112 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9964db58-b0cf-4d9d-acb5-8a1f1b873d3d admin admin] PATH_INFO: `/v3/projects/d0a7e5ad0f3f4cf9b78e9e8a0b68f475/users/b91824e1a3b0405fae119a7fefaed088/roles/ed72181e1403401facb77dcf33644757` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:23:10.251662 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9964db58-b0cf-4d9d-acb5-8a1f1b873d3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0a7e5ad0f3f4cf9b78e9e8a0b68f475, user_id=b91824e1a3b0405fae119a7fefaed088, role_id=ed72181e1403401facb77dcf33644757)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:23:10.256374 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9964db58-b0cf-4d9d-acb5-8a1f1b873d3d admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:23:10.280936 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1244/2472] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 5 12:23:10 2022] PUT /identity/v3/projects/d0a7e5ad0f3f4cf9b78e9e8a0b68f475/users/b91824e1a3b0405fae119a7fefaed088/roles/ed72181e1403401facb77dcf33644757 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 12:23:10.299058 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348e58cb-5ab5-4f1b-9502-885cb91488f3 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:23:10.299620 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348e58cb-5ab5-4f1b-9502-885cb91488f3 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:23:10.300226 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348e58cb-5ab5-4f1b-9502-885cb91488f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:23:10.349534 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-348e58cb-5ab5-4f1b-9502-885cb91488f3 None None] MFA Rules not processed for user `b91824e1a3b0405fae119a7fefaed088`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:23:10.351536 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-348e58cb-5ab5-4f1b-9502-885cb91488f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:23:10.470045 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1229/2473] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:23:10 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:23:10.474971 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9964db58-b0cf-4d9d-acb5-8a1f1b873d3d admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:23:10.553393 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9964db58-b0cf-4d9d-acb5-8a1f1b873d3d admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:23:10.558531 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14baf96a-08cc-4ad2-b2d8-7368624dc6fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:23:10.559209 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14baf96a-08cc-4ad2-b2d8-7368624dc6fc admin admin] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:23:10.559445 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14baf96a-08cc-4ad2-b2d8-7368624dc6fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:23:10.560247 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14baf96a-08cc-4ad2-b2d8-7368624dc6fc admin admin] PATH_INFO: `/v3/projects` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:23:10.560918 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14baf96a-08cc-4ad2-b2d8-7368624dc6fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:23:10.562933 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14baf96a-08cc-4ad2-b2d8-7368624dc6fc admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:23:10.594931 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1245/2474] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 5 12:23:10 2022] POST /identity/v3/projects => generated 373 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 12:23:10.598803 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348e58cb-5ab5-4f1b-9502-885cb91488f3 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:23:10.610441 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348e58cb-5ab5-4f1b-9502-885cb91488f3 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:23:10.616740 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:23:10.699287 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa89b1ad-6d59-4230-825d-eed10082853b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:23:10.700626 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa89b1ad-6d59-4230-825d-eed10082853b admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:23:10.700626 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa89b1ad-6d59-4230-825d-eed10082853b admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:23:10.701286 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa89b1ad-6d59-4230-825d-eed10082853b admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:23:10.701465 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa89b1ad-6d59-4230-825d-eed10082853b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:23:10.703472 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa89b1ad-6d59-4230-825d-eed10082853b admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:23:10.729729 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1230/2475] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 5 12:23:10 2022] POST /identity/v3/users => generated 293 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:23:10.734307 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14baf96a-08cc-4ad2-b2d8-7368624dc6fc admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:23:10.749092 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14baf96a-08cc-4ad2-b2d8-7368624dc6fc admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:23:10.754451 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6737eda1-b607-4229-8a77-087cf7b0881f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:23:10.754997 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6737eda1-b607-4229-8a77-087cf7b0881f admin admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:23:10.755283 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6737eda1-b607-4229-8a77-087cf7b0881f admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:23:10.755564 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6737eda1-b607-4229-8a77-087cf7b0881f admin admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:23:10.756502 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6737eda1-b607-4229-8a77-087cf7b0881f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:23:10.758161 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6737eda1-b607-4229-8a77-087cf7b0881f admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:23:10.777323 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1246/2476] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:23:10 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:23:10.781449 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa89b1ad-6d59-4230-825d-eed10082853b admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:23:10.792619 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa89b1ad-6d59-4230-825d-eed10082853b admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:23:10.800569 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90939f92-b51a-4dff-976c-8faf15433bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:23:10.801628 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90939f92-b51a-4dff-976c-8faf15433bc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:23:10.802145 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90939f92-b51a-4dff-976c-8faf15433bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:23:10.802517 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90939f92-b51a-4dff-976c-8faf15433bc1 admin admin] PATH_INFO: `/v3/projects/2b7f9d6e34be45309fcd8cf9924ad8f3/users/cf7ad4eb575e477594aef93f43f49dce/roles/16e2ccc8bd1b497d8cee780c1c7df0d2` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:23:10.822142 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90939f92-b51a-4dff-976c-8faf15433bc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b7f9d6e34be45309fcd8cf9924ad8f3, user_id=cf7ad4eb575e477594aef93f43f49dce, role_id=16e2ccc8bd1b497d8cee780c1c7df0d2)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:23:10.825235 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90939f92-b51a-4dff-976c-8faf15433bc1 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:23:10.845372 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1231/2477] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 5 12:23:10 2022] PUT /identity/v3/projects/2b7f9d6e34be45309fcd8cf9924ad8f3/users/cf7ad4eb575e477594aef93f43f49dce/roles/16e2ccc8bd1b497d8cee780c1c7df0d2 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 12:23:10.850777 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6737eda1-b607-4229-8a77-087cf7b0881f admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:23:10.870141 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6737eda1-b607-4229-8a77-087cf7b0881f admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:23:10.964247 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e35ea1-2afc-4812-b320-1b6f879e5ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:23:10.965316 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e35ea1-2afc-4812-b320-1b6f879e5ed3 admin admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:23:10.965830 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e35ea1-2afc-4812-b320-1b6f879e5ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:23:10.966121 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e35ea1-2afc-4812-b320-1b6f879e5ed3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:23:10.966904 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e35ea1-2afc-4812-b320-1b6f879e5ed3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:23:10.968723 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e35ea1-2afc-4812-b320-1b6f879e5ed3 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:23:10.975610 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:23:10.982759 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1247/2478] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:23:10 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:23:10.986740 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90939f92-b51a-4dff-976c-8faf15433bc1 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:23:10.998081 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90939f92-b51a-4dff-976c-8faf15433bc1 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:23:11.003178 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6462d0ba-09dd-44d9-b46c-158cf1fbee25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:23:11.003846 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6462d0ba-09dd-44d9-b46c-158cf1fbee25 admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:23:11.004133 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6462d0ba-09dd-44d9-b46c-158cf1fbee25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:23:11.004397 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6462d0ba-09dd-44d9-b46c-158cf1fbee25 admin admin] PATH_INFO: `/v3/projects/2b7f9d6e34be45309fcd8cf9924ad8f3/users/cf7ad4eb575e477594aef93f43f49dce/roles/16e2ccc8bd1b497d8cee780c1c7df0d2` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:23:11.006789 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6462d0ba-09dd-44d9-b46c-158cf1fbee25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b7f9d6e34be45309fcd8cf9924ad8f3, user_id=cf7ad4eb575e477594aef93f43f49dce, role_id=16e2ccc8bd1b497d8cee780c1c7df0d2)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:23:11.009579 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6462d0ba-09dd-44d9-b46c-158cf1fbee25 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:23:11.033209 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1232/2479] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 5 12:23:10 2022] PUT /identity/v3/projects/2b7f9d6e34be45309fcd8cf9924ad8f3/users/cf7ad4eb575e477594aef93f43f49dce/roles/16e2ccc8bd1b497d8cee780c1c7df0d2 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:23:11.035607 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5489e9ad-a694-498f-b00e-815864d62117 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:23:11.035959 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5489e9ad-a694-498f-b00e-815864d62117 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:23:11.036229 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5489e9ad-a694-498f-b00e-815864d62117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:23:11.068771 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-5489e9ad-a694-498f-b00e-815864d62117 None None] MFA Rules not processed for user `cf7ad4eb575e477594aef93f43f49dce`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:23:11.070051 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-5489e9ad-a694-498f-b00e-815864d62117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:23:11.148368 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1248/2480] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:23:11 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:23:11.161139 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6462d0ba-09dd-44d9-b46c-158cf1fbee25 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:23:11.163067 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-6462d0ba-09dd-44d9-b46c-158cf1fbee25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:23:11.228132 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6462d0ba-09dd-44d9-b46c-158cf1fbee25 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:23:11.232170 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2928bf-762e-41c1-b379-4f5b2309050c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37633bbae0c2423c81ccd61ac3a17ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:23:11.232815 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2928bf-762e-41c1-b379-4f5b2309050c service cinder] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:23:11.233299 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2928bf-762e-41c1-b379-4f5b2309050c service cinder] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:23:11.233668 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2928bf-762e-41c1-b379-4f5b2309050c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:23:11.251847 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2928bf-762e-41c1-b379-4f5b2309050c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:23:11.253476 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2928bf-762e-41c1-b379-4f5b2309050c service cinder] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:23:11.266234 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1233/2481] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:23:11 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:23:11.359838 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5489e9ad-a694-498f-b00e-815864d62117 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:23:11.370159 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5489e9ad-a694-498f-b00e-815864d62117 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:23:11.375928 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779c790c-e0d2-41cd-bb75-f1183f9d783d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37633bbae0c2423c81ccd61ac3a17ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:23:11.377246 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779c790c-e0d2-41cd-bb75-f1183f9d783d service cinder] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:23:11.378180 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779c790c-e0d2-41cd-bb75-f1183f9d783d service cinder] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:23:11.378840 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779c790c-e0d2-41cd-bb75-f1183f9d783d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:23:11.456688 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779c790c-e0d2-41cd-bb75-f1183f9d783d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:23:11.458330 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779c790c-e0d2-41cd-bb75-f1183f9d783d service cinder] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:23:11.470126 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1249/2482] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:23:11 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:23:17.737449 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf9babd-24dc-4951-809f-450997f0ba96 None None] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:23:17.738020 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf9babd-24dc-4951-809f-450997f0ba96 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:23:17.738134 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf9babd-24dc-4951-809f-450997f0ba96 None None] PATH_INFO: `/` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:23:17.740329 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1234/2483] 10.222.0.50 () {54 vars in 921 bytes} [Mon Sep 5 12:23:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 05 12:23:17.746165 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8996ace5-9127-49db-8ca9-103282317e7d None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:23:17.746703 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8996ace5-9127-49db-8ca9-103282317e7d None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:23:17.746818 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8996ace5-9127-49db-8ca9-103282317e7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:23:17.781967 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-8996ace5-9127-49db-8ca9-103282317e7d None None] MFA Rules not processed for user `cb060ff495bc4abb83ff88992fb7be09`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:23:17.783199 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-8996ace5-9127-49db-8ca9-103282317e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:23:17.868860 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1250/2484] 10.222.0.50 () {58 vars in 1018 bytes} [Mon Sep 5 12:23:17 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:23:17.891615 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf9babd-24dc-4951-809f-450997f0ba96 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:23:17.898617 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-8cf9babd-24dc-4951-809f-450997f0ba96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:23:17.985487 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf9babd-24dc-4951-809f-450997f0ba96 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:23:17.991394 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a106341d-8f2f-4adf-9de1-8cb408626a12 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b08e831af84a658b0f5b28ad03e4f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:23:17.992156 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a106341d-8f2f-4adf-9de1-8cb408626a12 service glance] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:23:17.993973 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a106341d-8f2f-4adf-9de1-8cb408626a12 service glance] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:23:17.993973 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a106341d-8f2f-4adf-9de1-8cb408626a12 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:23:18.015600 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a106341d-8f2f-4adf-9de1-8cb408626a12 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:23:18.018363 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a106341d-8f2f-4adf-9de1-8cb408626a12 service glance] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:23:18.043044 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1235/2485] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:23:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:23:18.124882 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8996ace5-9127-49db-8ca9-103282317e7d None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:23:18.126502 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-8996ace5-9127-49db-8ca9-103282317e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:23:18.151164 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:23:18.201680 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8996ace5-9127-49db-8ca9-103282317e7d None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:23:18.206222 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779f4966-9c41-485d-8776-a4c12a23a42e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4994b4faa4ec4aa088f3dc32c9c5614d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:23:18.206850 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779f4966-9c41-485d-8776-a4c12a23a42e service neutron] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:23:18.207118 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779f4966-9c41-485d-8776-a4c12a23a42e service neutron] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:23:18.207400 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779f4966-9c41-485d-8776-a4c12a23a42e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:23:18.209412 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-779f4966-9c41-485d-8776-a4c12a23a42e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:23:18.318186 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779f4966-9c41-485d-8776-a4c12a23a42e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:23:18.319940 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779f4966-9c41-485d-8776-a4c12a23a42e service neutron] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:23:18.336834 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1251/2486] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:23:18 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:23:20.399038 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaa3403-efac-429a-b45b-77827f78e31b None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:23:20.399635 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaa3403-efac-429a-b45b-77827f78e31b None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:23:20.399815 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaa3403-efac-429a-b45b-77827f78e31b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:23:20.409524 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:23:20.421809 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-feaa3403-efac-429a-b45b-77827f78e31b None None] MFA Rules not processed for user `bacc8ece8df24bf498c1d55ca2918224`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:23:20.423010 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-feaa3403-efac-429a-b45b-77827f78e31b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:23:20.490320 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1236/2487] 10.222.0.50 () {58 vars in 1009 bytes} [Mon Sep 5 12:23:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:23:20.502761 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779f4966-9c41-485d-8776-a4c12a23a42e service neutron] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:23:20.504444 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-779f4966-9c41-485d-8776-a4c12a23a42e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:23:20.593217 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779f4966-9c41-485d-8776-a4c12a23a42e service neutron] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:23:20.598464 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32f1d36-b0f4-45f0-b17f-ca6173bfd408 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2b32d58d964585a24e7c5784a8355f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:23:20.599085 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32f1d36-b0f4-45f0-b17f-ca6173bfd408 service swift] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:23:20.599365 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32f1d36-b0f4-45f0-b17f-ca6173bfd408 service swift] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:23:20.599635 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32f1d36-b0f4-45f0-b17f-ca6173bfd408 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:23:20.608559 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32f1d36-b0f4-45f0-b17f-ca6173bfd408 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:23:20.610220 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32f1d36-b0f4-45f0-b17f-ca6173bfd408 service swift] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:23:20.619146 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1252/2488] 10.222.0.50 () {60 vars in 1384 bytes} [Mon Sep 5 12:23:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 05 12:23:21.288185 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaa3403-efac-429a-b45b-77827f78e31b None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:23:21.309136 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaa3403-efac-429a-b45b-77827f78e31b None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:23:21.319779 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c165cb-23bb-4c5e-900c-a9785262bc04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4994b4faa4ec4aa088f3dc32c9c5614d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:23:21.320577 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c165cb-23bb-4c5e-900c-a9785262bc04 service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:23:21.321616 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c165cb-23bb-4c5e-900c-a9785262bc04 service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:23:21.322113 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c165cb-23bb-4c5e-900c-a9785262bc04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:23:21.324812 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-25c165cb-23bb-4c5e-900c-a9785262bc04 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:23:21.405608 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c165cb-23bb-4c5e-900c-a9785262bc04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:23:21.407138 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c165cb-23bb-4c5e-900c-a9785262bc04 service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:23:21.418315 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1237/2489] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:23:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:23:22.768532 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32f1d36-b0f4-45f0-b17f-ca6173bfd408 service swift] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:23:22.770826 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-d32f1d36-b0f4-45f0-b17f-ca6173bfd408 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:23:22.789802 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32f1d36-b0f4-45f0-b17f-ca6173bfd408 service swift] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:23:22.801345 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d18e23f-6e83-4545-98cc-83b2aa30adbb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb060ff495bc4abb83ff88992fb7be09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:23:22.802620 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d18e23f-6e83-4545-98cc-83b2aa30adbb service nova] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:23:22.803194 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d18e23f-6e83-4545-98cc-83b2aa30adbb service nova] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:23:22.803462 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d18e23f-6e83-4545-98cc-83b2aa30adbb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:23:22.805691 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-6d18e23f-6e83-4545-98cc-83b2aa30adbb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:23:22.901818 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d18e23f-6e83-4545-98cc-83b2aa30adbb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:23:22.905247 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d18e23f-6e83-4545-98cc-83b2aa30adbb service nova] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:23:22.914934 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:23:22.954180 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1253/2490] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:23:22 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:23:27.543568 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c165cb-23bb-4c5e-900c-a9785262bc04 service neutron] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:23:27.545848 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-25c165cb-23bb-4c5e-900c-a9785262bc04 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:23:27.751721 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c165cb-23bb-4c5e-900c-a9785262bc04 service neutron] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:23:27.763525 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6424bc5-0d20-4b9f-8bae-5612311302f6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5427d0752de4817b6aa25e28c2d9a30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:23:27.764178 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6424bc5-0d20-4b9f-8bae-5612311302f6 service placement] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:23:27.764472 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6424bc5-0d20-4b9f-8bae-5612311302f6 service placement] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:23:27.764738 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6424bc5-0d20-4b9f-8bae-5612311302f6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:23:27.767063 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-c6424bc5-0d20-4b9f-8bae-5612311302f6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:23:27.790697 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6424bc5-0d20-4b9f-8bae-5612311302f6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:23:27.792365 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6424bc5-0d20-4b9f-8bae-5612311302f6 service placement] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:23:27.804168 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1238/2491] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:23:27 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:23:31.886940 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d18e23f-6e83-4545-98cc-83b2aa30adbb service nova] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:23:31.899033 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-6d18e23f-6e83-4545-98cc-83b2aa30adbb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:23:31.911747 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d18e23f-6e83-4545-98cc-83b2aa30adbb service nova] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:23:31.916397 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4bbe1b-6700-4df7-bf28-6ce60269330d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:23:31.917098 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4bbe1b-6700-4df7-bf28-6ce60269330d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:23:31.917386 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4bbe1b-6700-4df7-bf28-6ce60269330d admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:23:31.917662 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4bbe1b-6700-4df7-bf28-6ce60269330d admin admin] PATH_INFO: `/v3/users/ab3a4519819e46ba945398957780f956` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:23:31.918889 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4bbe1b-6700-4df7-bf28-6ce60269330d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab3a4519819e46ba945398957780f956)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:23:31.920821 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4bbe1b-6700-4df7-bf28-6ce60269330d admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:23:31.978319 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-fb4bbe1b-6700-4df7-bf28-6ce60269330d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab3a4519819e46ba945398957780f956'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:23:31.978957 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-fb4bbe1b-6700-4df7-bf28-6ce60269330d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab3a4519819e46ba945398957780f956'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:23:31.987641 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-fb4bbe1b-6700-4df7-bf28-6ce60269330d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab3a4519819e46ba945398957780f956'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:23:31.988213 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-fb4bbe1b-6700-4df7-bf28-6ce60269330d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab3a4519819e46ba945398957780f956'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:23:32.001271 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-fb4bbe1b-6700-4df7-bf28-6ce60269330d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab3a4519819e46ba945398957780f956'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:23:32.015605 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1254/2492] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 5 12:23:31 2022] DELETE /identity/v3/users/ab3a4519819e46ba945398957780f956 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:23:32.229206 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6424bc5-0d20-4b9f-8bae-5612311302f6 service placement] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:23:32.250748 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6424bc5-0d20-4b9f-8bae-5612311302f6 service placement] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:23:32.300858 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:23:32.335352 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542a5268-d4e2-412d-94b8-96ed0f826230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:23:32.336245 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542a5268-d4e2-412d-94b8-96ed0f826230 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:23:32.336616 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542a5268-d4e2-412d-94b8-96ed0f826230 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:23:32.336807 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542a5268-d4e2-412d-94b8-96ed0f826230 admin admin] PATH_INFO: `/v3/projects/dcf70712fd4e4235a0698238db7e1f3d` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:23:32.338464 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542a5268-d4e2-412d-94b8-96ed0f826230 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dcf70712fd4e4235a0698238db7e1f3d)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:23:32.340834 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542a5268-d4e2-412d-94b8-96ed0f826230 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:23:32.415693 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-542a5268-d4e2-412d-94b8-96ed0f826230 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dcf70712fd4e4235a0698238db7e1f3d', 'request_id': 'req-542a5268-d4e2-412d-94b8-96ed0f826230'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:23:32.426646 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-542a5268-d4e2-412d-94b8-96ed0f826230 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dcf70712fd4e4235a0698238db7e1f3d', 'request_id': 'req-542a5268-d4e2-412d-94b8-96ed0f826230'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:23:32.435001 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-542a5268-d4e2-412d-94b8-96ed0f826230 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dcf70712fd4e4235a0698238db7e1f3d', 'request_id': 'req-542a5268-d4e2-412d-94b8-96ed0f826230'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:23:32.446866 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-542a5268-d4e2-412d-94b8-96ed0f826230 admin admin] The token cache is being invalidate because project dcf70712fd4e4235a0698238db7e1f3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:23:32.447156 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-542a5268-d4e2-412d-94b8-96ed0f826230 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:23:32.447816 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-542a5268-d4e2-412d-94b8-96ed0f826230 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:23:32.450713 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1239/2493] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 5 12:23:32 2022] DELETE /identity/v3/projects/dcf70712fd4e4235a0698238db7e1f3d => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:23:32.454762 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4bbe1b-6700-4df7-bf28-6ce60269330d admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:23:32.456768 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-fb4bbe1b-6700-4df7-bf28-6ce60269330d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:23:32.470489 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4bbe1b-6700-4df7-bf28-6ce60269330d admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:23:32.549110 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0a8703-afad-4daf-b52c-464732c83ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:23:32.549771 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0a8703-afad-4daf-b52c-464732c83ec7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:23:32.550057 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0a8703-afad-4daf-b52c-464732c83ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:23:32.550334 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0a8703-afad-4daf-b52c-464732c83ec7 admin admin] PATH_INFO: `/v3/users/3647bfeea3344a80a9bb0a3ede380373` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:23:32.551557 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0a8703-afad-4daf-b52c-464732c83ec7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3647bfeea3344a80a9bb0a3ede380373)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:23:32.553601 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0a8703-afad-4daf-b52c-464732c83ec7 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:23:32.600433 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-5e0a8703-afad-4daf-b52c-464732c83ec7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3647bfeea3344a80a9bb0a3ede380373'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:23:32.601102 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-5e0a8703-afad-4daf-b52c-464732c83ec7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3647bfeea3344a80a9bb0a3ede380373'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:23:32.608910 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-5e0a8703-afad-4daf-b52c-464732c83ec7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3647bfeea3344a80a9bb0a3ede380373'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:23:32.609556 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-5e0a8703-afad-4daf-b52c-464732c83ec7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3647bfeea3344a80a9bb0a3ede380373'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:23:32.621347 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-5e0a8703-afad-4daf-b52c-464732c83ec7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3647bfeea3344a80a9bb0a3ede380373'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:23:32.623079 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:23:32.635888 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1255/2494] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 5 12:23:32 2022] DELETE /identity/v3/users/3647bfeea3344a80a9bb0a3ede380373 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 12:23:32.820598 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542a5268-d4e2-412d-94b8-96ed0f826230 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:23:32.821288 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-542a5268-d4e2-412d-94b8-96ed0f826230 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:23:32.844931 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542a5268-d4e2-412d-94b8-96ed0f826230 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:23:32.924263 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d57f1c3-a05c-492e-9f2d-08ffe84450de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:23:32.924945 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d57f1c3-a05c-492e-9f2d-08ffe84450de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:23:32.925239 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d57f1c3-a05c-492e-9f2d-08ffe84450de admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:23:32.925511 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d57f1c3-a05c-492e-9f2d-08ffe84450de admin admin] PATH_INFO: `/v3/projects/b4af6f679e5947968fd76098c7af67b4` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:23:32.926794 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d57f1c3-a05c-492e-9f2d-08ffe84450de admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4af6f679e5947968fd76098c7af67b4)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:23:32.928758 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d57f1c3-a05c-492e-9f2d-08ffe84450de admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:23:32.987290 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-4d57f1c3-a05c-492e-9f2d-08ffe84450de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4af6f679e5947968fd76098c7af67b4', 'request_id': 'req-4d57f1c3-a05c-492e-9f2d-08ffe84450de'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:23:32.999452 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-4d57f1c3-a05c-492e-9f2d-08ffe84450de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4af6f679e5947968fd76098c7af67b4', 'request_id': 'req-4d57f1c3-a05c-492e-9f2d-08ffe84450de'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:23:33.012006 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-4d57f1c3-a05c-492e-9f2d-08ffe84450de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4af6f679e5947968fd76098c7af67b4', 'request_id': 'req-4d57f1c3-a05c-492e-9f2d-08ffe84450de'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:23:33.020306 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:23:33.032253 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-4d57f1c3-a05c-492e-9f2d-08ffe84450de admin admin] The token cache is being invalidate because project b4af6f679e5947968fd76098c7af67b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:23:33.032621 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-4d57f1c3-a05c-492e-9f2d-08ffe84450de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:23:33.033262 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-4d57f1c3-a05c-492e-9f2d-08ffe84450de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:23:33.035082 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1240/2495] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 5 12:23:32 2022] DELETE /identity/v3/projects/b4af6f679e5947968fd76098c7af67b4 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:23:35.925098 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618acef6-d0a7-42af-9c26-ddfe7802e0bc None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:23:35.925655 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618acef6-d0a7-42af-9c26-ddfe7802e0bc None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:23:35.926098 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618acef6-d0a7-42af-9c26-ddfe7802e0bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:23:35.957380 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-618acef6-d0a7-42af-9c26-ddfe7802e0bc None None] MFA Rules not processed for user `bacc8ece8df24bf498c1d55ca2918224`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:23:35.958565 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-618acef6-d0a7-42af-9c26-ddfe7802e0bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:23:36.045856 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1256/2496] 10.222.0.50 () {58 vars in 967 bytes} [Mon Sep 5 12:23:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:23:36.061565 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d57f1c3-a05c-492e-9f2d-08ffe84450de admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:23:36.063609 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-4d57f1c3-a05c-492e-9f2d-08ffe84450de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:23:36.146836 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d57f1c3-a05c-492e-9f2d-08ffe84450de admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:23:36.152389 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c62dcc5-7c3b-434d-8f99-a4aaddf0be33 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2b32d58d964585a24e7c5784a8355f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:23:36.153233 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c62dcc5-7c3b-434d-8f99-a4aaddf0be33 service swift] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:23:36.153546 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c62dcc5-7c3b-434d-8f99-a4aaddf0be33 service swift] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:23:36.153825 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c62dcc5-7c3b-434d-8f99-a4aaddf0be33 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:23:36.163443 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c62dcc5-7c3b-434d-8f99-a4aaddf0be33 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:23:36.165099 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c62dcc5-7c3b-434d-8f99-a4aaddf0be33 service swift] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:23:36.175483 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1241/2497] 10.222.0.50 () {60 vars in 1384 bytes} [Mon Sep 5 12:23:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 05 12:23:43.500204 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618acef6-d0a7-42af-9c26-ddfe7802e0bc None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:23:43.501738 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-618acef6-d0a7-42af-9c26-ddfe7802e0bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:23:43.572163 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618acef6-d0a7-42af-9c26-ddfe7802e0bc None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:23:43.577517 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24a2e9a-3d80-48ef-bc4b-1a721b5f8eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:23:43.578191 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24a2e9a-3d80-48ef-bc4b-1a721b5f8eae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:23:43.578467 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24a2e9a-3d80-48ef-bc4b-1a721b5f8eae admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:23:43.578740 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24a2e9a-3d80-48ef-bc4b-1a721b5f8eae admin admin] PATH_INFO: `/v3/users/b91824e1a3b0405fae119a7fefaed088` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:23:43.579909 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24a2e9a-3d80-48ef-bc4b-1a721b5f8eae admin admin] RBAC: Authorizing `identity:delete_user(user_id=b91824e1a3b0405fae119a7fefaed088)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:23:43.581906 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24a2e9a-3d80-48ef-bc4b-1a721b5f8eae admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:23:43.635336 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-f24a2e9a-3d80-48ef-bc4b-1a721b5f8eae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b91824e1a3b0405fae119a7fefaed088'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:23:43.635981 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-f24a2e9a-3d80-48ef-bc4b-1a721b5f8eae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b91824e1a3b0405fae119a7fefaed088'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:23:43.645472 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-f24a2e9a-3d80-48ef-bc4b-1a721b5f8eae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b91824e1a3b0405fae119a7fefaed088'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:23:43.646112 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-f24a2e9a-3d80-48ef-bc4b-1a721b5f8eae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b91824e1a3b0405fae119a7fefaed088'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:23:43.659229 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-f24a2e9a-3d80-48ef-bc4b-1a721b5f8eae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b91824e1a3b0405fae119a7fefaed088'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:23:43.672668 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1257/2498] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 5 12:23:43 2022] DELETE /identity/v3/users/b91824e1a3b0405fae119a7fefaed088 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:23:43.677330 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4c9279-ebdd-474b-a51d-00d27d203382 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:23:43.677853 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4c9279-ebdd-474b-a51d-00d27d203382 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:23:43.677853 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4c9279-ebdd-474b-a51d-00d27d203382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:23:43.698867 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-ec4c9279-ebdd-474b-a51d-00d27d203382 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:23:43.700104 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-ec4c9279-ebdd-474b-a51d-00d27d203382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:23:43.763932 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1242/2499] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:23:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:23:43.774373 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24a2e9a-3d80-48ef-bc4b-1a721b5f8eae admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:23:43.775825 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-f24a2e9a-3d80-48ef-bc4b-1a721b5f8eae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:23:43.790289 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:23:43.834912 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24a2e9a-3d80-48ef-bc4b-1a721b5f8eae admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:23:43.838510 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aafd216-2533-4c17-9e02-8dc86e5f6d57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4994b4faa4ec4aa088f3dc32c9c5614d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:23:43.839105 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aafd216-2533-4c17-9e02-8dc86e5f6d57 service neutron] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:23:43.839382 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aafd216-2533-4c17-9e02-8dc86e5f6d57 service neutron] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:23:43.839653 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aafd216-2533-4c17-9e02-8dc86e5f6d57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:23:43.848701 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aafd216-2533-4c17-9e02-8dc86e5f6d57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:23:43.850164 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aafd216-2533-4c17-9e02-8dc86e5f6d57 service neutron] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:23:43.859908 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1258/2500] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:23:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:23:44.129171 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4c9279-ebdd-474b-a51d-00d27d203382 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:23:44.130588 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-ec4c9279-ebdd-474b-a51d-00d27d203382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:23:44.142839 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4c9279-ebdd-474b-a51d-00d27d203382 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:23:44.147394 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8febf1db-18e4-481e-8408-020f7cfe9d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:23:44.148054 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8febf1db-18e4-481e-8408-020f7cfe9d06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:23:44.148334 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8febf1db-18e4-481e-8408-020f7cfe9d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:23:44.148604 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8febf1db-18e4-481e-8408-020f7cfe9d06 admin admin] PATH_INFO: `/v3/projects/d0a7e5ad0f3f4cf9b78e9e8a0b68f475` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:23:44.149745 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8febf1db-18e4-481e-8408-020f7cfe9d06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0a7e5ad0f3f4cf9b78e9e8a0b68f475)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:23:44.151652 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8febf1db-18e4-481e-8408-020f7cfe9d06 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:23:44.201938 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-8febf1db-18e4-481e-8408-020f7cfe9d06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0a7e5ad0f3f4cf9b78e9e8a0b68f475', 'request_id': 'req-8febf1db-18e4-481e-8408-020f7cfe9d06'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:23:44.209319 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-8febf1db-18e4-481e-8408-020f7cfe9d06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0a7e5ad0f3f4cf9b78e9e8a0b68f475', 'request_id': 'req-8febf1db-18e4-481e-8408-020f7cfe9d06'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:23:44.216280 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-8febf1db-18e4-481e-8408-020f7cfe9d06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0a7e5ad0f3f4cf9b78e9e8a0b68f475', 'request_id': 'req-8febf1db-18e4-481e-8408-020f7cfe9d06'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:23:44.226495 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-8febf1db-18e4-481e-8408-020f7cfe9d06 admin admin] The token cache is being invalidate because project d0a7e5ad0f3f4cf9b78e9e8a0b68f475 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:23:44.226778 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-8febf1db-18e4-481e-8408-020f7cfe9d06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:23:44.227416 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-8febf1db-18e4-481e-8408-020f7cfe9d06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:23:44.228913 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1243/2501] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 5 12:23:44 2022] DELETE /identity/v3/projects/d0a7e5ad0f3f4cf9b78e9e8a0b68f475 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:23:44.233559 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aafd216-2533-4c17-9e02-8dc86e5f6d57 service neutron] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:23:44.244632 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aafd216-2533-4c17-9e02-8dc86e5f6d57 service neutron] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:23:44.303020 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347e0111-7709-476c-a9b6-fa58d2c6e9fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:23:44.303657 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347e0111-7709-476c-a9b6-fa58d2c6e9fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:23:44.303941 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347e0111-7709-476c-a9b6-fa58d2c6e9fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:23:44.304217 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347e0111-7709-476c-a9b6-fa58d2c6e9fd admin admin] PATH_INFO: `/v3/users/cf7ad4eb575e477594aef93f43f49dce` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:23:44.305373 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347e0111-7709-476c-a9b6-fa58d2c6e9fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf7ad4eb575e477594aef93f43f49dce)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:23:44.307286 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347e0111-7709-476c-a9b6-fa58d2c6e9fd admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:23:44.368034 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-347e0111-7709-476c-a9b6-fa58d2c6e9fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf7ad4eb575e477594aef93f43f49dce'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:23:44.368706 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-347e0111-7709-476c-a9b6-fa58d2c6e9fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf7ad4eb575e477594aef93f43f49dce'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:23:44.376462 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-347e0111-7709-476c-a9b6-fa58d2c6e9fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf7ad4eb575e477594aef93f43f49dce'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:23:44.377111 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-347e0111-7709-476c-a9b6-fa58d2c6e9fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf7ad4eb575e477594aef93f43f49dce'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:23:44.389082 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-347e0111-7709-476c-a9b6-fa58d2c6e9fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf7ad4eb575e477594aef93f43f49dce'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:23:44.401457 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1259/2502] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 5 12:23:44 2022] DELETE /identity/v3/users/cf7ad4eb575e477594aef93f43f49dce => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:23:44.677676 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8febf1db-18e4-481e-8408-020f7cfe9d06 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:23:44.679228 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-8febf1db-18e4-481e-8408-020f7cfe9d06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:23:44.696479 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8febf1db-18e4-481e-8408-020f7cfe9d06 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:23:44.700635 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:23:44.770627 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a698973d-6ff1-4886-81b5-4fee0a11dc14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:23:44.771165 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a698973d-6ff1-4886-81b5-4fee0a11dc14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:23:44.771445 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a698973d-6ff1-4886-81b5-4fee0a11dc14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:23:44.771721 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a698973d-6ff1-4886-81b5-4fee0a11dc14 admin admin] PATH_INFO: `/v3/projects/2b7f9d6e34be45309fcd8cf9924ad8f3` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:23:44.772918 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a698973d-6ff1-4886-81b5-4fee0a11dc14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b7f9d6e34be45309fcd8cf9924ad8f3)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:23:44.774847 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a698973d-6ff1-4886-81b5-4fee0a11dc14 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:23:44.828867 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-a698973d-6ff1-4886-81b5-4fee0a11dc14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b7f9d6e34be45309fcd8cf9924ad8f3', 'request_id': 'req-a698973d-6ff1-4886-81b5-4fee0a11dc14'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:23:44.837807 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-a698973d-6ff1-4886-81b5-4fee0a11dc14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b7f9d6e34be45309fcd8cf9924ad8f3', 'request_id': 'req-a698973d-6ff1-4886-81b5-4fee0a11dc14'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:23:44.845166 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-a698973d-6ff1-4886-81b5-4fee0a11dc14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b7f9d6e34be45309fcd8cf9924ad8f3', 'request_id': 'req-a698973d-6ff1-4886-81b5-4fee0a11dc14'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:23:44.861411 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-a698973d-6ff1-4886-81b5-4fee0a11dc14 admin admin] The token cache is being invalidate because project 2b7f9d6e34be45309fcd8cf9924ad8f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:23:44.861930 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-a698973d-6ff1-4886-81b5-4fee0a11dc14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:23:44.862996 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-a698973d-6ff1-4886-81b5-4fee0a11dc14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:23:44.865517 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1244/2503] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 5 12:23:44 2022] DELETE /identity/v3/projects/2b7f9d6e34be45309fcd8cf9924ad8f3 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:23:44.872414 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581939e9-7439-407d-bb22-202668bc9a48 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:23:44.873007 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581939e9-7439-407d-bb22-202668bc9a48 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:23:44.873007 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581939e9-7439-407d-bb22-202668bc9a48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:23:44.893478 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-581939e9-7439-407d-bb22-202668bc9a48 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:23:44.894707 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-581939e9-7439-407d-bb22-202668bc9a48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:23:44.928496 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:23:44.960968 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1260/2504] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:23:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:23:44.969514 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4624f2b9-73b5-4013-87f8-13881bed933a None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:23:44.969825 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4624f2b9-73b5-4013-87f8-13881bed933a None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:23:44.970097 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4624f2b9-73b5-4013-87f8-13881bed933a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:23:44.990969 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-4624f2b9-73b5-4013-87f8-13881bed933a None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:23:44.992187 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-4624f2b9-73b5-4013-87f8-13881bed933a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:23:45.000017 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1245/2505] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:23:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:23:45.004528 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581939e9-7439-407d-bb22-202668bc9a48 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:23:45.014323 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581939e9-7439-407d-bb22-202668bc9a48 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:23:45.019085 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de883af1-099c-4b3e-b1af-2dcac0e53cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:23:45.019674 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de883af1-099c-4b3e-b1af-2dcac0e53cfb admin admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:23:45.019951 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de883af1-099c-4b3e-b1af-2dcac0e53cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:23:45.020220 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de883af1-099c-4b3e-b1af-2dcac0e53cfb admin admin] PATH_INFO: `/v3/domains` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:23:45.020929 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de883af1-099c-4b3e-b1af-2dcac0e53cfb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:23:45.021192 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de883af1-099c-4b3e-b1af-2dcac0e53cfb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:23:45.022775 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de883af1-099c-4b3e-b1af-2dcac0e53cfb admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:23:45.035313 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1261/2506] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Sep 5 12:23:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:23:45.040026 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4624f2b9-73b5-4013-87f8-13881bed933a None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:23:45.050080 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4624f2b9-73b5-4013-87f8-13881bed933a None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:23:45.054726 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c479527-2a67-4a9a-877f-58542c23b47c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:23:45.055325 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c479527-2a67-4a9a-877f-58542c23b47c admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:23:45.055602 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c479527-2a67-4a9a-877f-58542c23b47c admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:23:45.055871 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c479527-2a67-4a9a-877f-58542c23b47c admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:23:45.056509 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c479527-2a67-4a9a-877f-58542c23b47c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:23:45.058450 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c479527-2a67-4a9a-877f-58542c23b47c admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:23:45.086784 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1246/2507] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 5 12:23:45 2022] POST /identity/v3/projects => generated 357 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:23:45.091472 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de883af1-099c-4b3e-b1af-2dcac0e53cfb admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:23:45.101414 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de883af1-099c-4b3e-b1af-2dcac0e53cfb admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:23:45.158107 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77083dde-ba27-4e46-8649-34f92e2c4a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:23:45.158708 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77083dde-ba27-4e46-8649-34f92e2c4a10 admin admin] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:23:45.158991 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77083dde-ba27-4e46-8649-34f92e2c4a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:23:45.159302 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77083dde-ba27-4e46-8649-34f92e2c4a10 admin admin] PATH_INFO: `/v3/users` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:23:45.159918 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77083dde-ba27-4e46-8649-34f92e2c4a10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:23:45.161873 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77083dde-ba27-4e46-8649-34f92e2c4a10 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:23:45.183412 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1262/2508] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 5 12:23:45 2022] POST /identity/v3/users => generated 279 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:23:45.187607 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c479527-2a67-4a9a-877f-58542c23b47c admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:23:45.197971 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c479527-2a67-4a9a-877f-58542c23b47c admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:23:45.203256 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42784162-e828-4ba0-bb9a-258e2aaad054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:23:45.203874 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42784162-e828-4ba0-bb9a-258e2aaad054 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:23:45.204154 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42784162-e828-4ba0-bb9a-258e2aaad054 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:23:45.204457 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42784162-e828-4ba0-bb9a-258e2aaad054 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:23:45.205125 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42784162-e828-4ba0-bb9a-258e2aaad054 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:23:45.206720 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42784162-e828-4ba0-bb9a-258e2aaad054 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:23:45.217536 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1247/2509] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:23:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:23:45.221706 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77083dde-ba27-4e46-8649-34f92e2c4a10 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:23:45.232067 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77083dde-ba27-4e46-8649-34f92e2c4a10 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:23:45.236696 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aac887-e54b-4749-aed5-f08aefb688c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:23:45.237330 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aac887-e54b-4749-aed5-f08aefb688c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:23:45.237609 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aac887-e54b-4749-aed5-f08aefb688c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:23:45.237882 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aac887-e54b-4749-aed5-f08aefb688c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:23:45.238528 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3aac887-e54b-4749-aed5-f08aefb688c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:23:45.240116 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3aac887-e54b-4749-aed5-f08aefb688c9 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:23:45.251429 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1263/2510] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:23:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:23:45.255744 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42784162-e828-4ba0-bb9a-258e2aaad054 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:23:45.266454 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42784162-e828-4ba0-bb9a-258e2aaad054 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:23:45.271055 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943817f2-4a81-4152-858f-cc5b7a6db525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:23:45.271630 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943817f2-4a81-4152-858f-cc5b7a6db525 admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:23:45.271905 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943817f2-4a81-4152-858f-cc5b7a6db525 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:23:45.272174 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943817f2-4a81-4152-858f-cc5b7a6db525 admin admin] PATH_INFO: `/v3/projects/6410630559db4860a418a611323c07cf/users/905fb2a33cf647db8d79b372b9553d85/roles/ed72181e1403401facb77dcf33644757` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:23:45.287024 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943817f2-4a81-4152-858f-cc5b7a6db525 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6410630559db4860a418a611323c07cf, user_id=905fb2a33cf647db8d79b372b9553d85, role_id=ed72181e1403401facb77dcf33644757)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:23:45.289722 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943817f2-4a81-4152-858f-cc5b7a6db525 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:23:45.302242 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1248/2511] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 5 12:23:45 2022] PUT /identity/v3/projects/6410630559db4860a418a611323c07cf/users/905fb2a33cf647db8d79b372b9553d85/roles/ed72181e1403401facb77dcf33644757 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:23:45.313538 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db104c01-5bf5-417c-9c4b-12fa837decbd None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:23:45.313821 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db104c01-5bf5-417c-9c4b-12fa837decbd None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:23:45.314090 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db104c01-5bf5-417c-9c4b-12fa837decbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:23:45.342090 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-db104c01-5bf5-417c-9c4b-12fa837decbd None None] MFA Rules not processed for user `905fb2a33cf647db8d79b372b9553d85`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:23:45.343288 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-db104c01-5bf5-417c-9c4b-12fa837decbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:23:45.406688 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1264/2512] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:23:45 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:23:45.411163 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943817f2-4a81-4152-858f-cc5b7a6db525 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:23:45.444918 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:23:45.476041 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943817f2-4a81-4152-858f-cc5b7a6db525 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:23:45.480672 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffdf59e-dbb5-4992-949f-7d92e21d6b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:23:45.481318 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffdf59e-dbb5-4992-949f-7d92e21d6b97 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:23:45.481604 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffdf59e-dbb5-4992-949f-7d92e21d6b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:23:45.481886 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffdf59e-dbb5-4992-949f-7d92e21d6b97 admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:23:45.482540 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffdf59e-dbb5-4992-949f-7d92e21d6b97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:23:45.484443 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffdf59e-dbb5-4992-949f-7d92e21d6b97 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:23:45.510796 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1249/2513] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 5 12:23:45 2022] POST /identity/v3/projects => generated 355 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:23:45.515694 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db104c01-5bf5-417c-9c4b-12fa837decbd None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:23:45.526476 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db104c01-5bf5-417c-9c4b-12fa837decbd None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:23:45.555326 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:23:45.584681 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8014c661-6de3-4977-9d6f-9f95220a159d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:23:45.585313 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8014c661-6de3-4977-9d6f-9f95220a159d admin admin] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:23:45.585598 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8014c661-6de3-4977-9d6f-9f95220a159d admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:23:45.585873 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8014c661-6de3-4977-9d6f-9f95220a159d admin admin] PATH_INFO: `/v3/users` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:23:45.586540 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8014c661-6de3-4977-9d6f-9f95220a159d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:23:45.588465 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8014c661-6de3-4977-9d6f-9f95220a159d admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:23:45.609573 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1265/2514] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 5 12:23:45 2022] POST /identity/v3/users => generated 284 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 12:23:45.613568 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffdf59e-dbb5-4992-949f-7d92e21d6b97 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:23:45.624350 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffdf59e-dbb5-4992-949f-7d92e21d6b97 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:23:45.628767 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6874981-e514-4e37-bc6e-bcbc5fe1a4a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:23:45.629392 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6874981-e514-4e37-bc6e-bcbc5fe1a4a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:23:45.629671 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6874981-e514-4e37-bc6e-bcbc5fe1a4a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:23:45.629941 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6874981-e514-4e37-bc6e-bcbc5fe1a4a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:23:45.630571 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6874981-e514-4e37-bc6e-bcbc5fe1a4a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:23:45.632277 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6874981-e514-4e37-bc6e-bcbc5fe1a4a0 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:23:45.643454 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1250/2515] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:23:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:23:45.647590 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8014c661-6de3-4977-9d6f-9f95220a159d admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:23:45.657648 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8014c661-6de3-4977-9d6f-9f95220a159d admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:23:45.662289 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f8a60b-4e14-44f5-bf7e-af475d09fe7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:23:45.662962 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f8a60b-4e14-44f5-bf7e-af475d09fe7e admin admin] REQUEST_METHOD: `PUT` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:23:45.663240 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f8a60b-4e14-44f5-bf7e-af475d09fe7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:23:45.663509 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f8a60b-4e14-44f5-bf7e-af475d09fe7e admin admin] PATH_INFO: `/v3/projects/b8462da1f1424d37ab5545d18fd77a31/users/20d1e8cd25d24bdf91091592c3bd9510/roles/16e2ccc8bd1b497d8cee780c1c7df0d2` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:23:45.679412 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f8a60b-4e14-44f5-bf7e-af475d09fe7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8462da1f1424d37ab5545d18fd77a31, user_id=20d1e8cd25d24bdf91091592c3bd9510, role_id=16e2ccc8bd1b497d8cee780c1c7df0d2)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:23:45.682063 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f8a60b-4e14-44f5-bf7e-af475d09fe7e admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:23:45.695618 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1266/2516] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 5 12:23:45 2022] PUT /identity/v3/projects/b8462da1f1424d37ab5545d18fd77a31/users/20d1e8cd25d24bdf91091592c3bd9510/roles/16e2ccc8bd1b497d8cee780c1c7df0d2 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:23:45.700327 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6874981-e514-4e37-bc6e-bcbc5fe1a4a0 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:23:45.710163 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6874981-e514-4e37-bc6e-bcbc5fe1a4a0 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:23:45.767508 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d3f61d-1cbc-4e71-8250-a19a2eb5067e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:23:45.768120 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d3f61d-1cbc-4e71-8250-a19a2eb5067e admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:23:45.768399 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d3f61d-1cbc-4e71-8250-a19a2eb5067e admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:23:45.768672 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d3f61d-1cbc-4e71-8250-a19a2eb5067e admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:23:45.769359 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d3f61d-1cbc-4e71-8250-a19a2eb5067e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:23:45.770953 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d3f61d-1cbc-4e71-8250-a19a2eb5067e admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:23:45.781316 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1251/2517] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:23:45 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:23:45.786055 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f8a60b-4e14-44f5-bf7e-af475d09fe7e admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:23:45.797052 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f8a60b-4e14-44f5-bf7e-af475d09fe7e admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:23:45.801821 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e58211-b751-42fc-92a2-a8660885d34c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:23:45.802480 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e58211-b751-42fc-92a2-a8660885d34c admin admin] REQUEST_METHOD: `PUT` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:23:45.802756 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e58211-b751-42fc-92a2-a8660885d34c admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:23:45.803032 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e58211-b751-42fc-92a2-a8660885d34c admin admin] PATH_INFO: `/v3/projects/b8462da1f1424d37ab5545d18fd77a31/users/20d1e8cd25d24bdf91091592c3bd9510/roles/16e2ccc8bd1b497d8cee780c1c7df0d2` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:23:45.804952 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e58211-b751-42fc-92a2-a8660885d34c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8462da1f1424d37ab5545d18fd77a31, user_id=20d1e8cd25d24bdf91091592c3bd9510, role_id=16e2ccc8bd1b497d8cee780c1c7df0d2)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:23:45.807558 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e58211-b751-42fc-92a2-a8660885d34c admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:23:45.818781 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1267/2518] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 5 12:23:45 2022] PUT /identity/v3/projects/b8462da1f1424d37ab5545d18fd77a31/users/20d1e8cd25d24bdf91091592c3bd9510/roles/16e2ccc8bd1b497d8cee780c1c7df0d2 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 12:23:45.830253 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f799404d-4018-4f95-be87-9dd195d51fbf None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:23:45.830670 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f799404d-4018-4f95-be87-9dd195d51fbf None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:23:45.831132 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f799404d-4018-4f95-be87-9dd195d51fbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:23:45.860044 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-f799404d-4018-4f95-be87-9dd195d51fbf None None] MFA Rules not processed for user `20d1e8cd25d24bdf91091592c3bd9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:23:45.861309 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-f799404d-4018-4f95-be87-9dd195d51fbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:23:45.931906 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1252/2519] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:23:45 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:23:45.944166 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e58211-b751-42fc-92a2-a8660885d34c admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:23:45.946012 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-d0e58211-b751-42fc-92a2-a8660885d34c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:23:46.008074 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e58211-b751-42fc-92a2-a8660885d34c admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:23:46.011725 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9417d345-71bc-4c6f-95ae-1204b9e005ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37633bbae0c2423c81ccd61ac3a17ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:23:46.012373 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9417d345-71bc-4c6f-95ae-1204b9e005ae service cinder] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:23:46.012652 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9417d345-71bc-4c6f-95ae-1204b9e005ae service cinder] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:23:46.012942 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9417d345-71bc-4c6f-95ae-1204b9e005ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:23:46.022858 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9417d345-71bc-4c6f-95ae-1204b9e005ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:23:46.024328 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9417d345-71bc-4c6f-95ae-1204b9e005ae service cinder] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:23:46.035177 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1268/2520] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:23:45 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:23:46.132411 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f799404d-4018-4f95-be87-9dd195d51fbf None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:23:46.142484 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f799404d-4018-4f95-be87-9dd195d51fbf None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:23:46.146130 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94846d60-9e60-4b19-a4fa-e293d7da81fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37633bbae0c2423c81ccd61ac3a17ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:23:46.146739 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94846d60-9e60-4b19-a4fa-e293d7da81fd service cinder] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:23:46.147016 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94846d60-9e60-4b19-a4fa-e293d7da81fd service cinder] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:23:46.147286 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94846d60-9e60-4b19-a4fa-e293d7da81fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:23:46.176865 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:23:46.215449 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94846d60-9e60-4b19-a4fa-e293d7da81fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:23:46.216932 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94846d60-9e60-4b19-a4fa-e293d7da81fd service cinder] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:23:46.230283 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1253/2521] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:23:46 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:23:56.030303 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=56,keystone:INSERT=5 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:23:56.222699 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=15 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:24:01.390927 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9417d345-71bc-4c6f-95ae-1204b9e005ae service cinder] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:01.466075 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9417d345-71bc-4c6f-95ae-1204b9e005ae service cinder] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:01.470798 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8262d6-bcc8-4bf4-a7ac-95fd869d34b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:01.471453 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8262d6-bcc8-4bf4-a7ac-95fd869d34b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:01.471736 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8262d6-bcc8-4bf4-a7ac-95fd869d34b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:01.472027 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8262d6-bcc8-4bf4-a7ac-95fd869d34b9 admin admin] PATH_INFO: `/v3/users/905fb2a33cf647db8d79b372b9553d85` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:01.473234 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8262d6-bcc8-4bf4-a7ac-95fd869d34b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=905fb2a33cf647db8d79b372b9553d85)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:01.475197 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8262d6-bcc8-4bf4-a7ac-95fd869d34b9 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:01.530007 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-9d8262d6-bcc8-4bf4-a7ac-95fd869d34b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '905fb2a33cf647db8d79b372b9553d85'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:01.530783 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-9d8262d6-bcc8-4bf4-a7ac-95fd869d34b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '905fb2a33cf647db8d79b372b9553d85'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:01.540001 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-9d8262d6-bcc8-4bf4-a7ac-95fd869d34b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '905fb2a33cf647db8d79b372b9553d85'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:01.540752 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-9d8262d6-bcc8-4bf4-a7ac-95fd869d34b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '905fb2a33cf647db8d79b372b9553d85'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:01.554658 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-9d8262d6-bcc8-4bf4-a7ac-95fd869d34b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '905fb2a33cf647db8d79b372b9553d85'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:01.568694 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1269/2522] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 5 12:24:01 2022] DELETE /identity/v3/users/905fb2a33cf647db8d79b372b9553d85 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:24:01.573285 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11acf7ec-41fb-4510-8789-4ad077bf3615 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:01.573801 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11acf7ec-41fb-4510-8789-4ad077bf3615 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:01.573943 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11acf7ec-41fb-4510-8789-4ad077bf3615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:01.594158 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-11acf7ec-41fb-4510-8789-4ad077bf3615 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:24:01.595774 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-11acf7ec-41fb-4510-8789-4ad077bf3615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:01.663373 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1254/2523] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:24:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:24:01.676022 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8262d6-bcc8-4bf4-a7ac-95fd869d34b9 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:01.677789 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-9d8262d6-bcc8-4bf4-a7ac-95fd869d34b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:01.745322 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8262d6-bcc8-4bf4-a7ac-95fd869d34b9 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:01.749701 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e17abb-0336-4f0f-892b-513d7657f9ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4994b4faa4ec4aa088f3dc32c9c5614d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:01.750321 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e17abb-0336-4f0f-892b-513d7657f9ac service neutron] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:01.750600 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e17abb-0336-4f0f-892b-513d7657f9ac service neutron] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:01.750868 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e17abb-0336-4f0f-892b-513d7657f9ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:01.764625 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e17abb-0336-4f0f-892b-513d7657f9ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:01.766628 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e17abb-0336-4f0f-892b-513d7657f9ac service neutron] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:01.778942 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1270/2524] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:24:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:24:02.067181 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11acf7ec-41fb-4510-8789-4ad077bf3615 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:02.068670 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-11acf7ec-41fb-4510-8789-4ad077bf3615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:02.081394 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11acf7ec-41fb-4510-8789-4ad077bf3615 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:02.088230 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7186bf45-d866-4e2c-8ab1-dcf4ff97cd7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:02.089106 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7186bf45-d866-4e2c-8ab1-dcf4ff97cd7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:02.089573 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7186bf45-d866-4e2c-8ab1-dcf4ff97cd7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:02.090649 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7186bf45-d866-4e2c-8ab1-dcf4ff97cd7b admin admin] PATH_INFO: `/v3/projects/6410630559db4860a418a611323c07cf` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:02.092224 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7186bf45-d866-4e2c-8ab1-dcf4ff97cd7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6410630559db4860a418a611323c07cf)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:02.094662 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7186bf45-d866-4e2c-8ab1-dcf4ff97cd7b admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:02.175002 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-7186bf45-d866-4e2c-8ab1-dcf4ff97cd7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6410630559db4860a418a611323c07cf', 'request_id': 'req-7186bf45-d866-4e2c-8ab1-dcf4ff97cd7b'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:02.184709 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-7186bf45-d866-4e2c-8ab1-dcf4ff97cd7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6410630559db4860a418a611323c07cf', 'request_id': 'req-7186bf45-d866-4e2c-8ab1-dcf4ff97cd7b'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:02.192561 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-7186bf45-d866-4e2c-8ab1-dcf4ff97cd7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6410630559db4860a418a611323c07cf', 'request_id': 'req-7186bf45-d866-4e2c-8ab1-dcf4ff97cd7b'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:02.204440 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-7186bf45-d866-4e2c-8ab1-dcf4ff97cd7b admin admin] The token cache is being invalidate because project 6410630559db4860a418a611323c07cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:24:02.204747 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-7186bf45-d866-4e2c-8ab1-dcf4ff97cd7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:02.205443 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-7186bf45-d866-4e2c-8ab1-dcf4ff97cd7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:02.207008 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1255/2525] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 5 12:24:02 2022] DELETE /identity/v3/projects/6410630559db4860a418a611323c07cf => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 12:24:02.211401 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e17abb-0336-4f0f-892b-513d7657f9ac service neutron] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:02.222176 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e17abb-0336-4f0f-892b-513d7657f9ac service neutron] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:02.252736 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:24:02.299722 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bcdb13-bb4c-4497-b687-3f823048ea05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:02.300421 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bcdb13-bb4c-4497-b687-3f823048ea05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:02.300740 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bcdb13-bb4c-4497-b687-3f823048ea05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:02.301091 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bcdb13-bb4c-4497-b687-3f823048ea05 admin admin] PATH_INFO: `/v3/users/20d1e8cd25d24bdf91091592c3bd9510` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:02.302334 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bcdb13-bb4c-4497-b687-3f823048ea05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20d1e8cd25d24bdf91091592c3bd9510)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:02.304365 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bcdb13-bb4c-4497-b687-3f823048ea05 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:02.368527 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-f2bcdb13-bb4c-4497-b687-3f823048ea05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20d1e8cd25d24bdf91091592c3bd9510'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:02.369631 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-f2bcdb13-bb4c-4497-b687-3f823048ea05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20d1e8cd25d24bdf91091592c3bd9510'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:02.378996 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-f2bcdb13-bb4c-4497-b687-3f823048ea05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20d1e8cd25d24bdf91091592c3bd9510'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:02.379945 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-f2bcdb13-bb4c-4497-b687-3f823048ea05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20d1e8cd25d24bdf91091592c3bd9510'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:02.399823 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-f2bcdb13-bb4c-4497-b687-3f823048ea05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20d1e8cd25d24bdf91091592c3bd9510'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:02.420549 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1271/2526] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 5 12:24:02 2022] DELETE /identity/v3/users/20d1e8cd25d24bdf91091592c3bd9510 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:24:02.800865 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7186bf45-d866-4e2c-8ab1-dcf4ff97cd7b admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:02.802843 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-7186bf45-d866-4e2c-8ab1-dcf4ff97cd7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:02.818041 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7186bf45-d866-4e2c-8ab1-dcf4ff97cd7b admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:02.892428 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d0421c-e5a3-46ea-89e8-f1af24949b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:02.893126 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d0421c-e5a3-46ea-89e8-f1af24949b61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:02.893602 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d0421c-e5a3-46ea-89e8-f1af24949b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:02.894151 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d0421c-e5a3-46ea-89e8-f1af24949b61 admin admin] PATH_INFO: `/v3/projects/b8462da1f1424d37ab5545d18fd77a31` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:02.896250 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d0421c-e5a3-46ea-89e8-f1af24949b61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8462da1f1424d37ab5545d18fd77a31)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:02.899733 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d0421c-e5a3-46ea-89e8-f1af24949b61 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:02.955682 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:24:02.987298 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-46d0421c-e5a3-46ea-89e8-f1af24949b61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8462da1f1424d37ab5545d18fd77a31', 'request_id': 'req-46d0421c-e5a3-46ea-89e8-f1af24949b61'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:02.999417 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-46d0421c-e5a3-46ea-89e8-f1af24949b61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8462da1f1424d37ab5545d18fd77a31', 'request_id': 'req-46d0421c-e5a3-46ea-89e8-f1af24949b61'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:03.007456 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-46d0421c-e5a3-46ea-89e8-f1af24949b61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8462da1f1424d37ab5545d18fd77a31', 'request_id': 'req-46d0421c-e5a3-46ea-89e8-f1af24949b61'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:03.019799 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-46d0421c-e5a3-46ea-89e8-f1af24949b61 admin admin] The token cache is being invalidate because project b8462da1f1424d37ab5545d18fd77a31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:24:03.020075 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-46d0421c-e5a3-46ea-89e8-f1af24949b61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:03.020746 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-46d0421c-e5a3-46ea-89e8-f1af24949b61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:03.022310 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1256/2527] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 5 12:24:02 2022] DELETE /identity/v3/projects/b8462da1f1424d37ab5545d18fd77a31 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:24:03.027810 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578fc345-8cad-469a-bdcc-bae4aaf11e53 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:03.028139 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578fc345-8cad-469a-bdcc-bae4aaf11e53 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:03.028452 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578fc345-8cad-469a-bdcc-bae4aaf11e53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:03.050438 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-578fc345-8cad-469a-bdcc-bae4aaf11e53 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:24:03.051772 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-578fc345-8cad-469a-bdcc-bae4aaf11e53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:03.136385 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1272/2528] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:24:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:24:03.145839 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138b40a9-af8b-439f-977c-b70c5a44c737 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:03.146124 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138b40a9-af8b-439f-977c-b70c5a44c737 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:03.146397 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138b40a9-af8b-439f-977c-b70c5a44c737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:03.167093 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-138b40a9-af8b-439f-977c-b70c5a44c737 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:24:03.168880 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-138b40a9-af8b-439f-977c-b70c5a44c737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:03.177161 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1257/2529] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:24:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:24:03.181690 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578fc345-8cad-469a-bdcc-bae4aaf11e53 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:03.192598 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578fc345-8cad-469a-bdcc-bae4aaf11e53 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:03.197435 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dd9516-a449-4533-b22f-eeef1d60ccc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:03.198058 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dd9516-a449-4533-b22f-eeef1d60ccc0 admin admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:03.198343 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dd9516-a449-4533-b22f-eeef1d60ccc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:03.198620 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dd9516-a449-4533-b22f-eeef1d60ccc0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:03.199389 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dd9516-a449-4533-b22f-eeef1d60ccc0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:24:03.199708 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dd9516-a449-4533-b22f-eeef1d60ccc0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:03.201469 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dd9516-a449-4533-b22f-eeef1d60ccc0 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:03.214517 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1273/2530] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Sep 5 12:24:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:24:03.221994 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138b40a9-af8b-439f-977c-b70c5a44c737 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:03.237802 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138b40a9-af8b-439f-977c-b70c5a44c737 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:03.245706 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedad948-f25d-4032-b34c-03bc97b89c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:03.247058 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedad948-f25d-4032-b34c-03bc97b89c11 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:03.247686 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedad948-f25d-4032-b34c-03bc97b89c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:03.248333 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedad948-f25d-4032-b34c-03bc97b89c11 admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:03.249517 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedad948-f25d-4032-b34c-03bc97b89c11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:03.252923 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedad948-f25d-4032-b34c-03bc97b89c11 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:03.295307 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1258/2531] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 5 12:24:03 2022] POST /identity/v3/projects => generated 369 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:24:03.301345 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dd9516-a449-4533-b22f-eeef1d60ccc0 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:03.312204 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dd9516-a449-4533-b22f-eeef1d60ccc0 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:03.342132 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:24:03.378882 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ce7d2a-b52a-4603-b80e-ed1a73932cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:03.379570 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ce7d2a-b52a-4603-b80e-ed1a73932cc5 admin admin] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:03.379902 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ce7d2a-b52a-4603-b80e-ed1a73932cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:03.380224 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ce7d2a-b52a-4603-b80e-ed1a73932cc5 admin admin] PATH_INFO: `/v3/users` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:03.380954 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ce7d2a-b52a-4603-b80e-ed1a73932cc5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:03.383058 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ce7d2a-b52a-4603-b80e-ed1a73932cc5 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:03.407356 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1274/2532] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 5 12:24:03 2022] POST /identity/v3/users => generated 285 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:24:03.412140 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedad948-f25d-4032-b34c-03bc97b89c11 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:03.423006 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedad948-f25d-4032-b34c-03bc97b89c11 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:03.429725 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5160f8-246f-44e1-9c3e-1db8b969e495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:03.430730 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5160f8-246f-44e1-9c3e-1db8b969e495 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:03.431160 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5160f8-246f-44e1-9c3e-1db8b969e495 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:03.431608 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5160f8-246f-44e1-9c3e-1db8b969e495 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:03.432725 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5160f8-246f-44e1-9c3e-1db8b969e495 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:03.436215 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5160f8-246f-44e1-9c3e-1db8b969e495 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:03.456080 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1259/2533] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:24:03 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 12:24:03.461037 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ce7d2a-b52a-4603-b80e-ed1a73932cc5 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:03.475770 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ce7d2a-b52a-4603-b80e-ed1a73932cc5 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:03.480619 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d41a200-58e3-4514-9d3d-eb7c10b65dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:03.481324 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d41a200-58e3-4514-9d3d-eb7c10b65dcc admin admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:03.481648 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d41a200-58e3-4514-9d3d-eb7c10b65dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:03.481973 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d41a200-58e3-4514-9d3d-eb7c10b65dcc admin admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:03.482689 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d41a200-58e3-4514-9d3d-eb7c10b65dcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:03.484415 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d41a200-58e3-4514-9d3d-eb7c10b65dcc admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:03.497650 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1275/2534] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:24:03 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:24:03.502265 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5160f8-246f-44e1-9c3e-1db8b969e495 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:03.513328 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5160f8-246f-44e1-9c3e-1db8b969e495 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:03.518471 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24af4604-0727-4f31-addb-477caafbaac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:03.519160 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24af4604-0727-4f31-addb-477caafbaac0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:03.519436 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24af4604-0727-4f31-addb-477caafbaac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:03.519710 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24af4604-0727-4f31-addb-477caafbaac0 admin admin] PATH_INFO: `/v3/projects/0b885bd0da584ffe9bcb4dcec84d3a1c/users/a16a2786b5174034a2be92c14478c98c/roles/ed72181e1403401facb77dcf33644757` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:03.536833 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24af4604-0727-4f31-addb-477caafbaac0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b885bd0da584ffe9bcb4dcec84d3a1c, user_id=a16a2786b5174034a2be92c14478c98c, role_id=ed72181e1403401facb77dcf33644757)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:03.539624 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24af4604-0727-4f31-addb-477caafbaac0 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:03.554941 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1260/2535] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 5 12:24:03 2022] PUT /identity/v3/projects/0b885bd0da584ffe9bcb4dcec84d3a1c/users/a16a2786b5174034a2be92c14478c98c/roles/ed72181e1403401facb77dcf33644757 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:24:03.566871 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8e88cf-9266-4c30-8422-423182be0015 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:03.567198 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8e88cf-9266-4c30-8422-423182be0015 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:03.567482 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8e88cf-9266-4c30-8422-423182be0015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:03.602483 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-2f8e88cf-9266-4c30-8422-423182be0015 None None] MFA Rules not processed for user `a16a2786b5174034a2be92c14478c98c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:24:03.604070 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-2f8e88cf-9266-4c30-8422-423182be0015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:03.679554 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1276/2536] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:24:03 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 12:24:03.684726 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24af4604-0727-4f31-addb-477caafbaac0 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:03.761153 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24af4604-0727-4f31-addb-477caafbaac0 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:03.766368 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9372bd41-03c2-4a51-9ca0-0a2bcb667517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:03.766991 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9372bd41-03c2-4a51-9ca0-0a2bcb667517 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:03.767417 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9372bd41-03c2-4a51-9ca0-0a2bcb667517 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:03.767696 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9372bd41-03c2-4a51-9ca0-0a2bcb667517 admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:03.768340 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9372bd41-03c2-4a51-9ca0-0a2bcb667517 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:03.770317 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9372bd41-03c2-4a51-9ca0-0a2bcb667517 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:03.802478 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1261/2537] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 5 12:24:03 2022] POST /identity/v3/projects => generated 367 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 12:24:03.807852 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8e88cf-9266-4c30-8422-423182be0015 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:03.827291 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8e88cf-9266-4c30-8422-423182be0015 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:03.907158 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef249268-28bb-4cdd-81e1-9d48c137177b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:03.907787 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef249268-28bb-4cdd-81e1-9d48c137177b admin admin] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:03.908068 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef249268-28bb-4cdd-81e1-9d48c137177b admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:03.908338 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef249268-28bb-4cdd-81e1-9d48c137177b admin admin] PATH_INFO: `/v3/users` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:03.909030 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef249268-28bb-4cdd-81e1-9d48c137177b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:03.910984 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef249268-28bb-4cdd-81e1-9d48c137177b admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:03.935751 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1277/2538] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 5 12:24:03 2022] POST /identity/v3/users => generated 290 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:24:03.940281 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9372bd41-03c2-4a51-9ca0-0a2bcb667517 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:03.951872 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9372bd41-03c2-4a51-9ca0-0a2bcb667517 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:03.957030 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15571265-3c73-429e-8862-5ab8abbbd2a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:03.957647 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15571265-3c73-429e-8862-5ab8abbbd2a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:03.957928 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15571265-3c73-429e-8862-5ab8abbbd2a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:03.958203 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15571265-3c73-429e-8862-5ab8abbbd2a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:03.958863 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15571265-3c73-429e-8862-5ab8abbbd2a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:03.960519 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15571265-3c73-429e-8862-5ab8abbbd2a5 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:03.973184 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1262/2539] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:24:03 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 12:24:03.978103 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef249268-28bb-4cdd-81e1-9d48c137177b admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:03.989941 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef249268-28bb-4cdd-81e1-9d48c137177b admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:03.994713 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2906b818-bbbd-4ba8-8cf0-1d821bc06151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:03.995385 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2906b818-bbbd-4ba8-8cf0-1d821bc06151 admin admin] REQUEST_METHOD: `PUT` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:03.995660 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2906b818-bbbd-4ba8-8cf0-1d821bc06151 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:03.995929 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2906b818-bbbd-4ba8-8cf0-1d821bc06151 admin admin] PATH_INFO: `/v3/projects/0c5fb43c820e4509a5c3a9a5d9dba95d/users/b419e1380bb1459b9a71091ec632e059/roles/16e2ccc8bd1b497d8cee780c1c7df0d2` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:04.018075 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2906b818-bbbd-4ba8-8cf0-1d821bc06151 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c5fb43c820e4509a5c3a9a5d9dba95d, user_id=b419e1380bb1459b9a71091ec632e059, role_id=16e2ccc8bd1b497d8cee780c1c7df0d2)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:04.023275 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2906b818-bbbd-4ba8-8cf0-1d821bc06151 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:04.047043 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1278/2540] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 5 12:24:03 2022] PUT /identity/v3/projects/0c5fb43c820e4509a5c3a9a5d9dba95d/users/b419e1380bb1459b9a71091ec632e059/roles/16e2ccc8bd1b497d8cee780c1c7df0d2 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 12:24:04.053139 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15571265-3c73-429e-8862-5ab8abbbd2a5 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:04.066721 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15571265-3c73-429e-8862-5ab8abbbd2a5 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:04.090080 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:24:04.157604 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319d5b5d-a544-4c91-ad65-aac9323d9165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:04.158238 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319d5b5d-a544-4c91-ad65-aac9323d9165 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:04.158593 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319d5b5d-a544-4c91-ad65-aac9323d9165 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:04.158874 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319d5b5d-a544-4c91-ad65-aac9323d9165 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:04.159558 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319d5b5d-a544-4c91-ad65-aac9323d9165 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:04.161279 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319d5b5d-a544-4c91-ad65-aac9323d9165 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:04.173306 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1263/2541] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:24:04 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 12:24:04.178192 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2906b818-bbbd-4ba8-8cf0-1d821bc06151 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:04.184476 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:24:04.193096 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2906b818-bbbd-4ba8-8cf0-1d821bc06151 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:04.198041 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8d201c-b8ef-4a9a-8d50-b05362d5ca87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:04.198718 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8d201c-b8ef-4a9a-8d50-b05362d5ca87 admin admin] REQUEST_METHOD: `PUT` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:04.199005 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8d201c-b8ef-4a9a-8d50-b05362d5ca87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:04.199832 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8d201c-b8ef-4a9a-8d50-b05362d5ca87 admin admin] PATH_INFO: `/v3/projects/0c5fb43c820e4509a5c3a9a5d9dba95d/users/b419e1380bb1459b9a71091ec632e059/roles/16e2ccc8bd1b497d8cee780c1c7df0d2` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:04.201881 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8d201c-b8ef-4a9a-8d50-b05362d5ca87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c5fb43c820e4509a5c3a9a5d9dba95d, user_id=b419e1380bb1459b9a71091ec632e059, role_id=16e2ccc8bd1b497d8cee780c1c7df0d2)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:04.204545 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8d201c-b8ef-4a9a-8d50-b05362d5ca87 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:04.217156 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1279/2542] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 5 12:24:04 2022] PUT /identity/v3/projects/0c5fb43c820e4509a5c3a9a5d9dba95d/users/b419e1380bb1459b9a71091ec632e059/roles/16e2ccc8bd1b497d8cee780c1c7df0d2 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 12:24:04.229308 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e812b79-dbd7-429e-9406-78b2dbf0e031 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:04.229729 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e812b79-dbd7-429e-9406-78b2dbf0e031 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:04.230114 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e812b79-dbd7-429e-9406-78b2dbf0e031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:04.262453 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-6e812b79-dbd7-429e-9406-78b2dbf0e031 None None] MFA Rules not processed for user `b419e1380bb1459b9a71091ec632e059`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:24:04.263739 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-6e812b79-dbd7-429e-9406-78b2dbf0e031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:04.344876 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1264/2543] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:24:04 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 12:24:04.362301 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8d201c-b8ef-4a9a-8d50-b05362d5ca87 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:04.365066 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-7f8d201c-b8ef-4a9a-8d50-b05362d5ca87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:04.445884 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8d201c-b8ef-4a9a-8d50-b05362d5ca87 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:04.449834 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c58e99a-5bdf-401c-aa7c-4044b6793d9d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37633bbae0c2423c81ccd61ac3a17ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:04.450459 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c58e99a-5bdf-401c-aa7c-4044b6793d9d service cinder] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:04.450736 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c58e99a-5bdf-401c-aa7c-4044b6793d9d service cinder] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:04.451006 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c58e99a-5bdf-401c-aa7c-4044b6793d9d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:04.460962 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c58e99a-5bdf-401c-aa7c-4044b6793d9d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:04.462427 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c58e99a-5bdf-401c-aa7c-4044b6793d9d service cinder] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:04.473591 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1280/2544] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:24:04 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:24:04.528044 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e812b79-dbd7-429e-9406-78b2dbf0e031 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:04.529644 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-6e812b79-dbd7-429e-9406-78b2dbf0e031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:04.543858 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e812b79-dbd7-429e-9406-78b2dbf0e031 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:04.547953 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b84cf8-18eb-4e00-85bd-2413db991220 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37633bbae0c2423c81ccd61ac3a17ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:04.548694 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b84cf8-18eb-4e00-85bd-2413db991220 service cinder] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:04.549188 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b84cf8-18eb-4e00-85bd-2413db991220 service cinder] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:04.549553 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b84cf8-18eb-4e00-85bd-2413db991220 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:04.613811 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b84cf8-18eb-4e00-85bd-2413db991220 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:04.615369 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b84cf8-18eb-4e00-85bd-2413db991220 service cinder] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:04.625902 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1265/2545] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:24:04 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 12:24:08.231397 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c58e99a-5bdf-401c-aa7c-4044b6793d9d service cinder] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:08.327615 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c58e99a-5bdf-401c-aa7c-4044b6793d9d service cinder] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:08.332706 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58242ed2-878e-408f-a38b-85b0b082f947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:08.333401 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58242ed2-878e-408f-a38b-85b0b082f947 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:08.333675 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58242ed2-878e-408f-a38b-85b0b082f947 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:08.333955 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58242ed2-878e-408f-a38b-85b0b082f947 admin admin] PATH_INFO: `/v3/users/a16a2786b5174034a2be92c14478c98c` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:08.335169 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58242ed2-878e-408f-a38b-85b0b082f947 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a16a2786b5174034a2be92c14478c98c)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:08.337179 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58242ed2-878e-408f-a38b-85b0b082f947 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:08.402616 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-58242ed2-878e-408f-a38b-85b0b082f947 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a16a2786b5174034a2be92c14478c98c'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:08.403501 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-58242ed2-878e-408f-a38b-85b0b082f947 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a16a2786b5174034a2be92c14478c98c'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:08.413523 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-58242ed2-878e-408f-a38b-85b0b082f947 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a16a2786b5174034a2be92c14478c98c'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:08.414210 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-58242ed2-878e-408f-a38b-85b0b082f947 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a16a2786b5174034a2be92c14478c98c'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:08.436416 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-58242ed2-878e-408f-a38b-85b0b082f947 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a16a2786b5174034a2be92c14478c98c'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:08.451625 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1281/2546] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 5 12:24:08 2022] DELETE /identity/v3/users/a16a2786b5174034a2be92c14478c98c => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:24:08.456403 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b5f299-13bd-4f1e-839b-8d9c37b98151 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:08.457056 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b5f299-13bd-4f1e-839b-8d9c37b98151 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:08.457056 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b5f299-13bd-4f1e-839b-8d9c37b98151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:08.477698 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-78b5f299-13bd-4f1e-839b-8d9c37b98151 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:24:08.478947 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-78b5f299-13bd-4f1e-839b-8d9c37b98151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:08.543891 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:24:08.565131 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1266/2547] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:24:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 12:24:08.576924 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58242ed2-878e-408f-a38b-85b0b082f947 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:08.579219 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-58242ed2-878e-408f-a38b-85b0b082f947 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:08.602209 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:24:08.656700 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58242ed2-878e-408f-a38b-85b0b082f947 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:08.660437 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09895c6e-2d52-4106-8876-22ecf7f3cd53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4994b4faa4ec4aa088f3dc32c9c5614d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:08.661095 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09895c6e-2d52-4106-8876-22ecf7f3cd53 service neutron] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:08.661377 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09895c6e-2d52-4106-8876-22ecf7f3cd53 service neutron] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:08.661651 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09895c6e-2d52-4106-8876-22ecf7f3cd53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:08.671411 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09895c6e-2d52-4106-8876-22ecf7f3cd53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:08.672869 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09895c6e-2d52-4106-8876-22ecf7f3cd53 service neutron] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:08.682838 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1282/2548] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:24:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:24:08.993288 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b5f299-13bd-4f1e-839b-8d9c37b98151 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:09.002433 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-78b5f299-13bd-4f1e-839b-8d9c37b98151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:09.014832 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b5f299-13bd-4f1e-839b-8d9c37b98151 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:09.019894 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8031a989-71b4-4843-9c1b-d387e8f823f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:09.020546 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8031a989-71b4-4843-9c1b-d387e8f823f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:09.020817 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8031a989-71b4-4843-9c1b-d387e8f823f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:09.021196 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8031a989-71b4-4843-9c1b-d387e8f823f7 admin admin] PATH_INFO: `/v3/projects/0b885bd0da584ffe9bcb4dcec84d3a1c` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:09.022254 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8031a989-71b4-4843-9c1b-d387e8f823f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b885bd0da584ffe9bcb4dcec84d3a1c)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:09.024175 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8031a989-71b4-4843-9c1b-d387e8f823f7 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:09.079969 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-8031a989-71b4-4843-9c1b-d387e8f823f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b885bd0da584ffe9bcb4dcec84d3a1c', 'request_id': 'req-8031a989-71b4-4843-9c1b-d387e8f823f7'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:09.089831 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-8031a989-71b4-4843-9c1b-d387e8f823f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b885bd0da584ffe9bcb4dcec84d3a1c', 'request_id': 'req-8031a989-71b4-4843-9c1b-d387e8f823f7'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:09.096935 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-8031a989-71b4-4843-9c1b-d387e8f823f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b885bd0da584ffe9bcb4dcec84d3a1c', 'request_id': 'req-8031a989-71b4-4843-9c1b-d387e8f823f7'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:09.108492 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-8031a989-71b4-4843-9c1b-d387e8f823f7 admin admin] The token cache is being invalidate because project 0b885bd0da584ffe9bcb4dcec84d3a1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:24:09.108955 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-8031a989-71b4-4843-9c1b-d387e8f823f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:09.109756 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-8031a989-71b4-4843-9c1b-d387e8f823f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:09.111815 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1267/2549] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 5 12:24:08 2022] DELETE /identity/v3/projects/0b885bd0da584ffe9bcb4dcec84d3a1c => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:24:09.116255 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09895c6e-2d52-4106-8876-22ecf7f3cd53 service neutron] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:09.126902 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09895c6e-2d52-4106-8876-22ecf7f3cd53 service neutron] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:09.187424 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90646fd-e7ab-4294-942c-f5e52810f509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:09.188060 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90646fd-e7ab-4294-942c-f5e52810f509 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:09.188339 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90646fd-e7ab-4294-942c-f5e52810f509 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:09.188632 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90646fd-e7ab-4294-942c-f5e52810f509 admin admin] PATH_INFO: `/v3/users/b419e1380bb1459b9a71091ec632e059` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:09.189853 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90646fd-e7ab-4294-942c-f5e52810f509 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b419e1380bb1459b9a71091ec632e059)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:09.191815 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90646fd-e7ab-4294-942c-f5e52810f509 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:09.247264 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-a90646fd-e7ab-4294-942c-f5e52810f509 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b419e1380bb1459b9a71091ec632e059'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:09.248104 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-a90646fd-e7ab-4294-942c-f5e52810f509 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b419e1380bb1459b9a71091ec632e059'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:09.257255 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-a90646fd-e7ab-4294-942c-f5e52810f509 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b419e1380bb1459b9a71091ec632e059'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:09.257986 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-a90646fd-e7ab-4294-942c-f5e52810f509 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b419e1380bb1459b9a71091ec632e059'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:09.272639 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-a90646fd-e7ab-4294-942c-f5e52810f509 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b419e1380bb1459b9a71091ec632e059'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:09.286755 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1283/2550] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 5 12:24:09 2022] DELETE /identity/v3/users/b419e1380bb1459b9a71091ec632e059 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 12:24:09.585690 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8031a989-71b4-4843-9c1b-d387e8f823f7 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:09.587963 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-8031a989-71b4-4843-9c1b-d387e8f823f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:09.606323 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8031a989-71b4-4843-9c1b-d387e8f823f7 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:09.669319 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f60229-2097-4736-a3e3-bd07ed3a80f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:09.669916 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f60229-2097-4736-a3e3-bd07ed3a80f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:09.670194 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f60229-2097-4736-a3e3-bd07ed3a80f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:09.670464 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f60229-2097-4736-a3e3-bd07ed3a80f9 admin admin] PATH_INFO: `/v3/projects/0c5fb43c820e4509a5c3a9a5d9dba95d` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:09.671613 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f60229-2097-4736-a3e3-bd07ed3a80f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c5fb43c820e4509a5c3a9a5d9dba95d)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:09.673587 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f60229-2097-4736-a3e3-bd07ed3a80f9 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:09.724815 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-32f60229-2097-4736-a3e3-bd07ed3a80f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c5fb43c820e4509a5c3a9a5d9dba95d', 'request_id': 'req-32f60229-2097-4736-a3e3-bd07ed3a80f9'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:09.734304 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-32f60229-2097-4736-a3e3-bd07ed3a80f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c5fb43c820e4509a5c3a9a5d9dba95d', 'request_id': 'req-32f60229-2097-4736-a3e3-bd07ed3a80f9'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:09.745218 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-32f60229-2097-4736-a3e3-bd07ed3a80f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c5fb43c820e4509a5c3a9a5d9dba95d', 'request_id': 'req-32f60229-2097-4736-a3e3-bd07ed3a80f9'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:09.756737 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:24:09.769587 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-32f60229-2097-4736-a3e3-bd07ed3a80f9 admin admin] The token cache is being invalidate because project 0c5fb43c820e4509a5c3a9a5d9dba95d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:24:09.770242 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-32f60229-2097-4736-a3e3-bd07ed3a80f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:09.771355 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-32f60229-2097-4736-a3e3-bd07ed3a80f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:09.776474 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1268/2551] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 5 12:24:09 2022] DELETE /identity/v3/projects/0c5fb43c820e4509a5c3a9a5d9dba95d => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:24:09.780822 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302e9679-e123-4138-b5d6-eaaac8acfcdc None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:09.781143 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302e9679-e123-4138-b5d6-eaaac8acfcdc None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:09.781422 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302e9679-e123-4138-b5d6-eaaac8acfcdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:09.802469 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-302e9679-e123-4138-b5d6-eaaac8acfcdc None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:24:09.804409 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-302e9679-e123-4138-b5d6-eaaac8acfcdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:09.842595 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:24:09.876697 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1284/2552] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:24:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:24:09.890454 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9177b7-6f09-4084-99b1-d688c1da49f0 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:09.891263 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9177b7-6f09-4084-99b1-d688c1da49f0 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:09.891714 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9177b7-6f09-4084-99b1-d688c1da49f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:09.915999 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-ed9177b7-6f09-4084-99b1-d688c1da49f0 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:24:09.917321 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-ed9177b7-6f09-4084-99b1-d688c1da49f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:09.925413 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1269/2553] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:24:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:24:09.930184 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302e9679-e123-4138-b5d6-eaaac8acfcdc None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:09.940343 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302e9679-e123-4138-b5d6-eaaac8acfcdc None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:09.945156 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867326ee-d4e8-43ea-ace5-1073b5e766f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:09.945755 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867326ee-d4e8-43ea-ace5-1073b5e766f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:09.946029 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867326ee-d4e8-43ea-ace5-1073b5e766f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:09.946299 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867326ee-d4e8-43ea-ace5-1073b5e766f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:09.946946 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867326ee-d4e8-43ea-ace5-1073b5e766f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:24:09.947320 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867326ee-d4e8-43ea-ace5-1073b5e766f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:09.949478 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867326ee-d4e8-43ea-ace5-1073b5e766f5 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:09.962154 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1285/2554] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Sep 5 12:24:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:24:09.968998 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9177b7-6f09-4084-99b1-d688c1da49f0 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:09.978473 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9177b7-6f09-4084-99b1-d688c1da49f0 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:09.983131 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd4c9b6-ea6d-4901-aa3d-5fb2c2054aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:09.983738 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd4c9b6-ea6d-4901-aa3d-5fb2c2054aa1 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:09.984020 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd4c9b6-ea6d-4901-aa3d-5fb2c2054aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:09.984293 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd4c9b6-ea6d-4901-aa3d-5fb2c2054aa1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:09.984977 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd4c9b6-ea6d-4901-aa3d-5fb2c2054aa1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:09.986895 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd4c9b6-ea6d-4901-aa3d-5fb2c2054aa1 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:10.017709 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1270/2555] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 5 12:24:09 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:24:10.022068 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867326ee-d4e8-43ea-ace5-1073b5e766f5 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:10.032014 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867326ee-d4e8-43ea-ace5-1073b5e766f5 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:10.090018 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd857a9c-3f6d-4a5f-b2bb-985eeb54276a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:10.090633 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd857a9c-3f6d-4a5f-b2bb-985eeb54276a admin admin] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:10.090904 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd857a9c-3f6d-4a5f-b2bb-985eeb54276a admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:10.091180 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd857a9c-3f6d-4a5f-b2bb-985eeb54276a admin admin] PATH_INFO: `/v3/users` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:10.091867 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd857a9c-3f6d-4a5f-b2bb-985eeb54276a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:10.093838 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd857a9c-3f6d-4a5f-b2bb-985eeb54276a admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:10.116639 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1286/2556] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 5 12:24:10 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:24:10.120871 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd4c9b6-ea6d-4901-aa3d-5fb2c2054aa1 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:10.134436 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd4c9b6-ea6d-4901-aa3d-5fb2c2054aa1 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:10.143071 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7511af7-1d1e-4aa0-82c6-519810841966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:10.144035 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7511af7-1d1e-4aa0-82c6-519810841966 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:10.144433 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7511af7-1d1e-4aa0-82c6-519810841966 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:10.144972 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7511af7-1d1e-4aa0-82c6-519810841966 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:10.146042 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7511af7-1d1e-4aa0-82c6-519810841966 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:10.148719 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7511af7-1d1e-4aa0-82c6-519810841966 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:10.166782 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1271/2557] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:24:10 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:24:10.171685 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd857a9c-3f6d-4a5f-b2bb-985eeb54276a admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:10.182139 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd857a9c-3f6d-4a5f-b2bb-985eeb54276a admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:10.186947 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b5b759-2b52-46ac-a3a0-ba67af8333d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:10.187563 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b5b759-2b52-46ac-a3a0-ba67af8333d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:10.187846 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b5b759-2b52-46ac-a3a0-ba67af8333d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:10.188150 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b5b759-2b52-46ac-a3a0-ba67af8333d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:10.188806 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b5b759-2b52-46ac-a3a0-ba67af8333d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:10.190478 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b5b759-2b52-46ac-a3a0-ba67af8333d4 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:10.202151 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1287/2558] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:24:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:24:10.207610 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7511af7-1d1e-4aa0-82c6-519810841966 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:10.218580 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7511af7-1d1e-4aa0-82c6-519810841966 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:10.223273 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18dc9e2-b1ac-47ae-be3c-3e7be79e3a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:10.223941 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18dc9e2-b1ac-47ae-be3c-3e7be79e3a28 admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:10.224288 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18dc9e2-b1ac-47ae-be3c-3e7be79e3a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:10.224566 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18dc9e2-b1ac-47ae-be3c-3e7be79e3a28 admin admin] PATH_INFO: `/v3/projects/c3a92f18d0254b9bb7a152b71fbd447e/users/360b042120e94b9c9fb52d144273328c/roles/ed72181e1403401facb77dcf33644757` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:10.242159 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18dc9e2-b1ac-47ae-be3c-3e7be79e3a28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3a92f18d0254b9bb7a152b71fbd447e, user_id=360b042120e94b9c9fb52d144273328c, role_id=ed72181e1403401facb77dcf33644757)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:10.245097 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18dc9e2-b1ac-47ae-be3c-3e7be79e3a28 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:10.259609 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1272/2559] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 5 12:24:10 2022] PUT /identity/v3/projects/c3a92f18d0254b9bb7a152b71fbd447e/users/360b042120e94b9c9fb52d144273328c/roles/ed72181e1403401facb77dcf33644757 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 12:24:10.270716 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e112062d-cc35-495a-b531-c605f727e9c2 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:10.271408 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e112062d-cc35-495a-b531-c605f727e9c2 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:10.271408 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e112062d-cc35-495a-b531-c605f727e9c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:10.303565 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-e112062d-cc35-495a-b531-c605f727e9c2 None None] MFA Rules not processed for user `360b042120e94b9c9fb52d144273328c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:24:10.304806 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-e112062d-cc35-495a-b531-c605f727e9c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:10.376380 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1288/2560] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:24:10 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:24:10.381905 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18dc9e2-b1ac-47ae-be3c-3e7be79e3a28 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:10.450210 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18dc9e2-b1ac-47ae-be3c-3e7be79e3a28 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:10.456213 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e6b79d-196b-48da-9526-b4ef5dee3855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:10.456882 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e6b79d-196b-48da-9526-b4ef5dee3855 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:10.457243 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e6b79d-196b-48da-9526-b4ef5dee3855 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:10.457583 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e6b79d-196b-48da-9526-b4ef5dee3855 admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:10.458286 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e6b79d-196b-48da-9526-b4ef5dee3855 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:10.460507 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e6b79d-196b-48da-9526-b4ef5dee3855 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:10.494444 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1273/2561] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 5 12:24:10 2022] POST /identity/v3/projects => generated 385 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:24:10.498927 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e112062d-cc35-495a-b531-c605f727e9c2 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:10.511139 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e112062d-cc35-495a-b531-c605f727e9c2 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:10.540094 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:24:10.577591 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29302846-984b-40d8-9254-a5d5335a8ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:10.578345 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29302846-984b-40d8-9254-a5d5335a8ac6 admin admin] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:10.578675 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29302846-984b-40d8-9254-a5d5335a8ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:10.579019 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29302846-984b-40d8-9254-a5d5335a8ac6 admin admin] PATH_INFO: `/v3/users` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:10.579712 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29302846-984b-40d8-9254-a5d5335a8ac6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:10.581812 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29302846-984b-40d8-9254-a5d5335a8ac6 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:10.608809 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1289/2562] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 5 12:24:10 2022] POST /identity/v3/users => generated 299 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:24:10.610089 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e6b79d-196b-48da-9526-b4ef5dee3855 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:10.620858 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e6b79d-196b-48da-9526-b4ef5dee3855 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:10.625717 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f821755-0a64-4e86-a51a-ebc565ac9ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:10.626346 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f821755-0a64-4e86-a51a-ebc565ac9ccc admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:10.626629 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f821755-0a64-4e86-a51a-ebc565ac9ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:10.626903 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f821755-0a64-4e86-a51a-ebc565ac9ccc admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:10.627596 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f821755-0a64-4e86-a51a-ebc565ac9ccc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:10.629298 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f821755-0a64-4e86-a51a-ebc565ac9ccc admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:10.642645 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1274/2563] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:24:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:24:10.647495 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29302846-984b-40d8-9254-a5d5335a8ac6 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:10.659121 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29302846-984b-40d8-9254-a5d5335a8ac6 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:10.663992 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bacbeb-5f49-4413-a620-922e9b692528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:10.664667 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bacbeb-5f49-4413-a620-922e9b692528 admin admin] REQUEST_METHOD: `PUT` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:10.664972 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bacbeb-5f49-4413-a620-922e9b692528 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:10.665245 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bacbeb-5f49-4413-a620-922e9b692528 admin admin] PATH_INFO: `/v3/projects/75b555be4a4f42cf984fef81b555d2fe/users/c47cbf91f31043549bcb29038de5f336/roles/16e2ccc8bd1b497d8cee780c1c7df0d2` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:10.681566 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bacbeb-5f49-4413-a620-922e9b692528 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75b555be4a4f42cf984fef81b555d2fe, user_id=c47cbf91f31043549bcb29038de5f336, role_id=16e2ccc8bd1b497d8cee780c1c7df0d2)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:10.684229 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bacbeb-5f49-4413-a620-922e9b692528 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:10.702687 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1290/2564] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 5 12:24:10 2022] PUT /identity/v3/projects/75b555be4a4f42cf984fef81b555d2fe/users/c47cbf91f31043549bcb29038de5f336/roles/16e2ccc8bd1b497d8cee780c1c7df0d2 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:24:10.706800 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f821755-0a64-4e86-a51a-ebc565ac9ccc admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:10.719155 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f821755-0a64-4e86-a51a-ebc565ac9ccc admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:10.780797 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5910ae-b030-41e6-bbce-c97d0e30c113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:10.781454 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5910ae-b030-41e6-bbce-c97d0e30c113 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:10.781739 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5910ae-b030-41e6-bbce-c97d0e30c113 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:10.782015 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5910ae-b030-41e6-bbce-c97d0e30c113 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:10.782678 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5910ae-b030-41e6-bbce-c97d0e30c113 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:10.784360 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5910ae-b030-41e6-bbce-c97d0e30c113 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:10.796677 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1275/2565] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:24:10 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:24:10.801304 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bacbeb-5f49-4413-a620-922e9b692528 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:10.813528 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bacbeb-5f49-4413-a620-922e9b692528 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:10.818498 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a7eab7-7d0c-45db-a44d-f6c92c6d5732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:10.819197 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a7eab7-7d0c-45db-a44d-f6c92c6d5732 admin admin] REQUEST_METHOD: `PUT` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:10.819476 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a7eab7-7d0c-45db-a44d-f6c92c6d5732 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:10.819752 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a7eab7-7d0c-45db-a44d-f6c92c6d5732 admin admin] PATH_INFO: `/v3/projects/75b555be4a4f42cf984fef81b555d2fe/users/c47cbf91f31043549bcb29038de5f336/roles/16e2ccc8bd1b497d8cee780c1c7df0d2` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:10.822149 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a7eab7-7d0c-45db-a44d-f6c92c6d5732 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75b555be4a4f42cf984fef81b555d2fe, user_id=c47cbf91f31043549bcb29038de5f336, role_id=16e2ccc8bd1b497d8cee780c1c7df0d2)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:10.824924 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a7eab7-7d0c-45db-a44d-f6c92c6d5732 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:10.845752 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1291/2566] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 5 12:24:10 2022] PUT /identity/v3/projects/75b555be4a4f42cf984fef81b555d2fe/users/c47cbf91f31043549bcb29038de5f336/roles/16e2ccc8bd1b497d8cee780c1c7df0d2 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:24:10.857495 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fccbb4-8d6d-455a-a6f0-eb083967e0d0 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:10.857778 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fccbb4-8d6d-455a-a6f0-eb083967e0d0 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:10.858055 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fccbb4-8d6d-455a-a6f0-eb083967e0d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:10.866354 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:24:10.891145 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-00fccbb4-8d6d-455a-a6f0-eb083967e0d0 None None] MFA Rules not processed for user `c47cbf91f31043549bcb29038de5f336`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:24:10.892413 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-00fccbb4-8d6d-455a-a6f0-eb083967e0d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:10.988019 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1276/2567] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:24:10 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:24:11.008354 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a7eab7-7d0c-45db-a44d-f6c92c6d5732 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:11.010516 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-93a7eab7-7d0c-45db-a44d-f6c92c6d5732 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:11.077198 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a7eab7-7d0c-45db-a44d-f6c92c6d5732 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:11.082083 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62860eb9-e7ac-401a-bb23-4501f81fa43d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37633bbae0c2423c81ccd61ac3a17ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:11.082733 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62860eb9-e7ac-401a-bb23-4501f81fa43d service cinder] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:11.083006 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62860eb9-e7ac-401a-bb23-4501f81fa43d service cinder] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:11.083275 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62860eb9-e7ac-401a-bb23-4501f81fa43d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:11.095020 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62860eb9-e7ac-401a-bb23-4501f81fa43d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:11.097565 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62860eb9-e7ac-401a-bb23-4501f81fa43d service cinder] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:11.110292 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1292/2568] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:24:11 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:24:11.144120 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fccbb4-8d6d-455a-a6f0-eb083967e0d0 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:11.223767 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fccbb4-8d6d-455a-a6f0-eb083967e0d0 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:11.228723 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12588e5c-ff65-4955-bd3e-30612d139afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:11.229403 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12588e5c-ff65-4955-bd3e-30612d139afb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:11.229678 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12588e5c-ff65-4955-bd3e-30612d139afb admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:11.229964 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12588e5c-ff65-4955-bd3e-30612d139afb admin admin] PATH_INFO: `/v3/users/360b042120e94b9c9fb52d144273328c` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:11.231133 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12588e5c-ff65-4955-bd3e-30612d139afb admin admin] RBAC: Authorizing `identity:delete_user(user_id=360b042120e94b9c9fb52d144273328c)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:11.233996 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12588e5c-ff65-4955-bd3e-30612d139afb admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:11.317070 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-12588e5c-ff65-4955-bd3e-30612d139afb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '360b042120e94b9c9fb52d144273328c'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:11.318126 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-12588e5c-ff65-4955-bd3e-30612d139afb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '360b042120e94b9c9fb52d144273328c'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:11.334815 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-12588e5c-ff65-4955-bd3e-30612d139afb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '360b042120e94b9c9fb52d144273328c'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:11.335949 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-12588e5c-ff65-4955-bd3e-30612d139afb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '360b042120e94b9c9fb52d144273328c'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:11.350295 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-12588e5c-ff65-4955-bd3e-30612d139afb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '360b042120e94b9c9fb52d144273328c'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:11.376073 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1277/2569] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 5 12:24:11 2022] DELETE /identity/v3/users/360b042120e94b9c9fb52d144273328c => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:24:11.382031 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f5c5f6-6032-41ec-9210-ff9ec15aa4a2 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:11.382572 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f5c5f6-6032-41ec-9210-ff9ec15aa4a2 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:11.382713 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f5c5f6-6032-41ec-9210-ff9ec15aa4a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:11.407719 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-44f5c5f6-6032-41ec-9210-ff9ec15aa4a2 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:24:11.409596 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-44f5c5f6-6032-41ec-9210-ff9ec15aa4a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:11.497902 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1293/2570] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:24:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:24:11.510795 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12588e5c-ff65-4955-bd3e-30612d139afb admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:11.512329 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-12588e5c-ff65-4955-bd3e-30612d139afb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:11.526808 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:24:11.578665 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12588e5c-ff65-4955-bd3e-30612d139afb admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:11.582316 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cfc95c-e591-46cf-87aa-82e89d8c5c3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4994b4faa4ec4aa088f3dc32c9c5614d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:11.582928 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cfc95c-e591-46cf-87aa-82e89d8c5c3d service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:11.583238 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cfc95c-e591-46cf-87aa-82e89d8c5c3d service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:11.583512 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cfc95c-e591-46cf-87aa-82e89d8c5c3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:11.593690 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cfc95c-e591-46cf-87aa-82e89d8c5c3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:11.595152 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cfc95c-e591-46cf-87aa-82e89d8c5c3d service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:11.605374 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1278/2571] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:24:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:24:11.899332 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f5c5f6-6032-41ec-9210-ff9ec15aa4a2 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:11.901630 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-44f5c5f6-6032-41ec-9210-ff9ec15aa4a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:11.918913 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f5c5f6-6032-41ec-9210-ff9ec15aa4a2 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:11.923974 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcec4db7-bcb6-42c4-b967-778286228f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:11.924628 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec4db7-bcb6-42c4-b967-778286228f28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:11.924929 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec4db7-bcb6-42c4-b967-778286228f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:11.925205 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec4db7-bcb6-42c4-b967-778286228f28 admin admin] PATH_INFO: `/v3/projects/c3a92f18d0254b9bb7a152b71fbd447e` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:11.926341 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcec4db7-bcb6-42c4-b967-778286228f28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3a92f18d0254b9bb7a152b71fbd447e)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:11.928335 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcec4db7-bcb6-42c4-b967-778286228f28 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:11.952324 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:24:11.979152 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-dcec4db7-bcb6-42c4-b967-778286228f28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3a92f18d0254b9bb7a152b71fbd447e', 'request_id': 'req-dcec4db7-bcb6-42c4-b967-778286228f28'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:11.987434 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-dcec4db7-bcb6-42c4-b967-778286228f28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3a92f18d0254b9bb7a152b71fbd447e', 'request_id': 'req-dcec4db7-bcb6-42c4-b967-778286228f28'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:11.993089 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-dcec4db7-bcb6-42c4-b967-778286228f28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3a92f18d0254b9bb7a152b71fbd447e', 'request_id': 'req-dcec4db7-bcb6-42c4-b967-778286228f28'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:12.003994 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-dcec4db7-bcb6-42c4-b967-778286228f28 admin admin] The token cache is being invalidate because project c3a92f18d0254b9bb7a152b71fbd447e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:24:12.004220 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-dcec4db7-bcb6-42c4-b967-778286228f28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:12.004854 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-dcec4db7-bcb6-42c4-b967-778286228f28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:12.006373 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1294/2572] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 5 12:24:11 2022] DELETE /identity/v3/projects/c3a92f18d0254b9bb7a152b71fbd447e => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:24:12.010287 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cfc95c-e591-46cf-87aa-82e89d8c5c3d service neutron] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:12.020752 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cfc95c-e591-46cf-87aa-82e89d8c5c3d service neutron] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:12.075588 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d5605b-0592-47bb-9fc3-fc75cc136a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:12.076737 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d5605b-0592-47bb-9fc3-fc75cc136a14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:12.077047 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d5605b-0592-47bb-9fc3-fc75cc136a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:12.077319 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d5605b-0592-47bb-9fc3-fc75cc136a14 admin admin] PATH_INFO: `/v3/users/c47cbf91f31043549bcb29038de5f336` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:12.078439 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d5605b-0592-47bb-9fc3-fc75cc136a14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c47cbf91f31043549bcb29038de5f336)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:12.080359 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d5605b-0592-47bb-9fc3-fc75cc136a14 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:12.125173 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-46d5605b-0592-47bb-9fc3-fc75cc136a14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c47cbf91f31043549bcb29038de5f336'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:12.125808 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-46d5605b-0592-47bb-9fc3-fc75cc136a14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c47cbf91f31043549bcb29038de5f336'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:12.133055 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-46d5605b-0592-47bb-9fc3-fc75cc136a14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c47cbf91f31043549bcb29038de5f336'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:12.133670 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-46d5605b-0592-47bb-9fc3-fc75cc136a14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c47cbf91f31043549bcb29038de5f336'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:12.148290 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-46d5605b-0592-47bb-9fc3-fc75cc136a14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c47cbf91f31043549bcb29038de5f336'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:12.162067 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1279/2573] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 5 12:24:12 2022] DELETE /identity/v3/users/c47cbf91f31043549bcb29038de5f336 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:24:12.462027 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcec4db7-bcb6-42c4-b967-778286228f28 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:12.463982 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-dcec4db7-bcb6-42c4-b967-778286228f28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:12.482646 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcec4db7-bcb6-42c4-b967-778286228f28 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:12.575548 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea14e6a5-5b13-4b47-b27c-71854205c4e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:12.576760 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea14e6a5-5b13-4b47-b27c-71854205c4e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:12.577117 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea14e6a5-5b13-4b47-b27c-71854205c4e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:12.577414 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea14e6a5-5b13-4b47-b27c-71854205c4e2 admin admin] PATH_INFO: `/v3/projects/75b555be4a4f42cf984fef81b555d2fe` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:12.578582 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea14e6a5-5b13-4b47-b27c-71854205c4e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75b555be4a4f42cf984fef81b555d2fe)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:12.580566 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea14e6a5-5b13-4b47-b27c-71854205c4e2 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:12.634963 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-ea14e6a5-5b13-4b47-b27c-71854205c4e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75b555be4a4f42cf984fef81b555d2fe', 'request_id': 'req-ea14e6a5-5b13-4b47-b27c-71854205c4e2'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:12.644942 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-ea14e6a5-5b13-4b47-b27c-71854205c4e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75b555be4a4f42cf984fef81b555d2fe', 'request_id': 'req-ea14e6a5-5b13-4b47-b27c-71854205c4e2'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:12.651721 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-ea14e6a5-5b13-4b47-b27c-71854205c4e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75b555be4a4f42cf984fef81b555d2fe', 'request_id': 'req-ea14e6a5-5b13-4b47-b27c-71854205c4e2'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:12.663524 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-ea14e6a5-5b13-4b47-b27c-71854205c4e2 admin admin] The token cache is being invalidate because project 75b555be4a4f42cf984fef81b555d2fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:24:12.663820 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-ea14e6a5-5b13-4b47-b27c-71854205c4e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:12.664479 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-ea14e6a5-5b13-4b47-b27c-71854205c4e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:12.666026 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1295/2574] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 5 12:24:12 2022] DELETE /identity/v3/projects/75b555be4a4f42cf984fef81b555d2fe => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:24:12.671585 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee223c7-a86d-49e0-9d19-625e26d54494 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:12.671911 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee223c7-a86d-49e0-9d19-625e26d54494 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:12.672143 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee223c7-a86d-49e0-9d19-625e26d54494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:12.692248 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-1ee223c7-a86d-49e0-9d19-625e26d54494 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:24:12.693488 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-1ee223c7-a86d-49e0-9d19-625e26d54494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:12.718822 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:24:12.753802 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1280/2575] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:24:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:24:12.762446 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb18888-16e1-4c9d-9624-550071d63727 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:12.762659 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb18888-16e1-4c9d-9624-550071d63727 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:12.762932 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb18888-16e1-4c9d-9624-550071d63727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:12.788695 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-4eb18888-16e1-4c9d-9624-550071d63727 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:24:12.789993 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-4eb18888-16e1-4c9d-9624-550071d63727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:12.798438 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1296/2576] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:24:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:24:12.802748 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee223c7-a86d-49e0-9d19-625e26d54494 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:12.813233 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee223c7-a86d-49e0-9d19-625e26d54494 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:12.817908 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ece09e-eaa1-4500-b70a-2f7475016916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:12.818505 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ece09e-eaa1-4500-b70a-2f7475016916 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:12.818782 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ece09e-eaa1-4500-b70a-2f7475016916 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:12.819050 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ece09e-eaa1-4500-b70a-2f7475016916 admin admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:12.819693 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ece09e-eaa1-4500-b70a-2f7475016916 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:24:12.820079 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ece09e-eaa1-4500-b70a-2f7475016916 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:12.822679 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ece09e-eaa1-4500-b70a-2f7475016916 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:12.837234 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1281/2577] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Sep 5 12:24:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:24:12.841801 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb18888-16e1-4c9d-9624-550071d63727 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:12.850954 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb18888-16e1-4c9d-9624-550071d63727 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:12.855493 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c582ee03-ff9d-4888-9ad8-f28ee87126a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:12.856086 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c582ee03-ff9d-4888-9ad8-f28ee87126a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:12.856363 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c582ee03-ff9d-4888-9ad8-f28ee87126a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:12.856636 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c582ee03-ff9d-4888-9ad8-f28ee87126a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:12.857809 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c582ee03-ff9d-4888-9ad8-f28ee87126a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:12.859730 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c582ee03-ff9d-4888-9ad8-f28ee87126a3 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:12.892972 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1297/2578] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 5 12:24:12 2022] POST /identity/v3/projects => generated 383 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:24:12.897439 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ece09e-eaa1-4500-b70a-2f7475016916 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:12.908214 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ece09e-eaa1-4500-b70a-2f7475016916 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:12.981877 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693edb73-38ec-40f1-9665-4b43cfb2ef0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:12.982988 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693edb73-38ec-40f1-9665-4b43cfb2ef0e admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:12.983342 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693edb73-38ec-40f1-9665-4b43cfb2ef0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:12.983680 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693edb73-38ec-40f1-9665-4b43cfb2ef0e admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:12.984428 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693edb73-38ec-40f1-9665-4b43cfb2ef0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:12.986678 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693edb73-38ec-40f1-9665-4b43cfb2ef0e admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:13.009546 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1282/2579] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 5 12:24:12 2022] POST /identity/v3/users => generated 292 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:24:13.015887 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c582ee03-ff9d-4888-9ad8-f28ee87126a3 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:13.032553 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c582ee03-ff9d-4888-9ad8-f28ee87126a3 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:13.042003 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7abf78-c7c9-459d-a7ad-c4a43f9b60ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:13.042787 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7abf78-c7c9-459d-a7ad-c4a43f9b60ea admin admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:13.043141 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7abf78-c7c9-459d-a7ad-c4a43f9b60ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:13.043497 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7abf78-c7c9-459d-a7ad-c4a43f9b60ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:13.044243 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7abf78-c7c9-459d-a7ad-c4a43f9b60ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:13.046592 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7abf78-c7c9-459d-a7ad-c4a43f9b60ea admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:13.049901 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:24:13.064850 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1298/2580] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:24:13 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:24:13.066236 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693edb73-38ec-40f1-9665-4b43cfb2ef0e admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:13.083202 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693edb73-38ec-40f1-9665-4b43cfb2ef0e admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:13.088467 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bdcceb-fca7-47b7-93cd-acca45cb8bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:13.089223 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bdcceb-fca7-47b7-93cd-acca45cb8bb5 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:13.089567 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bdcceb-fca7-47b7-93cd-acca45cb8bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:13.089843 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bdcceb-fca7-47b7-93cd-acca45cb8bb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:13.090491 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bdcceb-fca7-47b7-93cd-acca45cb8bb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:13.092626 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bdcceb-fca7-47b7-93cd-acca45cb8bb5 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:13.106438 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1283/2581] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:24:13 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 12:24:13.111312 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7abf78-c7c9-459d-a7ad-c4a43f9b60ea admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:13.122075 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7abf78-c7c9-459d-a7ad-c4a43f9b60ea admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:13.128546 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c69a208-9c45-4800-b52c-351f7507b577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:13.129350 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c69a208-9c45-4800-b52c-351f7507b577 admin admin] REQUEST_METHOD: `PUT` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:13.129693 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c69a208-9c45-4800-b52c-351f7507b577 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:13.129969 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c69a208-9c45-4800-b52c-351f7507b577 admin admin] PATH_INFO: `/v3/projects/5b3f422ac0a34830bacef9b1ca002f13/users/ae4dbbf57ee54886b13f2f10ec778dfd/roles/ed72181e1403401facb77dcf33644757` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:13.151550 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c69a208-9c45-4800-b52c-351f7507b577 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b3f422ac0a34830bacef9b1ca002f13, user_id=ae4dbbf57ee54886b13f2f10ec778dfd, role_id=ed72181e1403401facb77dcf33644757)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:13.156058 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c69a208-9c45-4800-b52c-351f7507b577 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:13.174439 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1299/2582] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 5 12:24:13 2022] PUT /identity/v3/projects/5b3f422ac0a34830bacef9b1ca002f13/users/ae4dbbf57ee54886b13f2f10ec778dfd/roles/ed72181e1403401facb77dcf33644757 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:24:13.184565 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4115440d-a751-4804-b509-2f95ad268b84 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:13.184858 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4115440d-a751-4804-b509-2f95ad268b84 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:13.185197 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4115440d-a751-4804-b509-2f95ad268b84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:13.215828 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-4115440d-a751-4804-b509-2f95ad268b84 None None] MFA Rules not processed for user `ae4dbbf57ee54886b13f2f10ec778dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:24:13.217611 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-4115440d-a751-4804-b509-2f95ad268b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:13.294115 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1284/2583] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:24:13 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:24:13.299061 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c69a208-9c45-4800-b52c-351f7507b577 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:13.366696 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c69a208-9c45-4800-b52c-351f7507b577 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:13.371772 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22ed954-2f68-4c7e-a87b-cc7f2b8d6c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:13.372392 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22ed954-2f68-4c7e-a87b-cc7f2b8d6c03 admin admin] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:13.372678 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22ed954-2f68-4c7e-a87b-cc7f2b8d6c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:13.373066 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22ed954-2f68-4c7e-a87b-cc7f2b8d6c03 admin admin] PATH_INFO: `/v3/projects` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:13.373720 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22ed954-2f68-4c7e-a87b-cc7f2b8d6c03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:13.375654 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22ed954-2f68-4c7e-a87b-cc7f2b8d6c03 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:13.409918 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1300/2584] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 5 12:24:13 2022] POST /identity/v3/projects => generated 379 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:24:13.411312 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4115440d-a751-4804-b509-2f95ad268b84 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:13.422158 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4115440d-a751-4804-b509-2f95ad268b84 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:13.450387 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:24:13.490866 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a218beeb-44af-48c7-85ba-080ecedafac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:13.491575 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a218beeb-44af-48c7-85ba-080ecedafac8 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:13.492713 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a218beeb-44af-48c7-85ba-080ecedafac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:13.492713 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a218beeb-44af-48c7-85ba-080ecedafac8 admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:13.493027 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a218beeb-44af-48c7-85ba-080ecedafac8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:13.494912 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a218beeb-44af-48c7-85ba-080ecedafac8 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:13.525361 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1285/2585] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 5 12:24:13 2022] POST /identity/v3/users => generated 296 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:24:13.527062 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22ed954-2f68-4c7e-a87b-cc7f2b8d6c03 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:13.538260 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22ed954-2f68-4c7e-a87b-cc7f2b8d6c03 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:13.543254 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e03a17a-c62c-4ab6-a4c8-2f2c08eb8932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:13.543870 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e03a17a-c62c-4ab6-a4c8-2f2c08eb8932 admin admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:13.544111 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e03a17a-c62c-4ab6-a4c8-2f2c08eb8932 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:13.545000 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e03a17a-c62c-4ab6-a4c8-2f2c08eb8932 admin admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:13.545602 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e03a17a-c62c-4ab6-a4c8-2f2c08eb8932 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:13.547204 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e03a17a-c62c-4ab6-a4c8-2f2c08eb8932 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:13.563090 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1301/2586] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:24:13 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:24:13.564980 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a218beeb-44af-48c7-85ba-080ecedafac8 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:13.575567 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a218beeb-44af-48c7-85ba-080ecedafac8 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:13.580443 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fca0f4-41ee-4c28-b6f8-1d79fd80aea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:13.581130 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fca0f4-41ee-4c28-b6f8-1d79fd80aea6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:13.581455 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fca0f4-41ee-4c28-b6f8-1d79fd80aea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:13.581731 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fca0f4-41ee-4c28-b6f8-1d79fd80aea6 admin admin] PATH_INFO: `/v3/projects/512cc83ea7e14883a185753e709c4cc1/users/3e468a970489490f8e576c3c96951b55/roles/16e2ccc8bd1b497d8cee780c1c7df0d2` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:13.598054 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fca0f4-41ee-4c28-b6f8-1d79fd80aea6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=512cc83ea7e14883a185753e709c4cc1, user_id=3e468a970489490f8e576c3c96951b55, role_id=16e2ccc8bd1b497d8cee780c1c7df0d2)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:13.600702 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fca0f4-41ee-4c28-b6f8-1d79fd80aea6 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:13.617598 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1286/2587] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 5 12:24:13 2022] PUT /identity/v3/projects/512cc83ea7e14883a185753e709c4cc1/users/3e468a970489490f8e576c3c96951b55/roles/16e2ccc8bd1b497d8cee780c1c7df0d2 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 12:24:13.621478 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e03a17a-c62c-4ab6-a4c8-2f2c08eb8932 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:13.633255 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e03a17a-c62c-4ab6-a4c8-2f2c08eb8932 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:13.707050 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3018d6-bfdf-4633-97ee-49803f9265b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:13.707783 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3018d6-bfdf-4633-97ee-49803f9265b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:13.707930 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3018d6-bfdf-4633-97ee-49803f9265b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:13.708206 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3018d6-bfdf-4633-97ee-49803f9265b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:13.708862 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3018d6-bfdf-4633-97ee-49803f9265b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:13.710622 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3018d6-bfdf-4633-97ee-49803f9265b4 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:13.725822 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1302/2588] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:24:13 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:24:13.729796 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fca0f4-41ee-4c28-b6f8-1d79fd80aea6 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:13.741588 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fca0f4-41ee-4c28-b6f8-1d79fd80aea6 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:13.746555 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669a2dc5-6d50-46f9-9b8d-23d66dc0c327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:13.747431 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669a2dc5-6d50-46f9-9b8d-23d66dc0c327 admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:13.747973 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669a2dc5-6d50-46f9-9b8d-23d66dc0c327 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:13.748315 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669a2dc5-6d50-46f9-9b8d-23d66dc0c327 admin admin] PATH_INFO: `/v3/projects/512cc83ea7e14883a185753e709c4cc1/users/3e468a970489490f8e576c3c96951b55/roles/16e2ccc8bd1b497d8cee780c1c7df0d2` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:13.750506 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669a2dc5-6d50-46f9-9b8d-23d66dc0c327 admin admin] RBAC: Authorizing `identity:create_grant(project_id=512cc83ea7e14883a185753e709c4cc1, user_id=3e468a970489490f8e576c3c96951b55, role_id=16e2ccc8bd1b497d8cee780c1c7df0d2)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:13.754161 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669a2dc5-6d50-46f9-9b8d-23d66dc0c327 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:13.766739 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1287/2589] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 5 12:24:13 2022] PUT /identity/v3/projects/512cc83ea7e14883a185753e709c4cc1/users/3e468a970489490f8e576c3c96951b55/roles/16e2ccc8bd1b497d8cee780c1c7df0d2 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:24:13.839068 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0a54ef-6120-4130-a7d5-f5c882fe4e7f None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:13.839484 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0a54ef-6120-4130-a7d5-f5c882fe4e7f None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:13.839852 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0a54ef-6120-4130-a7d5-f5c882fe4e7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:13.877766 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-bc0a54ef-6120-4130-a7d5-f5c882fe4e7f None None] MFA Rules not processed for user `3e468a970489490f8e576c3c96951b55`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:24:13.879155 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-bc0a54ef-6120-4130-a7d5-f5c882fe4e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:13.969025 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:24:14.069374 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1303/2590] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:24:13 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:24:14.083924 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669a2dc5-6d50-46f9-9b8d-23d66dc0c327 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:14.086342 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-669a2dc5-6d50-46f9-9b8d-23d66dc0c327 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:14.178776 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669a2dc5-6d50-46f9-9b8d-23d66dc0c327 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:14.184204 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79d0b4d-00da-4d89-a48c-8be4ba5e1526 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37633bbae0c2423c81ccd61ac3a17ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:14.185141 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79d0b4d-00da-4d89-a48c-8be4ba5e1526 service cinder] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:14.185543 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79d0b4d-00da-4d89-a48c-8be4ba5e1526 service cinder] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:14.185936 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79d0b4d-00da-4d89-a48c-8be4ba5e1526 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:14.196297 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79d0b4d-00da-4d89-a48c-8be4ba5e1526 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:14.197797 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79d0b4d-00da-4d89-a48c-8be4ba5e1526 service cinder] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:14.209334 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1288/2591] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:24:14 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:24:14.319397 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0a54ef-6120-4130-a7d5-f5c882fe4e7f None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:14.343970 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0a54ef-6120-4130-a7d5-f5c882fe4e7f None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:14.348000 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfeed21-4cd0-45d5-9b33-f893130dee1c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37633bbae0c2423c81ccd61ac3a17ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:14.348743 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfeed21-4cd0-45d5-9b33-f893130dee1c service cinder] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:14.349134 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfeed21-4cd0-45d5-9b33-f893130dee1c service cinder] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:14.349408 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfeed21-4cd0-45d5-9b33-f893130dee1c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:14.464759 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfeed21-4cd0-45d5-9b33-f893130dee1c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:14.467040 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfeed21-4cd0-45d5-9b33-f893130dee1c service cinder] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:14.482508 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1304/2592] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:24:14 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:24:17.170179 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79d0b4d-00da-4d89-a48c-8be4ba5e1526 service cinder] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:17.235704 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79d0b4d-00da-4d89-a48c-8be4ba5e1526 service cinder] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:17.245470 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa7c98a-cbb9-4779-9737-ca93bad66e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:17.246303 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa7c98a-cbb9-4779-9737-ca93bad66e1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:17.246568 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa7c98a-cbb9-4779-9737-ca93bad66e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:17.246927 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa7c98a-cbb9-4779-9737-ca93bad66e1b admin admin] PATH_INFO: `/v3/users/ae4dbbf57ee54886b13f2f10ec778dfd` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:17.248165 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa7c98a-cbb9-4779-9737-ca93bad66e1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae4dbbf57ee54886b13f2f10ec778dfd)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:17.250144 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa7c98a-cbb9-4779-9737-ca93bad66e1b admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:17.276680 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:24:17.308170 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-3fa7c98a-cbb9-4779-9737-ca93bad66e1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae4dbbf57ee54886b13f2f10ec778dfd'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:17.308794 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-3fa7c98a-cbb9-4779-9737-ca93bad66e1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae4dbbf57ee54886b13f2f10ec778dfd'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:17.316713 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-3fa7c98a-cbb9-4779-9737-ca93bad66e1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae4dbbf57ee54886b13f2f10ec778dfd'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:17.317415 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-3fa7c98a-cbb9-4779-9737-ca93bad66e1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae4dbbf57ee54886b13f2f10ec778dfd'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:17.330158 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-3fa7c98a-cbb9-4779-9737-ca93bad66e1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae4dbbf57ee54886b13f2f10ec778dfd'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:17.343728 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1289/2593] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 5 12:24:17 2022] DELETE /identity/v3/users/ae4dbbf57ee54886b13f2f10ec778dfd => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:24:17.348663 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fd9cea-ecdd-4593-92ed-c54a985cd23d None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:17.349207 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fd9cea-ecdd-4593-92ed-c54a985cd23d None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:17.349307 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fd9cea-ecdd-4593-92ed-c54a985cd23d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:17.370091 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-70fd9cea-ecdd-4593-92ed-c54a985cd23d None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:24:17.371318 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-70fd9cea-ecdd-4593-92ed-c54a985cd23d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:17.439681 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1305/2594] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:24:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:24:17.452496 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa7c98a-cbb9-4779-9737-ca93bad66e1b admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:17.454028 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-3fa7c98a-cbb9-4779-9737-ca93bad66e1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:17.516686 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa7c98a-cbb9-4779-9737-ca93bad66e1b admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:17.520454 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e0f917-32ec-4aff-a896-f949a0639b0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4994b4faa4ec4aa088f3dc32c9c5614d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:17.521100 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e0f917-32ec-4aff-a896-f949a0639b0e service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:17.521386 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e0f917-32ec-4aff-a896-f949a0639b0e service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:17.521663 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e0f917-32ec-4aff-a896-f949a0639b0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:17.531798 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e0f917-32ec-4aff-a896-f949a0639b0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:17.533338 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e0f917-32ec-4aff-a896-f949a0639b0e service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:17.543428 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1290/2595] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:24:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:24:18.048822 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fd9cea-ecdd-4593-92ed-c54a985cd23d None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:18.050325 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-70fd9cea-ecdd-4593-92ed-c54a985cd23d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:18.063601 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fd9cea-ecdd-4593-92ed-c54a985cd23d None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:18.066169 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e0f917-32ec-4aff-a896-f949a0639b0e service neutron] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:18.067777 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-16e0f917-32ec-4aff-a896-f949a0639b0e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:18.068054 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef9989e-b6bf-4aa8-af1e-5d74d3ce85f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4994b4faa4ec4aa088f3dc32c9c5614d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:18.068791 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef9989e-b6bf-4aa8-af1e-5d74d3ce85f5 service neutron] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:18.069106 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef9989e-b6bf-4aa8-af1e-5d74d3ce85f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:18.069418 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef9989e-b6bf-4aa8-af1e-5d74d3ce85f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:18.071235 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-4ef9989e-b6bf-4aa8-af1e-5d74d3ce85f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:18.083026 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e0f917-32ec-4aff-a896-f949a0639b0e service neutron] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:18.088428 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db66e421-253e-48bf-ade6-f6699d49194e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:18.089104 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db66e421-253e-48bf-ade6-f6699d49194e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:18.089382 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db66e421-253e-48bf-ade6-f6699d49194e admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:18.091091 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef9989e-b6bf-4aa8-af1e-5d74d3ce85f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:18.093200 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef9989e-b6bf-4aa8-af1e-5d74d3ce85f5 service neutron] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:18.097509 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db66e421-253e-48bf-ade6-f6699d49194e admin admin] PATH_INFO: `/v3/projects/5b3f422ac0a34830bacef9b1ca002f13` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:18.098753 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db66e421-253e-48bf-ade6-f6699d49194e admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b3f422ac0a34830bacef9b1ca002f13)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:18.100698 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db66e421-253e-48bf-ade6-f6699d49194e admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:18.103469 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1306/2596] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:24:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 12:24:18.150641 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-db66e421-253e-48bf-ade6-f6699d49194e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b3f422ac0a34830bacef9b1ca002f13', 'request_id': 'req-db66e421-253e-48bf-ade6-f6699d49194e'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:18.158827 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-db66e421-253e-48bf-ade6-f6699d49194e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b3f422ac0a34830bacef9b1ca002f13', 'request_id': 'req-db66e421-253e-48bf-ade6-f6699d49194e'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:18.165611 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-db66e421-253e-48bf-ade6-f6699d49194e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b3f422ac0a34830bacef9b1ca002f13', 'request_id': 'req-db66e421-253e-48bf-ade6-f6699d49194e'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:18.176707 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-db66e421-253e-48bf-ade6-f6699d49194e admin admin] The token cache is being invalidate because project 5b3f422ac0a34830bacef9b1ca002f13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:24:18.177366 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-db66e421-253e-48bf-ade6-f6699d49194e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:18.177685 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-db66e421-253e-48bf-ade6-f6699d49194e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:18.179190 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1291/2597] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 5 12:24:18 2022] DELETE /identity/v3/projects/5b3f422ac0a34830bacef9b1ca002f13 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 12:24:18.183195 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef9989e-b6bf-4aa8-af1e-5d74d3ce85f5 service neutron] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:18.192869 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef9989e-b6bf-4aa8-af1e-5d74d3ce85f5 service neutron] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:18.374993 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:24:18.383056 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a24c25c-161d-4461-b4ab-fb94ac2286b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:18.383731 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a24c25c-161d-4461-b4ab-fb94ac2286b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:18.384006 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a24c25c-161d-4461-b4ab-fb94ac2286b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:18.384280 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a24c25c-161d-4461-b4ab-fb94ac2286b6 admin admin] PATH_INFO: `/v3/users/3e468a970489490f8e576c3c96951b55` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:18.385475 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a24c25c-161d-4461-b4ab-fb94ac2286b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e468a970489490f8e576c3c96951b55)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:18.387535 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a24c25c-161d-4461-b4ab-fb94ac2286b6 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:18.449105 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-0a24c25c-161d-4461-b4ab-fb94ac2286b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e468a970489490f8e576c3c96951b55'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:18.449105 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-0a24c25c-161d-4461-b4ab-fb94ac2286b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e468a970489490f8e576c3c96951b55'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:18.453593 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-0a24c25c-161d-4461-b4ab-fb94ac2286b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e468a970489490f8e576c3c96951b55'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:18.454450 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-0a24c25c-161d-4461-b4ab-fb94ac2286b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e468a970489490f8e576c3c96951b55'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:18.467480 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-0a24c25c-161d-4461-b4ab-fb94ac2286b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e468a970489490f8e576c3c96951b55'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:18.481201 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1307/2598] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 5 12:24:18 2022] DELETE /identity/v3/users/3e468a970489490f8e576c3c96951b55 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:24:18.787476 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db66e421-253e-48bf-ade6-f6699d49194e admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:18.789095 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-db66e421-253e-48bf-ade6-f6699d49194e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:18.805114 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db66e421-253e-48bf-ade6-f6699d49194e admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:18.859311 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:24:18.904467 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62f679e-3997-4738-9e90-bbcc74c5fe93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:18.905116 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62f679e-3997-4738-9e90-bbcc74c5fe93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:18.905442 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62f679e-3997-4738-9e90-bbcc74c5fe93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:18.905724 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62f679e-3997-4738-9e90-bbcc74c5fe93 admin admin] PATH_INFO: `/v3/projects/512cc83ea7e14883a185753e709c4cc1` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:18.906947 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62f679e-3997-4738-9e90-bbcc74c5fe93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=512cc83ea7e14883a185753e709c4cc1)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:18.909399 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62f679e-3997-4738-9e90-bbcc74c5fe93 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:18.971434 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-a62f679e-3997-4738-9e90-bbcc74c5fe93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '512cc83ea7e14883a185753e709c4cc1', 'request_id': 'req-a62f679e-3997-4738-9e90-bbcc74c5fe93'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:18.984166 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-a62f679e-3997-4738-9e90-bbcc74c5fe93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '512cc83ea7e14883a185753e709c4cc1', 'request_id': 'req-a62f679e-3997-4738-9e90-bbcc74c5fe93'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:18.991955 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-a62f679e-3997-4738-9e90-bbcc74c5fe93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '512cc83ea7e14883a185753e709c4cc1', 'request_id': 'req-a62f679e-3997-4738-9e90-bbcc74c5fe93'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:19.007534 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-a62f679e-3997-4738-9e90-bbcc74c5fe93 admin admin] The token cache is being invalidate because project 512cc83ea7e14883a185753e709c4cc1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:24:19.007829 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-a62f679e-3997-4738-9e90-bbcc74c5fe93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:19.008626 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-a62f679e-3997-4738-9e90-bbcc74c5fe93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:19.010236 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1292/2599] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 5 12:24:18 2022] DELETE /identity/v3/projects/512cc83ea7e14883a185753e709c4cc1 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:24:19.015425 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616a262a-be59-4863-8400-0f9c99004e47 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:19.015793 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616a262a-be59-4863-8400-0f9c99004e47 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:19.016136 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616a262a-be59-4863-8400-0f9c99004e47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:19.037286 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-616a262a-be59-4863-8400-0f9c99004e47 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:24:19.038632 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-616a262a-be59-4863-8400-0f9c99004e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:19.115824 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1308/2600] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:24:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 12:24:19.124208 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39d4196-f49d-44b1-87aa-238e83e805e1 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:19.124498 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39d4196-f49d-44b1-87aa-238e83e805e1 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:19.124772 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39d4196-f49d-44b1-87aa-238e83e805e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:19.145798 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-a39d4196-f49d-44b1-87aa-238e83e805e1 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:24:19.147020 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-a39d4196-f49d-44b1-87aa-238e83e805e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:19.156541 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1293/2601] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:24:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:24:19.164573 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616a262a-be59-4863-8400-0f9c99004e47 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:19.175469 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616a262a-be59-4863-8400-0f9c99004e47 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:19.180137 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2081327-b404-45a2-9d03-6d4571d3b067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:19.180748 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2081327-b404-45a2-9d03-6d4571d3b067 admin admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:19.181055 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2081327-b404-45a2-9d03-6d4571d3b067 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:19.181331 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2081327-b404-45a2-9d03-6d4571d3b067 admin admin] PATH_INFO: `/v3/domains` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:19.181990 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2081327-b404-45a2-9d03-6d4571d3b067 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:24:19.182294 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2081327-b404-45a2-9d03-6d4571d3b067 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:19.184110 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2081327-b404-45a2-9d03-6d4571d3b067 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:19.197298 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1309/2602] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Sep 5 12:24:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:24:19.202080 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39d4196-f49d-44b1-87aa-238e83e805e1 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:19.212830 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39d4196-f49d-44b1-87aa-238e83e805e1 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:19.219529 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11ae745-850d-4090-9e0f-9816561d812d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:19.220134 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11ae745-850d-4090-9e0f-9816561d812d admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:19.220411 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11ae745-850d-4090-9e0f-9816561d812d admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:19.220855 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11ae745-850d-4090-9e0f-9816561d812d admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:19.221361 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11ae745-850d-4090-9e0f-9816561d812d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:19.223315 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11ae745-850d-4090-9e0f-9816561d812d admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:19.254597 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1294/2603] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 5 12:24:19 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:24:19.259483 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2081327-b404-45a2-9d03-6d4571d3b067 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:19.272177 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2081327-b404-45a2-9d03-6d4571d3b067 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:19.340027 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec0ac30-8dd6-440b-974d-dcaed3c76bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:19.340681 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec0ac30-8dd6-440b-974d-dcaed3c76bdd admin admin] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:19.341011 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec0ac30-8dd6-440b-974d-dcaed3c76bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:19.345943 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec0ac30-8dd6-440b-974d-dcaed3c76bdd admin admin] PATH_INFO: `/v3/users` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:19.346734 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec0ac30-8dd6-440b-974d-dcaed3c76bdd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:19.348706 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec0ac30-8dd6-440b-974d-dcaed3c76bdd admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:19.359628 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:24:19.375923 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1310/2604] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 5 12:24:19 2022] POST /identity/v3/users => generated 287 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:24:19.381812 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11ae745-850d-4090-9e0f-9816561d812d admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:19.401152 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11ae745-850d-4090-9e0f-9816561d812d admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:19.408275 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6009d84-ad1b-4139-9c41-aa634a1fed7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:19.408840 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6009d84-ad1b-4139-9c41-aa634a1fed7a admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:19.409160 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6009d84-ad1b-4139-9c41-aa634a1fed7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:19.409436 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6009d84-ad1b-4139-9c41-aa634a1fed7a admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:19.410105 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6009d84-ad1b-4139-9c41-aa634a1fed7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:19.411814 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6009d84-ad1b-4139-9c41-aa634a1fed7a admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:19.423945 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1295/2605] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:24:19 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:24:19.428300 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec0ac30-8dd6-440b-974d-dcaed3c76bdd admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:19.440831 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec0ac30-8dd6-440b-974d-dcaed3c76bdd admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:19.447631 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9847d04-f849-415e-851d-552f6a5243e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:19.448258 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9847d04-f849-415e-851d-552f6a5243e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:19.448539 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9847d04-f849-415e-851d-552f6a5243e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:19.448813 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9847d04-f849-415e-851d-552f6a5243e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:19.454430 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9847d04-f849-415e-851d-552f6a5243e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:19.456783 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9847d04-f849-415e-851d-552f6a5243e3 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:19.472578 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1311/2606] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:24:19 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:24:19.477210 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6009d84-ad1b-4139-9c41-aa634a1fed7a admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:19.507647 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6009d84-ad1b-4139-9c41-aa634a1fed7a admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:19.513612 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b573c795-625a-4cb0-a8e2-57d4bfb1fa07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:19.514483 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b573c795-625a-4cb0-a8e2-57d4bfb1fa07 admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:19.514834 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b573c795-625a-4cb0-a8e2-57d4bfb1fa07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:19.515428 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b573c795-625a-4cb0-a8e2-57d4bfb1fa07 admin admin] PATH_INFO: `/v3/projects/6177288cb4174cefb547fc5aa0d067a6/users/39d7b72419d84aa386c35db1a31d356c/roles/ed72181e1403401facb77dcf33644757` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:19.537354 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b573c795-625a-4cb0-a8e2-57d4bfb1fa07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6177288cb4174cefb547fc5aa0d067a6, user_id=39d7b72419d84aa386c35db1a31d356c, role_id=ed72181e1403401facb77dcf33644757)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:19.540703 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b573c795-625a-4cb0-a8e2-57d4bfb1fa07 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:19.557114 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1296/2607] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 5 12:24:19 2022] PUT /identity/v3/projects/6177288cb4174cefb547fc5aa0d067a6/users/39d7b72419d84aa386c35db1a31d356c/roles/ed72181e1403401facb77dcf33644757 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:24:19.562229 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3045575f-d649-4945-b96d-214f1ffa5ab9 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:19.563300 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3045575f-d649-4945-b96d-214f1ffa5ab9 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:19.563593 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3045575f-d649-4945-b96d-214f1ffa5ab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:19.592098 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-3045575f-d649-4945-b96d-214f1ffa5ab9 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:24:19.593407 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-3045575f-d649-4945-b96d-214f1ffa5ab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:19.662481 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1312/2608] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:24:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 12:24:19.672265 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b573c795-625a-4cb0-a8e2-57d4bfb1fa07 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:19.674167 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-b573c795-625a-4cb0-a8e2-57d4bfb1fa07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:19.735561 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b573c795-625a-4cb0-a8e2-57d4bfb1fa07 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:19.739655 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c68702-909e-4b30-9223-be4e57bd29ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4994b4faa4ec4aa088f3dc32c9c5614d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:19.740275 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c68702-909e-4b30-9223-be4e57bd29ff service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:19.740558 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c68702-909e-4b30-9223-be4e57bd29ff service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:19.740826 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c68702-909e-4b30-9223-be4e57bd29ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:19.749238 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:24:19.751695 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c68702-909e-4b30-9223-be4e57bd29ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:19.753719 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c68702-909e-4b30-9223-be4e57bd29ff service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:19.767031 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1297/2609] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:24:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:24:20.564908 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24ab216-be8c-4bc5-9b15-a0d326732317 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:20.566001 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24ab216-be8c-4bc5-9b15-a0d326732317 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:20.566515 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24ab216-be8c-4bc5-9b15-a0d326732317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:20.619596 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-f24ab216-be8c-4bc5-9b15-a0d326732317 None None] MFA Rules not processed for user `39d7b72419d84aa386c35db1a31d356c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:24:20.621517 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-f24ab216-be8c-4bc5-9b15-a0d326732317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:20.738633 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1313/2610] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:24:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:24:20.739413 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c68702-909e-4b30-9223-be4e57bd29ff service neutron] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:20.749763 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c68702-909e-4b30-9223-be4e57bd29ff service neutron] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:20.755348 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68ab3e2-c5a1-45b6-9f05-458e1a81fdcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:20.756017 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68ab3e2-c5a1-45b6-9f05-458e1a81fdcb admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:20.756306 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68ab3e2-c5a1-45b6-9f05-458e1a81fdcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:20.756639 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68ab3e2-c5a1-45b6-9f05-458e1a81fdcb admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:20.757345 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68ab3e2-c5a1-45b6-9f05-458e1a81fdcb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:20.759347 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68ab3e2-c5a1-45b6-9f05-458e1a81fdcb admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:20.802553 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1298/2611] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 5 12:24:20 2022] POST /identity/v3/projects => generated 373 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 12:24:20.803783 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24ab216-be8c-4bc5-9b15-a0d326732317 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:20.815341 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24ab216-be8c-4bc5-9b15-a0d326732317 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:20.874072 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3704b91-3e5d-4e9b-8311-8af22aeabe75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:20.874707 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3704b91-3e5d-4e9b-8311-8af22aeabe75 admin admin] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:20.874988 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3704b91-3e5d-4e9b-8311-8af22aeabe75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:20.875253 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3704b91-3e5d-4e9b-8311-8af22aeabe75 admin admin] PATH_INFO: `/v3/users` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:20.875886 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3704b91-3e5d-4e9b-8311-8af22aeabe75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:20.878983 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3704b91-3e5d-4e9b-8311-8af22aeabe75 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:20.899102 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:24:20.910975 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1314/2612] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 5 12:24:20 2022] POST /identity/v3/users => generated 293 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:24:20.912164 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68ab3e2-c5a1-45b6-9f05-458e1a81fdcb admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:20.923002 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68ab3e2-c5a1-45b6-9f05-458e1a81fdcb admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:20.928103 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a4b377-52ba-4592-bf2b-9292c689d44e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:20.928721 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a4b377-52ba-4592-bf2b-9292c689d44e admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:20.929032 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a4b377-52ba-4592-bf2b-9292c689d44e admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:20.929303 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a4b377-52ba-4592-bf2b-9292c689d44e admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:20.929947 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a4b377-52ba-4592-bf2b-9292c689d44e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:20.931562 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a4b377-52ba-4592-bf2b-9292c689d44e admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:20.947720 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1299/2613] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:24:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 12:24:20.949051 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3704b91-3e5d-4e9b-8311-8af22aeabe75 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:20.963715 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3704b91-3e5d-4e9b-8311-8af22aeabe75 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:20.970067 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333817ba-a2ce-4516-b9ca-73790da77eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:20.970820 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333817ba-a2ce-4516-b9ca-73790da77eb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:20.971171 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333817ba-a2ce-4516-b9ca-73790da77eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:20.971533 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333817ba-a2ce-4516-b9ca-73790da77eb5 admin admin] PATH_INFO: `/v3/projects/93f7aa939aac422ab88426d71f76dbfd/users/994d5f9787314d86b1a5f2f21d3eb056/roles/16e2ccc8bd1b497d8cee780c1c7df0d2` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:20.992018 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333817ba-a2ce-4516-b9ca-73790da77eb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93f7aa939aac422ab88426d71f76dbfd, user_id=994d5f9787314d86b1a5f2f21d3eb056, role_id=16e2ccc8bd1b497d8cee780c1c7df0d2)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:20.995167 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333817ba-a2ce-4516-b9ca-73790da77eb5 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:21.016885 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1315/2614] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 5 12:24:20 2022] PUT /identity/v3/projects/93f7aa939aac422ab88426d71f76dbfd/users/994d5f9787314d86b1a5f2f21d3eb056/roles/16e2ccc8bd1b497d8cee780c1c7df0d2 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:24:21.021047 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a4b377-52ba-4592-bf2b-9292c689d44e admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:21.031999 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a4b377-52ba-4592-bf2b-9292c689d44e admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:21.088241 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b301c6-200d-4ec1-b511-b251ed1d3b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:21.088975 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b301c6-200d-4ec1-b511-b251ed1d3b19 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:21.089254 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b301c6-200d-4ec1-b511-b251ed1d3b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:21.089522 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b301c6-200d-4ec1-b511-b251ed1d3b19 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:21.090160 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b301c6-200d-4ec1-b511-b251ed1d3b19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:21.092428 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b301c6-200d-4ec1-b511-b251ed1d3b19 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:21.102447 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1300/2615] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:24:21 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:24:21.106774 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333817ba-a2ce-4516-b9ca-73790da77eb5 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:21.117379 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333817ba-a2ce-4516-b9ca-73790da77eb5 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:21.122319 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7215d656-9062-4754-97d9-6aab0797544d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:21.122999 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7215d656-9062-4754-97d9-6aab0797544d admin admin] REQUEST_METHOD: `PUT` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:21.123277 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7215d656-9062-4754-97d9-6aab0797544d admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:21.123551 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7215d656-9062-4754-97d9-6aab0797544d admin admin] PATH_INFO: `/v3/projects/93f7aa939aac422ab88426d71f76dbfd/users/994d5f9787314d86b1a5f2f21d3eb056/roles/16e2ccc8bd1b497d8cee780c1c7df0d2` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:21.125518 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7215d656-9062-4754-97d9-6aab0797544d admin admin] RBAC: Authorizing `identity:create_grant(project_id=93f7aa939aac422ab88426d71f76dbfd, user_id=994d5f9787314d86b1a5f2f21d3eb056, role_id=16e2ccc8bd1b497d8cee780c1c7df0d2)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:21.128119 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7215d656-9062-4754-97d9-6aab0797544d admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:21.139272 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1316/2616] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 5 12:24:21 2022] PUT /identity/v3/projects/93f7aa939aac422ab88426d71f76dbfd/users/994d5f9787314d86b1a5f2f21d3eb056/roles/16e2ccc8bd1b497d8cee780c1c7df0d2 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:24:22.106765 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129c0974-46de-4e9c-aeda-ac1b87e095ae None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:22.107554 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129c0974-46de-4e9c-aeda-ac1b87e095ae None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:22.107554 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129c0974-46de-4e9c-aeda-ac1b87e095ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:22.119692 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7215d656-9062-4754-97d9-6aab0797544d admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:22.121533 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-7215d656-9062-4754-97d9-6aab0797544d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:22.141923 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-129c0974-46de-4e9c-aeda-ac1b87e095ae None None] MFA Rules not processed for user `994d5f9787314d86b1a5f2f21d3eb056`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:24:22.143185 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-129c0974-46de-4e9c-aeda-ac1b87e095ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:22.195214 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7215d656-9062-4754-97d9-6aab0797544d admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:22.201420 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c097cb8d-44fe-4c22-bbbb-b39de111244b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:22.202073 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c097cb8d-44fe-4c22-bbbb-b39de111244b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:22.202358 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c097cb8d-44fe-4c22-bbbb-b39de111244b admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:22.202630 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c097cb8d-44fe-4c22-bbbb-b39de111244b admin admin] PATH_INFO: `/v3/users/09f4ccac184d43b7a519471316dd28b3` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:22.203809 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c097cb8d-44fe-4c22-bbbb-b39de111244b admin admin] RBAC: Authorizing `identity:delete_user(user_id=09f4ccac184d43b7a519471316dd28b3)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:22.205753 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c097cb8d-44fe-4c22-bbbb-b39de111244b admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:22.234836 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1301/2617] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:24:22 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:24:22.236298 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2381f89-a382-47a4-a1b3-ad73a3d3b073 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:22.238347 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2381f89-a382-47a4-a1b3-ad73a3d3b073 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:22.238347 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2381f89-a382-47a4-a1b3-ad73a3d3b073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:22.266629 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-f2381f89-a382-47a4-a1b3-ad73a3d3b073 None None] MFA Rules not processed for user `39d7b72419d84aa386c35db1a31d356c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:24:22.267848 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-f2381f89-a382-47a4-a1b3-ad73a3d3b073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:22.273268 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-c097cb8d-44fe-4c22-bbbb-b39de111244b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09f4ccac184d43b7a519471316dd28b3'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:22.274142 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-c097cb8d-44fe-4c22-bbbb-b39de111244b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09f4ccac184d43b7a519471316dd28b3'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:22.284304 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-c097cb8d-44fe-4c22-bbbb-b39de111244b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09f4ccac184d43b7a519471316dd28b3'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:22.285456 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-c097cb8d-44fe-4c22-bbbb-b39de111244b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09f4ccac184d43b7a519471316dd28b3'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:22.302778 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-c097cb8d-44fe-4c22-bbbb-b39de111244b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09f4ccac184d43b7a519471316dd28b3'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:22.317547 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1317/2618] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 5 12:24:22 2022] DELETE /identity/v3/users/09f4ccac184d43b7a519471316dd28b3 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:24:22.338032 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:24:22.355199 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1302/2619] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:24:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 12:24:22.367457 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c097cb8d-44fe-4c22-bbbb-b39de111244b admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:22.369205 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-c097cb8d-44fe-4c22-bbbb-b39de111244b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:22.417943 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:24:22.450378 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c097cb8d-44fe-4c22-bbbb-b39de111244b admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:22.456614 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b798c89-9758-42ed-9dcb-c42d04b0f564 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb060ff495bc4abb83ff88992fb7be09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:22.457271 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b798c89-9758-42ed-9dcb-c42d04b0f564 service nova] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:22.457549 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b798c89-9758-42ed-9dcb-c42d04b0f564 service nova] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:22.459580 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b798c89-9758-42ed-9dcb-c42d04b0f564 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:22.460759 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-5b798c89-9758-42ed-9dcb-c42d04b0f564 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:22.505025 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2381f89-a382-47a4-a1b3-ad73a3d3b073 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:22.507723 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-f2381f89-a382-47a4-a1b3-ad73a3d3b073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:22.531457 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2381f89-a382-47a4-a1b3-ad73a3d3b073 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:22.533087 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b798c89-9758-42ed-9dcb-c42d04b0f564 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:22.534690 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b798c89-9758-42ed-9dcb-c42d04b0f564 service nova] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:22.547750 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1318/2620] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:24:22 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:24:22.623878 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0261629-08de-4759-a42f-2f7221e38840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:22.624593 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0261629-08de-4759-a42f-2f7221e38840 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:22.625025 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0261629-08de-4759-a42f-2f7221e38840 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:22.625312 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0261629-08de-4759-a42f-2f7221e38840 admin admin] PATH_INFO: `/v3/projects/7fdfe7dc0efc4ff4abd8fcdff51f2eae` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:22.626555 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0261629-08de-4759-a42f-2f7221e38840 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fdfe7dc0efc4ff4abd8fcdff51f2eae)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:22.629392 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0261629-08de-4759-a42f-2f7221e38840 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:22.678654 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-b0261629-08de-4759-a42f-2f7221e38840 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fdfe7dc0efc4ff4abd8fcdff51f2eae', 'request_id': 'req-b0261629-08de-4759-a42f-2f7221e38840'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:22.687406 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-b0261629-08de-4759-a42f-2f7221e38840 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fdfe7dc0efc4ff4abd8fcdff51f2eae', 'request_id': 'req-b0261629-08de-4759-a42f-2f7221e38840'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:22.694380 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-b0261629-08de-4759-a42f-2f7221e38840 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fdfe7dc0efc4ff4abd8fcdff51f2eae', 'request_id': 'req-b0261629-08de-4759-a42f-2f7221e38840'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:22.705212 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-b0261629-08de-4759-a42f-2f7221e38840 admin admin] The token cache is being invalidate because project 7fdfe7dc0efc4ff4abd8fcdff51f2eae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:24:22.705507 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-b0261629-08de-4759-a42f-2f7221e38840 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:22.706182 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-b0261629-08de-4759-a42f-2f7221e38840 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:22.707701 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1303/2621] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 5 12:24:22 2022] DELETE /identity/v3/projects/7fdfe7dc0efc4ff4abd8fcdff51f2eae => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 12:24:22.712747 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb45e5be-f482-4b8a-8e3f-d2e37bb43b42 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:22.713132 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb45e5be-f482-4b8a-8e3f-d2e37bb43b42 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:22.713468 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb45e5be-f482-4b8a-8e3f-d2e37bb43b42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:22.735945 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-eb45e5be-f482-4b8a-8e3f-d2e37bb43b42 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:24:22.737213 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-eb45e5be-f482-4b8a-8e3f-d2e37bb43b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:22.790919 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0261629-08de-4759-a42f-2f7221e38840 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:22.792426 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-b0261629-08de-4759-a42f-2f7221e38840 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:22.813809 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1319/2622] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:24:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:24:22.822105 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8772b6-1610-4b2e-bbd9-939132281645 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:22.822395 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8772b6-1610-4b2e-bbd9-939132281645 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:22.822691 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8772b6-1610-4b2e-bbd9-939132281645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:22.849629 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-0f8772b6-1610-4b2e-bbd9-939132281645 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:24:22.851035 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-0f8772b6-1610-4b2e-bbd9-939132281645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:22.855176 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0261629-08de-4759-a42f-2f7221e38840 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:22.859453 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc829f4-e1e7-4603-8dfe-82adf3e529e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4994b4faa4ec4aa088f3dc32c9c5614d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:22.859826 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1320/2623] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:24:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 12:24:22.860058 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc829f4-e1e7-4603-8dfe-82adf3e529e7 service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:22.860338 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc829f4-e1e7-4603-8dfe-82adf3e529e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:22.860614 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc829f4-e1e7-4603-8dfe-82adf3e529e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:22.862453 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-9dc829f4-e1e7-4603-8dfe-82adf3e529e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:22.864104 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8772b6-1610-4b2e-bbd9-939132281645 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:22.873105 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc829f4-e1e7-4603-8dfe-82adf3e529e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:22.873313 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8772b6-1610-4b2e-bbd9-939132281645 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:22.874567 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc829f4-e1e7-4603-8dfe-82adf3e529e7 service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:22.878130 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b708fe03-8e66-4240-8157-0339dc7d255e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:22.878736 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b708fe03-8e66-4240-8157-0339dc7d255e admin admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:22.879043 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b708fe03-8e66-4240-8157-0339dc7d255e admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:22.879312 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b708fe03-8e66-4240-8157-0339dc7d255e admin admin] PATH_INFO: `/v3/domains` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:22.879956 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b708fe03-8e66-4240-8157-0339dc7d255e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:24:22.880256 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b708fe03-8e66-4240-8157-0339dc7d255e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:22.881863 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b708fe03-8e66-4240-8157-0339dc7d255e admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:22.882754 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1304/2624] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:24:22 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 12:24:22.894384 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1321/2625] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Sep 5 12:24:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:24:22.898964 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc829f4-e1e7-4603-8dfe-82adf3e529e7 service neutron] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:22.911040 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc829f4-e1e7-4603-8dfe-82adf3e529e7 service neutron] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:22.915636 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b6f071-bc63-40da-8dd5-070451a34f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:22.916250 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b6f071-bc63-40da-8dd5-070451a34f58 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:22.916534 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b6f071-bc63-40da-8dd5-070451a34f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:22.916814 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b6f071-bc63-40da-8dd5-070451a34f58 admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:22.917508 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b6f071-bc63-40da-8dd5-070451a34f58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:22.920009 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b6f071-bc63-40da-8dd5-070451a34f58 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:22.944788 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:24:22.953241 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1305/2626] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 5 12:24:22 2022] POST /identity/v3/projects => generated 405 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:24:22.957365 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b708fe03-8e66-4240-8157-0339dc7d255e admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:22.968391 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b708fe03-8e66-4240-8157-0339dc7d255e admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:23.032864 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81bf01d-004e-43b2-8760-5ae501f63788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:23.033429 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81bf01d-004e-43b2-8760-5ae501f63788 admin admin] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:23.033706 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81bf01d-004e-43b2-8760-5ae501f63788 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:23.033976 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81bf01d-004e-43b2-8760-5ae501f63788 admin admin] PATH_INFO: `/v3/users` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:23.034628 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81bf01d-004e-43b2-8760-5ae501f63788 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:23.036541 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81bf01d-004e-43b2-8760-5ae501f63788 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:23.045760 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:24:23.062960 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1322/2627] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 5 12:24:22 2022] POST /identity/v3/users => generated 303 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:24:23.067125 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b6f071-bc63-40da-8dd5-070451a34f58 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:23.079479 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b6f071-bc63-40da-8dd5-070451a34f58 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:23.088948 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cf4f81-3a2c-4bd7-860e-76880708e4ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:23.089574 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cf4f81-3a2c-4bd7-860e-76880708e4ad admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:23.089855 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cf4f81-3a2c-4bd7-860e-76880708e4ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:23.090132 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cf4f81-3a2c-4bd7-860e-76880708e4ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:23.090782 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cf4f81-3a2c-4bd7-860e-76880708e4ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:23.093208 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cf4f81-3a2c-4bd7-860e-76880708e4ad admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:23.104793 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1306/2628] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:24:23 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:24:23.109074 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81bf01d-004e-43b2-8760-5ae501f63788 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:23.119369 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81bf01d-004e-43b2-8760-5ae501f63788 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:23.124709 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f81bba-11e8-4cd8-acb0-636152ff6a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:23.125344 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f81bba-11e8-4cd8-acb0-636152ff6a46 admin admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:23.125620 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f81bba-11e8-4cd8-acb0-636152ff6a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:23.125892 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f81bba-11e8-4cd8-acb0-636152ff6a46 admin admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:23.126539 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f81bba-11e8-4cd8-acb0-636152ff6a46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:23.128121 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f81bba-11e8-4cd8-acb0-636152ff6a46 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:23.139203 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1323/2629] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:24:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:24:23.143758 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cf4f81-3a2c-4bd7-860e-76880708e4ad admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:23.153793 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cf4f81-3a2c-4bd7-860e-76880708e4ad admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:23.158941 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff9b66d-342e-4c16-8a47-6e1910ad57ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:23.159599 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff9b66d-342e-4c16-8a47-6e1910ad57ae admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:23.159876 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff9b66d-342e-4c16-8a47-6e1910ad57ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:23.160147 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff9b66d-342e-4c16-8a47-6e1910ad57ae admin admin] PATH_INFO: `/v3/projects/92fad628206c4be2b3d23c63327ce392/users/22e8ce08c87b41d88c4dace3200014c4/roles/ed72181e1403401facb77dcf33644757` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:23.176383 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff9b66d-342e-4c16-8a47-6e1910ad57ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=92fad628206c4be2b3d23c63327ce392, user_id=22e8ce08c87b41d88c4dace3200014c4, role_id=ed72181e1403401facb77dcf33644757)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:23.179094 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff9b66d-342e-4c16-8a47-6e1910ad57ae admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:23.196744 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1307/2630] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 5 12:24:23 2022] PUT /identity/v3/projects/92fad628206c4be2b3d23c63327ce392/users/22e8ce08c87b41d88c4dace3200014c4/roles/ed72181e1403401facb77dcf33644757 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:24:23.198573 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bfbb3a-6703-4f90-bc3f-7eea55e10482 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:23.199282 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bfbb3a-6703-4f90-bc3f-7eea55e10482 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:23.199814 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bfbb3a-6703-4f90-bc3f-7eea55e10482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:23.223048 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-93bfbb3a-6703-4f90-bc3f-7eea55e10482 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:24:23.224306 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-93bfbb3a-6703-4f90-bc3f-7eea55e10482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:23.304444 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1324/2631] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:24:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:24:23.319637 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff9b66d-342e-4c16-8a47-6e1910ad57ae admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:23.322041 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-fff9b66d-342e-4c16-8a47-6e1910ad57ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:23.395012 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff9b66d-342e-4c16-8a47-6e1910ad57ae admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:23.402170 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31994470-1239-421c-81f6-d48720506e3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4994b4faa4ec4aa088f3dc32c9c5614d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:23.402170 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31994470-1239-421c-81f6-d48720506e3a service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:23.402170 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31994470-1239-421c-81f6-d48720506e3a service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:23.402170 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31994470-1239-421c-81f6-d48720506e3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:23.412526 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31994470-1239-421c-81f6-d48720506e3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:23.414396 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31994470-1239-421c-81f6-d48720506e3a service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:23.426393 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1308/2632] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:24:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:24:24.160956 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054f5f5c-1225-4cf9-a1d2-98327b90ffe7 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:24.161526 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054f5f5c-1225-4cf9-a1d2-98327b90ffe7 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:24.161526 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054f5f5c-1225-4cf9-a1d2-98327b90ffe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:24.194981 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-054f5f5c-1225-4cf9-a1d2-98327b90ffe7 None None] MFA Rules not processed for user `22e8ce08c87b41d88c4dace3200014c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:24:24.196204 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-054f5f5c-1225-4cf9-a1d2-98327b90ffe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:24.281815 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1325/2633] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:24:24 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:24:24.288261 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31994470-1239-421c-81f6-d48720506e3a service neutron] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:24.311108 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31994470-1239-421c-81f6-d48720506e3a service neutron] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:24.316209 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b0ee94-3992-4844-ae68-9d1303cf04c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:24.316766 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b0ee94-3992-4844-ae68-9d1303cf04c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:24.317133 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b0ee94-3992-4844-ae68-9d1303cf04c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:24.317414 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b0ee94-3992-4844-ae68-9d1303cf04c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:24.318353 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b0ee94-3992-4844-ae68-9d1303cf04c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:24.320646 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b0ee94-3992-4844-ae68-9d1303cf04c6 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:24.366061 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1309/2634] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 5 12:24:24 2022] POST /identity/v3/projects => generated 403 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:24:24.370418 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054f5f5c-1225-4cf9-a1d2-98327b90ffe7 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:24.389898 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054f5f5c-1225-4cf9-a1d2-98327b90ffe7 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:24.481424 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b22539a-a610-4d35-a5fb-5c4e7dd2d380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:24.483007 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b22539a-a610-4d35-a5fb-5c4e7dd2d380 admin admin] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:24.483513 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b22539a-a610-4d35-a5fb-5c4e7dd2d380 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:24.483790 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b22539a-a610-4d35-a5fb-5c4e7dd2d380 admin admin] PATH_INFO: `/v3/users` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:24.484453 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b22539a-a610-4d35-a5fb-5c4e7dd2d380 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:24.486535 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b22539a-a610-4d35-a5fb-5c4e7dd2d380 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:24.510053 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:24:24.519161 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1326/2635] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 5 12:24:24 2022] POST /identity/v3/users => generated 308 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:24:24.523394 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b0ee94-3992-4844-ae68-9d1303cf04c6 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:24.535285 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b0ee94-3992-4844-ae68-9d1303cf04c6 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:24.541591 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3426d069-1a0f-482f-b818-bccdc4e3f2c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:24.541591 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3426d069-1a0f-482f-b818-bccdc4e3f2c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:24.541927 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3426d069-1a0f-482f-b818-bccdc4e3f2c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:24.542157 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3426d069-1a0f-482f-b818-bccdc4e3f2c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:24.542819 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3426d069-1a0f-482f-b818-bccdc4e3f2c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:24.545041 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3426d069-1a0f-482f-b818-bccdc4e3f2c3 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:24.559486 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1310/2636] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:24:24 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 12:24:24.563457 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b22539a-a610-4d35-a5fb-5c4e7dd2d380 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:24.576391 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b22539a-a610-4d35-a5fb-5c4e7dd2d380 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:24.580210 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41523acd-d3cd-4bf3-b716-794138fde977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:24.581006 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41523acd-d3cd-4bf3-b716-794138fde977 admin admin] REQUEST_METHOD: `PUT` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:24.581226 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41523acd-d3cd-4bf3-b716-794138fde977 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:24.581455 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41523acd-d3cd-4bf3-b716-794138fde977 admin admin] PATH_INFO: `/v3/projects/dfd32501b7974ee48a1401efc2c1465c/users/efb35bcebab64c5fbf74669ca35556b0/roles/16e2ccc8bd1b497d8cee780c1c7df0d2` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:24.601660 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41523acd-d3cd-4bf3-b716-794138fde977 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfd32501b7974ee48a1401efc2c1465c, user_id=efb35bcebab64c5fbf74669ca35556b0, role_id=16e2ccc8bd1b497d8cee780c1c7df0d2)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:24.605422 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41523acd-d3cd-4bf3-b716-794138fde977 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:24.624467 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1327/2637] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 5 12:24:24 2022] PUT /identity/v3/projects/dfd32501b7974ee48a1401efc2c1465c/users/efb35bcebab64c5fbf74669ca35556b0/roles/16e2ccc8bd1b497d8cee780c1c7df0d2 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:24:24.629013 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3426d069-1a0f-482f-b818-bccdc4e3f2c3 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:24.642918 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3426d069-1a0f-482f-b818-bccdc4e3f2c3 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:24.713338 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a801f284-c5d4-4376-8adc-58208510edca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:24.714064 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a801f284-c5d4-4376-8adc-58208510edca admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:24.714404 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a801f284-c5d4-4376-8adc-58208510edca admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:24.714736 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a801f284-c5d4-4376-8adc-58208510edca admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:24.715998 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a801f284-c5d4-4376-8adc-58208510edca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:24.718448 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a801f284-c5d4-4376-8adc-58208510edca admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:24.730548 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1311/2638] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:24:24 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:24:24.734943 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41523acd-d3cd-4bf3-b716-794138fde977 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:24.749416 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41523acd-d3cd-4bf3-b716-794138fde977 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:24.755603 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8314e55-0231-4e8f-bb56-6aa6602aef40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:24.756825 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8314e55-0231-4e8f-bb56-6aa6602aef40 admin admin] REQUEST_METHOD: `PUT` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:24.757089 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8314e55-0231-4e8f-bb56-6aa6602aef40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:24.757492 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8314e55-0231-4e8f-bb56-6aa6602aef40 admin admin] PATH_INFO: `/v3/projects/dfd32501b7974ee48a1401efc2c1465c/users/efb35bcebab64c5fbf74669ca35556b0/roles/16e2ccc8bd1b497d8cee780c1c7df0d2` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:24.766002 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8314e55-0231-4e8f-bb56-6aa6602aef40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfd32501b7974ee48a1401efc2c1465c, user_id=efb35bcebab64c5fbf74669ca35556b0, role_id=16e2ccc8bd1b497d8cee780c1c7df0d2)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:24.768789 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8314e55-0231-4e8f-bb56-6aa6602aef40 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:24.782154 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1328/2639] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 5 12:24:24 2022] PUT /identity/v3/projects/dfd32501b7974ee48a1401efc2c1465c/users/efb35bcebab64c5fbf74669ca35556b0/roles/16e2ccc8bd1b497d8cee780c1c7df0d2 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:24:26.323926 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd62867-227d-4d1c-99e5-ce7b33459885 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:26.324465 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd62867-227d-4d1c-99e5-ce7b33459885 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:26.325406 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd62867-227d-4d1c-99e5-ce7b33459885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:26.361348 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-bdd62867-227d-4d1c-99e5-ce7b33459885 None None] MFA Rules not processed for user `efb35bcebab64c5fbf74669ca35556b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:24:26.362870 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-bdd62867-227d-4d1c-99e5-ce7b33459885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:26.384962 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:24:26.443908 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1312/2640] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:24:26 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:24:28.103793 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8314e55-0231-4e8f-bb56-6aa6602aef40 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:28.166964 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8314e55-0231-4e8f-bb56-6aa6602aef40 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:28.171468 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0332cc-d46e-4d3e-89f8-9f785803d4bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:28.172090 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0332cc-d46e-4d3e-89f8-9f785803d4bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:28.172364 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0332cc-d46e-4d3e-89f8-9f785803d4bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:28.172634 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0332cc-d46e-4d3e-89f8-9f785803d4bb admin admin] PATH_INFO: `/v3/users/22e8ce08c87b41d88c4dace3200014c4` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:28.173796 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0332cc-d46e-4d3e-89f8-9f785803d4bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=22e8ce08c87b41d88c4dace3200014c4)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:28.175693 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0332cc-d46e-4d3e-89f8-9f785803d4bb admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:28.221577 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-ae0332cc-d46e-4d3e-89f8-9f785803d4bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22e8ce08c87b41d88c4dace3200014c4'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:28.222229 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-ae0332cc-d46e-4d3e-89f8-9f785803d4bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22e8ce08c87b41d88c4dace3200014c4'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:28.229499 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-ae0332cc-d46e-4d3e-89f8-9f785803d4bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22e8ce08c87b41d88c4dace3200014c4'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:28.230124 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-ae0332cc-d46e-4d3e-89f8-9f785803d4bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22e8ce08c87b41d88c4dace3200014c4'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:28.242596 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-ae0332cc-d46e-4d3e-89f8-9f785803d4bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22e8ce08c87b41d88c4dace3200014c4'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:28.255722 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1329/2641] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 5 12:24:28 2022] DELETE /identity/v3/users/22e8ce08c87b41d88c4dace3200014c4 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:24:28.434109 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd62867-227d-4d1c-99e5-ce7b33459885 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:28.451276 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd62867-227d-4d1c-99e5-ce7b33459885 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:28.521203 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd01220-b577-4017-a2d2-b302143b7751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:28.521755 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd01220-b577-4017-a2d2-b302143b7751 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:28.522043 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd01220-b577-4017-a2d2-b302143b7751 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:28.522313 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd01220-b577-4017-a2d2-b302143b7751 admin admin] PATH_INFO: `/v3/projects/92fad628206c4be2b3d23c63327ce392` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:28.523492 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd01220-b577-4017-a2d2-b302143b7751 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92fad628206c4be2b3d23c63327ce392)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:28.525455 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd01220-b577-4017-a2d2-b302143b7751 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:28.575340 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-0dd01220-b577-4017-a2d2-b302143b7751 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92fad628206c4be2b3d23c63327ce392', 'request_id': 'req-0dd01220-b577-4017-a2d2-b302143b7751'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:28.582694 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-0dd01220-b577-4017-a2d2-b302143b7751 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92fad628206c4be2b3d23c63327ce392', 'request_id': 'req-0dd01220-b577-4017-a2d2-b302143b7751'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:28.589373 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-0dd01220-b577-4017-a2d2-b302143b7751 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92fad628206c4be2b3d23c63327ce392', 'request_id': 'req-0dd01220-b577-4017-a2d2-b302143b7751'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:28.600102 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-0dd01220-b577-4017-a2d2-b302143b7751 admin admin] The token cache is being invalidate because project 92fad628206c4be2b3d23c63327ce392 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:24:28.600369 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-0dd01220-b577-4017-a2d2-b302143b7751 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:28.601498 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-0dd01220-b577-4017-a2d2-b302143b7751 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:28.602974 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1313/2642] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 5 12:24:28 2022] DELETE /identity/v3/projects/92fad628206c4be2b3d23c63327ce392 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:24:28.607643 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0332cc-d46e-4d3e-89f8-9f785803d4bb admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:28.609108 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-ae0332cc-d46e-4d3e-89f8-9f785803d4bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:28.622974 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0332cc-d46e-4d3e-89f8-9f785803d4bb admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:28.661152 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:24:28.682411 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2f7c9e-a0c4-464c-b785-e81f9682f20b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:28.683047 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2f7c9e-a0c4-464c-b785-e81f9682f20b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:28.683346 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2f7c9e-a0c4-464c-b785-e81f9682f20b admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:28.683618 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2f7c9e-a0c4-464c-b785-e81f9682f20b admin admin] PATH_INFO: `/v3/users/efb35bcebab64c5fbf74669ca35556b0` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:28.684773 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2f7c9e-a0c4-464c-b785-e81f9682f20b admin admin] RBAC: Authorizing `identity:delete_user(user_id=efb35bcebab64c5fbf74669ca35556b0)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:28.687319 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2f7c9e-a0c4-464c-b785-e81f9682f20b admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:28.736135 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-9d2f7c9e-a0c4-464c-b785-e81f9682f20b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'efb35bcebab64c5fbf74669ca35556b0'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:28.736820 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-9d2f7c9e-a0c4-464c-b785-e81f9682f20b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'efb35bcebab64c5fbf74669ca35556b0'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:28.744843 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-9d2f7c9e-a0c4-464c-b785-e81f9682f20b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'efb35bcebab64c5fbf74669ca35556b0'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:28.745530 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-9d2f7c9e-a0c4-464c-b785-e81f9682f20b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'efb35bcebab64c5fbf74669ca35556b0'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:28.758632 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-9d2f7c9e-a0c4-464c-b785-e81f9682f20b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'efb35bcebab64c5fbf74669ca35556b0'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:28.771368 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1330/2643] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 5 12:24:28 2022] DELETE /identity/v3/users/efb35bcebab64c5fbf74669ca35556b0 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:24:28.947489 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd01220-b577-4017-a2d2-b302143b7751 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:28.948986 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-0dd01220-b577-4017-a2d2-b302143b7751 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:28.961720 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd01220-b577-4017-a2d2-b302143b7751 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:29.009188 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:24:29.024318 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ff8588-45ca-4c86-bb11-8aae167b2329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:29.024985 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ff8588-45ca-4c86-bb11-8aae167b2329 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:29.025260 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ff8588-45ca-4c86-bb11-8aae167b2329 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:29.025531 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ff8588-45ca-4c86-bb11-8aae167b2329 admin admin] PATH_INFO: `/v3/projects/dfd32501b7974ee48a1401efc2c1465c` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:29.026652 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ff8588-45ca-4c86-bb11-8aae167b2329 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfd32501b7974ee48a1401efc2c1465c)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:29.029108 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ff8588-45ca-4c86-bb11-8aae167b2329 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:29.077040 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-90ff8588-45ca-4c86-bb11-8aae167b2329 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfd32501b7974ee48a1401efc2c1465c', 'request_id': 'req-90ff8588-45ca-4c86-bb11-8aae167b2329'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:29.084752 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-90ff8588-45ca-4c86-bb11-8aae167b2329 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfd32501b7974ee48a1401efc2c1465c', 'request_id': 'req-90ff8588-45ca-4c86-bb11-8aae167b2329'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:29.091802 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-90ff8588-45ca-4c86-bb11-8aae167b2329 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfd32501b7974ee48a1401efc2c1465c', 'request_id': 'req-90ff8588-45ca-4c86-bb11-8aae167b2329'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:29.102270 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-90ff8588-45ca-4c86-bb11-8aae167b2329 admin admin] The token cache is being invalidate because project dfd32501b7974ee48a1401efc2c1465c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:24:29.102664 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-90ff8588-45ca-4c86-bb11-8aae167b2329 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:29.103308 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-90ff8588-45ca-4c86-bb11-8aae167b2329 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:29.104827 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1314/2644] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 5 12:24:28 2022] DELETE /identity/v3/projects/dfd32501b7974ee48a1401efc2c1465c => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:24:29.109789 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e5cbe6-64ac-4809-918b-fb7ecb3e084f None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:29.110283 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e5cbe6-64ac-4809-918b-fb7ecb3e084f None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:29.110384 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e5cbe6-64ac-4809-918b-fb7ecb3e084f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:29.129646 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-33e5cbe6-64ac-4809-918b-fb7ecb3e084f None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:24:29.130760 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-33e5cbe6-64ac-4809-918b-fb7ecb3e084f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:29.190330 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1331/2645] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:24:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:24:29.198044 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee90c921-1327-46a2-b274-846047ed6d60 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:29.198326 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee90c921-1327-46a2-b274-846047ed6d60 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:29.198598 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee90c921-1327-46a2-b274-846047ed6d60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:29.219092 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-ee90c921-1327-46a2-b274-846047ed6d60 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:24:29.220295 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-ee90c921-1327-46a2-b274-846047ed6d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:29.228039 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1315/2646] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:24:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:24:29.232402 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e5cbe6-64ac-4809-918b-fb7ecb3e084f None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:29.242292 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e5cbe6-64ac-4809-918b-fb7ecb3e084f None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:29.246913 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e97dbb6-c011-4fb5-be5c-8c90cd9072d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:29.247524 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e97dbb6-c011-4fb5-be5c-8c90cd9072d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:29.247815 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e97dbb6-c011-4fb5-be5c-8c90cd9072d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:29.248078 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e97dbb6-c011-4fb5-be5c-8c90cd9072d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:29.248730 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e97dbb6-c011-4fb5-be5c-8c90cd9072d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:24:29.249071 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e97dbb6-c011-4fb5-be5c-8c90cd9072d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:29.250671 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e97dbb6-c011-4fb5-be5c-8c90cd9072d9 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:29.262259 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1332/2647] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Sep 5 12:24:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:24:29.267492 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee90c921-1327-46a2-b274-846047ed6d60 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:29.276918 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee90c921-1327-46a2-b274-846047ed6d60 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:29.282379 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0803b4a9-4345-4daa-9986-56d949532002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:29.282968 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0803b4a9-4345-4daa-9986-56d949532002 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:29.283244 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0803b4a9-4345-4daa-9986-56d949532002 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:29.283513 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0803b4a9-4345-4daa-9986-56d949532002 admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:29.284136 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0803b4a9-4345-4daa-9986-56d949532002 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:29.286089 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0803b4a9-4345-4daa-9986-56d949532002 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:29.312906 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1316/2648] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 5 12:24:29 2022] POST /identity/v3/projects => generated 365 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:24:29.317383 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e97dbb6-c011-4fb5-be5c-8c90cd9072d9 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:29.327638 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e97dbb6-c011-4fb5-be5c-8c90cd9072d9 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:29.371427 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:24:29.386589 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f820902-80c3-4f01-a9bc-69220bd313d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:29.387125 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f820902-80c3-4f01-a9bc-69220bd313d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:29.387405 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f820902-80c3-4f01-a9bc-69220bd313d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:29.387676 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f820902-80c3-4f01-a9bc-69220bd313d6 admin admin] PATH_INFO: `/v3/users` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:29.388830 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f820902-80c3-4f01-a9bc-69220bd313d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:29.391100 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f820902-80c3-4f01-a9bc-69220bd313d6 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:29.412164 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1333/2649] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 5 12:24:29 2022] POST /identity/v3/users => generated 283 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:24:29.416357 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0803b4a9-4345-4daa-9986-56d949532002 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:29.426571 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0803b4a9-4345-4daa-9986-56d949532002 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:29.431139 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7ddf4a-b979-456d-9550-3e18d2c88251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:29.431731 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7ddf4a-b979-456d-9550-3e18d2c88251 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:29.432010 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7ddf4a-b979-456d-9550-3e18d2c88251 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:29.432282 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7ddf4a-b979-456d-9550-3e18d2c88251 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:29.432953 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7ddf4a-b979-456d-9550-3e18d2c88251 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:29.434548 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7ddf4a-b979-456d-9550-3e18d2c88251 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:29.444581 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1317/2650] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:24:29 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 12:24:29.448621 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f820902-80c3-4f01-a9bc-69220bd313d6 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:29.459007 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f820902-80c3-4f01-a9bc-69220bd313d6 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:29.463788 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2367d9e7-49aa-470d-b61d-cfcf88141636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:29.464386 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2367d9e7-49aa-470d-b61d-cfcf88141636 admin admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:29.464670 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2367d9e7-49aa-470d-b61d-cfcf88141636 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:29.465063 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2367d9e7-49aa-470d-b61d-cfcf88141636 admin admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:29.465666 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2367d9e7-49aa-470d-b61d-cfcf88141636 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:29.467984 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2367d9e7-49aa-470d-b61d-cfcf88141636 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:29.478655 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1334/2651] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:24:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:24:29.482913 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7ddf4a-b979-456d-9550-3e18d2c88251 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:29.493256 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7ddf4a-b979-456d-9550-3e18d2c88251 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:29.498306 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7592bcc5-aeb0-4709-ac89-45ee118932b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:29.498942 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7592bcc5-aeb0-4709-ac89-45ee118932b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:29.499235 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7592bcc5-aeb0-4709-ac89-45ee118932b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:29.499489 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7592bcc5-aeb0-4709-ac89-45ee118932b7 admin admin] PATH_INFO: `/v3/projects/7a427fa7c6ea44098804f206bf924ee8/users/478d5400bc6d44f995137d882c8b03f8/roles/ed72181e1403401facb77dcf33644757` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:29.514486 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7592bcc5-aeb0-4709-ac89-45ee118932b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a427fa7c6ea44098804f206bf924ee8, user_id=478d5400bc6d44f995137d882c8b03f8, role_id=ed72181e1403401facb77dcf33644757)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:29.517513 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7592bcc5-aeb0-4709-ac89-45ee118932b7 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:29.530928 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1318/2652] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 5 12:24:29 2022] PUT /identity/v3/projects/7a427fa7c6ea44098804f206bf924ee8/users/478d5400bc6d44f995137d882c8b03f8/roles/ed72181e1403401facb77dcf33644757 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:24:29.541212 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75be9fd0-accd-4cdd-91ed-73cdb1e3775a None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:29.541497 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75be9fd0-accd-4cdd-91ed-73cdb1e3775a None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:29.541797 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75be9fd0-accd-4cdd-91ed-73cdb1e3775a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:29.570994 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-75be9fd0-accd-4cdd-91ed-73cdb1e3775a None None] MFA Rules not processed for user `478d5400bc6d44f995137d882c8b03f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:24:29.572229 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-75be9fd0-accd-4cdd-91ed-73cdb1e3775a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:29.637038 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1335/2653] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:24:29 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:24:29.642527 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7592bcc5-aeb0-4709-ac89-45ee118932b7 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:29.715421 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7592bcc5-aeb0-4709-ac89-45ee118932b7 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:29.720839 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7e93c5-63ba-4b1c-8eb5-5a136743ae7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:29.721484 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7e93c5-63ba-4b1c-8eb5-5a136743ae7a admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:29.721767 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7e93c5-63ba-4b1c-8eb5-5a136743ae7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:29.722045 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7e93c5-63ba-4b1c-8eb5-5a136743ae7a admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:29.722844 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7e93c5-63ba-4b1c-8eb5-5a136743ae7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:29.724785 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7e93c5-63ba-4b1c-8eb5-5a136743ae7a admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:29.748171 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:24:29.757811 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1319/2654] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 5 12:24:29 2022] POST /identity/v3/projects => generated 367 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:24:29.761720 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75be9fd0-accd-4cdd-91ed-73cdb1e3775a None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:29.773398 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75be9fd0-accd-4cdd-91ed-73cdb1e3775a None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:29.831548 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10d8898-aaae-4d3a-8f5e-af160da64f52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:29.832162 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10d8898-aaae-4d3a-8f5e-af160da64f52 admin admin] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:29.832452 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10d8898-aaae-4d3a-8f5e-af160da64f52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:29.832729 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10d8898-aaae-4d3a-8f5e-af160da64f52 admin admin] PATH_INFO: `/v3/users` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:29.833427 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10d8898-aaae-4d3a-8f5e-af160da64f52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:29.835385 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10d8898-aaae-4d3a-8f5e-af160da64f52 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:29.858274 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1336/2655] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 5 12:24:29 2022] POST /identity/v3/users => generated 290 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:24:29.862754 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7e93c5-63ba-4b1c-8eb5-5a136743ae7a admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:29.875094 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7e93c5-63ba-4b1c-8eb5-5a136743ae7a admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:29.880383 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7ec78b-b99d-4cbb-bff9-14fd43858ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:29.881064 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7ec78b-b99d-4cbb-bff9-14fd43858ff7 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:29.881351 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7ec78b-b99d-4cbb-bff9-14fd43858ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:29.881622 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7ec78b-b99d-4cbb-bff9-14fd43858ff7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:29.882274 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7ec78b-b99d-4cbb-bff9-14fd43858ff7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:29.883922 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7ec78b-b99d-4cbb-bff9-14fd43858ff7 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:29.896883 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1320/2656] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:24:29 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:24:29.901553 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10d8898-aaae-4d3a-8f5e-af160da64f52 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:29.911656 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10d8898-aaae-4d3a-8f5e-af160da64f52 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:29.916421 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5661f321-cfa4-457f-8151-c470cba2e863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:29.917221 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5661f321-cfa4-457f-8151-c470cba2e863 admin admin] REQUEST_METHOD: `PUT` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:29.917527 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5661f321-cfa4-457f-8151-c470cba2e863 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:29.917800 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5661f321-cfa4-457f-8151-c470cba2e863 admin admin] PATH_INFO: `/v3/projects/7dda8a6a89ed4b84af1504afe7ce2957/users/47f5cf948ca34394b7feb6d5fbce4fcb/roles/16e2ccc8bd1b497d8cee780c1c7df0d2` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:29.933802 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5661f321-cfa4-457f-8151-c470cba2e863 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7dda8a6a89ed4b84af1504afe7ce2957, user_id=47f5cf948ca34394b7feb6d5fbce4fcb, role_id=16e2ccc8bd1b497d8cee780c1c7df0d2)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:29.937074 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5661f321-cfa4-457f-8151-c470cba2e863 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:29.950201 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1337/2657] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 5 12:24:29 2022] PUT /identity/v3/projects/7dda8a6a89ed4b84af1504afe7ce2957/users/47f5cf948ca34394b7feb6d5fbce4fcb/roles/16e2ccc8bd1b497d8cee780c1c7df0d2 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:24:29.954249 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7ec78b-b99d-4cbb-bff9-14fd43858ff7 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:29.964225 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7ec78b-b99d-4cbb-bff9-14fd43858ff7 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:30.022338 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643f5026-a72e-412c-9120-d767ac9d92b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:30.022950 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643f5026-a72e-412c-9120-d767ac9d92b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:30.023230 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643f5026-a72e-412c-9120-d767ac9d92b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:30.023503 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643f5026-a72e-412c-9120-d767ac9d92b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:30.024144 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643f5026-a72e-412c-9120-d767ac9d92b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:30.025777 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643f5026-a72e-412c-9120-d767ac9d92b2 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:30.036234 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1321/2658] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:24:29 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:24:30.040335 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5661f321-cfa4-457f-8151-c470cba2e863 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:30.051234 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5661f321-cfa4-457f-8151-c470cba2e863 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:30.055949 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c3fd1c-d80d-4799-865e-5c04aa7860d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:30.056609 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c3fd1c-d80d-4799-865e-5c04aa7860d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:30.056912 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c3fd1c-d80d-4799-865e-5c04aa7860d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:30.057198 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c3fd1c-d80d-4799-865e-5c04aa7860d8 admin admin] PATH_INFO: `/v3/projects/7dda8a6a89ed4b84af1504afe7ce2957/users/47f5cf948ca34394b7feb6d5fbce4fcb/roles/16e2ccc8bd1b497d8cee780c1c7df0d2` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:30.059120 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c3fd1c-d80d-4799-865e-5c04aa7860d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7dda8a6a89ed4b84af1504afe7ce2957, user_id=47f5cf948ca34394b7feb6d5fbce4fcb, role_id=16e2ccc8bd1b497d8cee780c1c7df0d2)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:30.062372 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c3fd1c-d80d-4799-865e-5c04aa7860d8 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:30.073048 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1338/2659] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 5 12:24:30 2022] PUT /identity/v3/projects/7dda8a6a89ed4b84af1504afe7ce2957/users/47f5cf948ca34394b7feb6d5fbce4fcb/roles/16e2ccc8bd1b497d8cee780c1c7df0d2 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:24:30.084418 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6687743-f1d7-4b17-8d7f-d112fc1e3fb0 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:30.084705 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6687743-f1d7-4b17-8d7f-d112fc1e3fb0 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:30.085017 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6687743-f1d7-4b17-8d7f-d112fc1e3fb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:30.115484 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-a6687743-f1d7-4b17-8d7f-d112fc1e3fb0 None None] MFA Rules not processed for user `47f5cf948ca34394b7feb6d5fbce4fcb`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:24:30.116733 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-a6687743-f1d7-4b17-8d7f-d112fc1e3fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:30.205494 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1322/2660] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:24:30 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:24:30.217277 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c3fd1c-d80d-4799-865e-5c04aa7860d8 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:30.219080 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-82c3fd1c-d80d-4799-865e-5c04aa7860d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:30.229196 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:24:30.281936 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c3fd1c-d80d-4799-865e-5c04aa7860d8 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:30.285759 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7ac784-639b-45e1-b2ae-c7884ca3c9d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37633bbae0c2423c81ccd61ac3a17ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:30.286377 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7ac784-639b-45e1-b2ae-c7884ca3c9d8 service cinder] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:30.286652 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7ac784-639b-45e1-b2ae-c7884ca3c9d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:30.286940 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7ac784-639b-45e1-b2ae-c7884ca3c9d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:30.297017 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7ac784-639b-45e1-b2ae-c7884ca3c9d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:30.298451 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7ac784-639b-45e1-b2ae-c7884ca3c9d8 service cinder] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:30.308316 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1339/2661] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:24:30 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:24:30.394805 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6687743-f1d7-4b17-8d7f-d112fc1e3fb0 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:30.405105 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6687743-f1d7-4b17-8d7f-d112fc1e3fb0 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:30.408668 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7843f9-272c-436a-8ebf-870d3632fdf6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37633bbae0c2423c81ccd61ac3a17ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:30.409304 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7843f9-272c-436a-8ebf-870d3632fdf6 service cinder] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:30.409584 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7843f9-272c-436a-8ebf-870d3632fdf6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:30.409852 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7843f9-272c-436a-8ebf-870d3632fdf6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:30.468167 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7843f9-272c-436a-8ebf-870d3632fdf6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:30.469545 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7843f9-272c-436a-8ebf-870d3632fdf6 service cinder] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:30.478725 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1323/2662] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:24:30 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:24:35.337321 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7ac784-639b-45e1-b2ae-c7884ca3c9d8 service cinder] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:35.401266 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7ac784-639b-45e1-b2ae-c7884ca3c9d8 service cinder] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:35.406456 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd03d4c-3bbe-4a00-90fc-308df5ad3f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:35.407092 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd03d4c-3bbe-4a00-90fc-308df5ad3f18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:35.407380 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd03d4c-3bbe-4a00-90fc-308df5ad3f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:35.407653 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd03d4c-3bbe-4a00-90fc-308df5ad3f18 admin admin] PATH_INFO: `/v3/users/478d5400bc6d44f995137d882c8b03f8` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:35.408790 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd03d4c-3bbe-4a00-90fc-308df5ad3f18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=478d5400bc6d44f995137d882c8b03f8)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:35.410736 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd03d4c-3bbe-4a00-90fc-308df5ad3f18 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:35.461975 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-5dd03d4c-3bbe-4a00-90fc-308df5ad3f18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '478d5400bc6d44f995137d882c8b03f8'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:35.462639 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-5dd03d4c-3bbe-4a00-90fc-308df5ad3f18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '478d5400bc6d44f995137d882c8b03f8'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:35.471518 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-5dd03d4c-3bbe-4a00-90fc-308df5ad3f18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '478d5400bc6d44f995137d882c8b03f8'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:35.472170 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-5dd03d4c-3bbe-4a00-90fc-308df5ad3f18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '478d5400bc6d44f995137d882c8b03f8'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:35.487050 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-5dd03d4c-3bbe-4a00-90fc-308df5ad3f18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '478d5400bc6d44f995137d882c8b03f8'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:35.500472 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1340/2663] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 5 12:24:35 2022] DELETE /identity/v3/users/478d5400bc6d44f995137d882c8b03f8 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:24:35.505128 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce7529f-af40-4a90-b6c6-8ef807a867ab None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:35.505668 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce7529f-af40-4a90-b6c6-8ef807a867ab None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:35.505668 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce7529f-af40-4a90-b6c6-8ef807a867ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:35.520012 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=100 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:24:35.528111 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-cce7529f-af40-4a90-b6c6-8ef807a867ab None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:24:35.529993 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-cce7529f-af40-4a90-b6c6-8ef807a867ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:35.593550 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1324/2664] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:24:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:24:35.603647 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd03d4c-3bbe-4a00-90fc-308df5ad3f18 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:35.605288 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-5dd03d4c-3bbe-4a00-90fc-308df5ad3f18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:35.639737 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:24:35.670067 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd03d4c-3bbe-4a00-90fc-308df5ad3f18 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:35.673792 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f6dda8-01f2-4fd7-8698-90cddf8b09e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4994b4faa4ec4aa088f3dc32c9c5614d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:35.674405 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f6dda8-01f2-4fd7-8698-90cddf8b09e7 service neutron] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:35.674686 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f6dda8-01f2-4fd7-8698-90cddf8b09e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:35.674960 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f6dda8-01f2-4fd7-8698-90cddf8b09e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:35.684584 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f6dda8-01f2-4fd7-8698-90cddf8b09e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:35.686614 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f6dda8-01f2-4fd7-8698-90cddf8b09e7 service neutron] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:35.696771 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1341/2665] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:24:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:24:35.997811 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce7529f-af40-4a90-b6c6-8ef807a867ab None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:36.000469 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-cce7529f-af40-4a90-b6c6-8ef807a867ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:36.018829 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce7529f-af40-4a90-b6c6-8ef807a867ab None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:36.023977 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98cc897-c08e-4004-8821-69fa7be676cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:36.024829 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98cc897-c08e-4004-8821-69fa7be676cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:36.025257 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98cc897-c08e-4004-8821-69fa7be676cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:36.025597 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98cc897-c08e-4004-8821-69fa7be676cf admin admin] PATH_INFO: `/v3/projects/7a427fa7c6ea44098804f206bf924ee8` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:36.026978 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98cc897-c08e-4004-8821-69fa7be676cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a427fa7c6ea44098804f206bf924ee8)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:36.029242 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98cc897-c08e-4004-8821-69fa7be676cf admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:36.102180 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-b98cc897-c08e-4004-8821-69fa7be676cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a427fa7c6ea44098804f206bf924ee8', 'request_id': 'req-b98cc897-c08e-4004-8821-69fa7be676cf'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:36.110902 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-b98cc897-c08e-4004-8821-69fa7be676cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a427fa7c6ea44098804f206bf924ee8', 'request_id': 'req-b98cc897-c08e-4004-8821-69fa7be676cf'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:36.117345 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-b98cc897-c08e-4004-8821-69fa7be676cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a427fa7c6ea44098804f206bf924ee8', 'request_id': 'req-b98cc897-c08e-4004-8821-69fa7be676cf'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:36.128670 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-b98cc897-c08e-4004-8821-69fa7be676cf admin admin] The token cache is being invalidate because project 7a427fa7c6ea44098804f206bf924ee8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:24:36.129000 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-b98cc897-c08e-4004-8821-69fa7be676cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:36.129848 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-b98cc897-c08e-4004-8821-69fa7be676cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:36.131395 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1325/2666] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 5 12:24:35 2022] DELETE /identity/v3/projects/7a427fa7c6ea44098804f206bf924ee8 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:24:36.135788 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f6dda8-01f2-4fd7-8698-90cddf8b09e7 service neutron] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:36.146645 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f6dda8-01f2-4fd7-8698-90cddf8b09e7 service neutron] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:36.214870 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330f3d07-9b4e-45e3-a3d3-60422c858d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:36.215590 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330f3d07-9b4e-45e3-a3d3-60422c858d02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:36.215848 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330f3d07-9b4e-45e3-a3d3-60422c858d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:36.216621 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330f3d07-9b4e-45e3-a3d3-60422c858d02 admin admin] PATH_INFO: `/v3/users/47f5cf948ca34394b7feb6d5fbce4fcb` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:36.217826 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330f3d07-9b4e-45e3-a3d3-60422c858d02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47f5cf948ca34394b7feb6d5fbce4fcb)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:36.221926 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330f3d07-9b4e-45e3-a3d3-60422c858d02 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:36.292599 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-330f3d07-9b4e-45e3-a3d3-60422c858d02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47f5cf948ca34394b7feb6d5fbce4fcb'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:36.293926 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-330f3d07-9b4e-45e3-a3d3-60422c858d02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47f5cf948ca34394b7feb6d5fbce4fcb'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:36.310699 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-330f3d07-9b4e-45e3-a3d3-60422c858d02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47f5cf948ca34394b7feb6d5fbce4fcb'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:36.311478 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-330f3d07-9b4e-45e3-a3d3-60422c858d02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47f5cf948ca34394b7feb6d5fbce4fcb'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:36.325491 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-330f3d07-9b4e-45e3-a3d3-60422c858d02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47f5cf948ca34394b7feb6d5fbce4fcb'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:36.338584 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1342/2667] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 5 12:24:36 2022] DELETE /identity/v3/users/47f5cf948ca34394b7feb6d5fbce4fcb => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:24:36.371370 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98cc897-c08e-4004-8821-69fa7be676cf admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:36.372814 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-b98cc897-c08e-4004-8821-69fa7be676cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:36.439273 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98cc897-c08e-4004-8821-69fa7be676cf admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:36.486018 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:24:36.495305 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83676c04-9e7b-407c-8510-f888a5e824c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37633bbae0c2423c81ccd61ac3a17ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:36.497872 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83676c04-9e7b-407c-8510-f888a5e824c0 service cinder] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:36.497972 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83676c04-9e7b-407c-8510-f888a5e824c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:36.498353 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83676c04-9e7b-407c-8510-f888a5e824c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:36.500429 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-83676c04-9e7b-407c-8510-f888a5e824c0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:36.566717 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83676c04-9e7b-407c-8510-f888a5e824c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:36.568355 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83676c04-9e7b-407c-8510-f888a5e824c0 service cinder] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:36.579149 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1326/2668] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:24:36 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:24:36.622350 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330f3d07-9b4e-45e3-a3d3-60422c858d02 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:36.623866 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-330f3d07-9b4e-45e3-a3d3-60422c858d02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:36.690169 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:24:36.704400 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330f3d07-9b4e-45e3-a3d3-60422c858d02 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:36.709492 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a7af4f-17bb-4908-b89b-39282b0d341b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:36.710200 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a7af4f-17bb-4908-b89b-39282b0d341b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:36.710478 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a7af4f-17bb-4908-b89b-39282b0d341b admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:36.710753 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a7af4f-17bb-4908-b89b-39282b0d341b admin admin] PATH_INFO: `/v3/projects/7dda8a6a89ed4b84af1504afe7ce2957` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:36.711871 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a7af4f-17bb-4908-b89b-39282b0d341b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7dda8a6a89ed4b84af1504afe7ce2957)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:36.713777 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a7af4f-17bb-4908-b89b-39282b0d341b admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:36.764782 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-75a7af4f-17bb-4908-b89b-39282b0d341b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7dda8a6a89ed4b84af1504afe7ce2957', 'request_id': 'req-75a7af4f-17bb-4908-b89b-39282b0d341b'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:36.774400 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-75a7af4f-17bb-4908-b89b-39282b0d341b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7dda8a6a89ed4b84af1504afe7ce2957', 'request_id': 'req-75a7af4f-17bb-4908-b89b-39282b0d341b'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:36.784981 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-75a7af4f-17bb-4908-b89b-39282b0d341b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7dda8a6a89ed4b84af1504afe7ce2957', 'request_id': 'req-75a7af4f-17bb-4908-b89b-39282b0d341b'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:36.796038 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-75a7af4f-17bb-4908-b89b-39282b0d341b admin admin] The token cache is being invalidate because project 7dda8a6a89ed4b84af1504afe7ce2957 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:24:36.796331 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-75a7af4f-17bb-4908-b89b-39282b0d341b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:36.797055 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-75a7af4f-17bb-4908-b89b-39282b0d341b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:36.798540 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1343/2669] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 5 12:24:36 2022] DELETE /identity/v3/projects/7dda8a6a89ed4b84af1504afe7ce2957 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:24:36.803359 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b436f86d-ed93-4d6c-a6d3-9ba6e8849c11 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:36.803643 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b436f86d-ed93-4d6c-a6d3-9ba6e8849c11 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:36.803924 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b436f86d-ed93-4d6c-a6d3-9ba6e8849c11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:36.824526 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-b436f86d-ed93-4d6c-a6d3-9ba6e8849c11 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:24:36.826612 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-b436f86d-ed93-4d6c-a6d3-9ba6e8849c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:36.890870 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1327/2670] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:24:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:24:36.898649 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9b5369-e6cd-4d93-9a7d-4ef5f7228839 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:36.898929 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9b5369-e6cd-4d93-9a7d-4ef5f7228839 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:36.899192 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9b5369-e6cd-4d93-9a7d-4ef5f7228839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:36.919339 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-5a9b5369-e6cd-4d93-9a7d-4ef5f7228839 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:24:36.920542 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-5a9b5369-e6cd-4d93-9a7d-4ef5f7228839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:36.928768 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1344/2671] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:24:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:24:36.934683 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b436f86d-ed93-4d6c-a6d3-9ba6e8849c11 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:36.944304 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b436f86d-ed93-4d6c-a6d3-9ba6e8849c11 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:36.949289 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a059fe-9b17-4089-a441-cbf760a6a902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:36.949893 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a059fe-9b17-4089-a441-cbf760a6a902 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:36.950174 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a059fe-9b17-4089-a441-cbf760a6a902 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:36.951011 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a059fe-9b17-4089-a441-cbf760a6a902 admin admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:36.951656 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a059fe-9b17-4089-a441-cbf760a6a902 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:24:36.951983 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a059fe-9b17-4089-a441-cbf760a6a902 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:36.953609 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a059fe-9b17-4089-a441-cbf760a6a902 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:36.966919 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1328/2672] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Sep 5 12:24:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:24:36.971470 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9b5369-e6cd-4d93-9a7d-4ef5f7228839 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:36.980729 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9b5369-e6cd-4d93-9a7d-4ef5f7228839 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:36.985490 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1716a7d6-4e6e-4e07-a459-e9f78d82b2dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:36.986094 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1716a7d6-4e6e-4e07-a459-e9f78d82b2dd admin admin] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:36.986374 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1716a7d6-4e6e-4e07-a459-e9f78d82b2dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:36.986648 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1716a7d6-4e6e-4e07-a459-e9f78d82b2dd admin admin] PATH_INFO: `/v3/projects` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:36.987300 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1716a7d6-4e6e-4e07-a459-e9f78d82b2dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:36.989330 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1716a7d6-4e6e-4e07-a459-e9f78d82b2dd admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:37.019605 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1345/2673] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 5 12:24:36 2022] POST /identity/v3/projects => generated 381 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:24:37.023732 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a059fe-9b17-4089-a441-cbf760a6a902 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:37.033513 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a059fe-9b17-4089-a441-cbf760a6a902 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:37.093217 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2183d4fe-7c1f-494d-abe0-a741d2d41699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:37.093832 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2183d4fe-7c1f-494d-abe0-a741d2d41699 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:37.094132 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2183d4fe-7c1f-494d-abe0-a741d2d41699 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:37.094387 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2183d4fe-7c1f-494d-abe0-a741d2d41699 admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:37.095032 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2183d4fe-7c1f-494d-abe0-a741d2d41699 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:37.096992 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2183d4fe-7c1f-494d-abe0-a741d2d41699 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:37.118976 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1329/2674] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 5 12:24:37 2022] POST /identity/v3/users => generated 291 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:24:37.123337 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1716a7d6-4e6e-4e07-a459-e9f78d82b2dd admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:37.134061 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1716a7d6-4e6e-4e07-a459-e9f78d82b2dd admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:37.138966 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137ba946-c8e4-4ccf-bd34-ae990a175848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:37.139563 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137ba946-c8e4-4ccf-bd34-ae990a175848 admin admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:37.139838 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137ba946-c8e4-4ccf-bd34-ae990a175848 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:37.140359 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137ba946-c8e4-4ccf-bd34-ae990a175848 admin admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:37.141048 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137ba946-c8e4-4ccf-bd34-ae990a175848 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:37.142621 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137ba946-c8e4-4ccf-bd34-ae990a175848 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:37.152776 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1346/2675] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:24:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:24:37.156930 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2183d4fe-7c1f-494d-abe0-a741d2d41699 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:37.168388 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2183d4fe-7c1f-494d-abe0-a741d2d41699 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:37.173435 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ded1f25-ad33-42a7-a00a-6f7de0565940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:37.174040 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ded1f25-ad33-42a7-a00a-6f7de0565940 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:37.174321 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ded1f25-ad33-42a7-a00a-6f7de0565940 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:37.174591 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ded1f25-ad33-42a7-a00a-6f7de0565940 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:37.175235 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ded1f25-ad33-42a7-a00a-6f7de0565940 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:37.177006 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ded1f25-ad33-42a7-a00a-6f7de0565940 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:37.189601 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1330/2676] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:24:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 12:24:37.195544 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137ba946-c8e4-4ccf-bd34-ae990a175848 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:37.207371 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137ba946-c8e4-4ccf-bd34-ae990a175848 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:37.211965 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12169a3f-e06e-4036-88a0-3e2bba94ac41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:37.212615 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12169a3f-e06e-4036-88a0-3e2bba94ac41 admin admin] REQUEST_METHOD: `PUT` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:37.212917 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12169a3f-e06e-4036-88a0-3e2bba94ac41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:37.213410 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12169a3f-e06e-4036-88a0-3e2bba94ac41 admin admin] PATH_INFO: `/v3/projects/eaf6d0032ec34b1f90af7ef3e06158cb/users/fb3f6788fd2f4c1594e2db14662fc82e/roles/ed72181e1403401facb77dcf33644757` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:37.228520 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12169a3f-e06e-4036-88a0-3e2bba94ac41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eaf6d0032ec34b1f90af7ef3e06158cb, user_id=fb3f6788fd2f4c1594e2db14662fc82e, role_id=ed72181e1403401facb77dcf33644757)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:37.231201 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12169a3f-e06e-4036-88a0-3e2bba94ac41 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:37.250985 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1347/2677] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 5 12:24:37 2022] PUT /identity/v3/projects/eaf6d0032ec34b1f90af7ef3e06158cb/users/fb3f6788fd2f4c1594e2db14662fc82e/roles/ed72181e1403401facb77dcf33644757 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 12:24:37.263682 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59478dac-d785-4ca0-a2b9-6e51ad142aa9 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:37.263992 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59478dac-d785-4ca0-a2b9-6e51ad142aa9 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:37.264245 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59478dac-d785-4ca0-a2b9-6e51ad142aa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:37.273541 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:24:37.300737 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-59478dac-d785-4ca0-a2b9-6e51ad142aa9 None None] MFA Rules not processed for user `fb3f6788fd2f4c1594e2db14662fc82e`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:24:37.302067 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-59478dac-d785-4ca0-a2b9-6e51ad142aa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:37.386737 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1331/2678] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:24:37 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:24:37.392343 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12169a3f-e06e-4036-88a0-3e2bba94ac41 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:37.460921 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12169a3f-e06e-4036-88a0-3e2bba94ac41 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:37.465643 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b29e865-e04c-46d9-87ed-4a43787dfd42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:37.466256 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b29e865-e04c-46d9-87ed-4a43787dfd42 admin admin] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:37.466536 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b29e865-e04c-46d9-87ed-4a43787dfd42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:37.466812 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b29e865-e04c-46d9-87ed-4a43787dfd42 admin admin] PATH_INFO: `/v3/projects` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:37.467462 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b29e865-e04c-46d9-87ed-4a43787dfd42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:37.469404 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b29e865-e04c-46d9-87ed-4a43787dfd42 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:37.498421 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1348/2679] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 5 12:24:37 2022] POST /identity/v3/projects => generated 383 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:24:37.502624 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59478dac-d785-4ca0-a2b9-6e51ad142aa9 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:37.513763 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59478dac-d785-4ca0-a2b9-6e51ad142aa9 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:37.571476 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739e3e6d-38a0-453a-8ce7-dbe9d16a7e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:37.572122 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739e3e6d-38a0-453a-8ce7-dbe9d16a7e73 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:37.572361 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739e3e6d-38a0-453a-8ce7-dbe9d16a7e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:37.572639 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739e3e6d-38a0-453a-8ce7-dbe9d16a7e73 admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:37.573350 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739e3e6d-38a0-453a-8ce7-dbe9d16a7e73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:37.575313 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739e3e6d-38a0-453a-8ce7-dbe9d16a7e73 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:37.596641 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1332/2680] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 5 12:24:37 2022] POST /identity/v3/users => generated 298 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:24:37.600712 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b29e865-e04c-46d9-87ed-4a43787dfd42 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:37.606213 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:24:37.612948 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b29e865-e04c-46d9-87ed-4a43787dfd42 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:37.618769 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c5203e-0af1-4945-b112-2f4bb92a8b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:37.619372 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c5203e-0af1-4945-b112-2f4bb92a8b33 admin admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:37.619656 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c5203e-0af1-4945-b112-2f4bb92a8b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:37.619934 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c5203e-0af1-4945-b112-2f4bb92a8b33 admin admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:37.620583 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c5203e-0af1-4945-b112-2f4bb92a8b33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:37.622834 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c5203e-0af1-4945-b112-2f4bb92a8b33 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:37.633443 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1349/2681] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:24:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:24:37.637546 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739e3e6d-38a0-453a-8ce7-dbe9d16a7e73 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:37.647964 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739e3e6d-38a0-453a-8ce7-dbe9d16a7e73 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:37.652573 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d9914d-df72-48f0-b1d5-193df1b1665a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:37.653251 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d9914d-df72-48f0-b1d5-193df1b1665a admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:37.653560 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d9914d-df72-48f0-b1d5-193df1b1665a admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:37.653835 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d9914d-df72-48f0-b1d5-193df1b1665a admin admin] PATH_INFO: `/v3/projects/13aa308e114a419b8f423620e4e82f50/users/fc42de713a8442a8ae4c2d94b359505d/roles/16e2ccc8bd1b497d8cee780c1c7df0d2` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:37.668372 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d9914d-df72-48f0-b1d5-193df1b1665a admin admin] RBAC: Authorizing `identity:create_grant(project_id=13aa308e114a419b8f423620e4e82f50, user_id=fc42de713a8442a8ae4c2d94b359505d, role_id=16e2ccc8bd1b497d8cee780c1c7df0d2)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:37.671602 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d9914d-df72-48f0-b1d5-193df1b1665a admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:37.684482 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1333/2682] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 5 12:24:37 2022] PUT /identity/v3/projects/13aa308e114a419b8f423620e4e82f50/users/fc42de713a8442a8ae4c2d94b359505d/roles/16e2ccc8bd1b497d8cee780c1c7df0d2 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:24:37.689299 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c5203e-0af1-4945-b112-2f4bb92a8b33 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:37.699202 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c5203e-0af1-4945-b112-2f4bb92a8b33 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:37.753781 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d26c44e-4e07-41ac-b27c-bfe89f26759e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:37.754380 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d26c44e-4e07-41ac-b27c-bfe89f26759e admin admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:37.754655 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d26c44e-4e07-41ac-b27c-bfe89f26759e admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:37.754948 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d26c44e-4e07-41ac-b27c-bfe89f26759e admin admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:37.755586 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d26c44e-4e07-41ac-b27c-bfe89f26759e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:37.757214 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d26c44e-4e07-41ac-b27c-bfe89f26759e admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:37.767742 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1350/2683] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:24:37 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:24:37.771918 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d9914d-df72-48f0-b1d5-193df1b1665a admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:37.783174 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d9914d-df72-48f0-b1d5-193df1b1665a admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:37.788098 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b805205-7b30-4907-8345-218b8a49fcbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:37.788754 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b805205-7b30-4907-8345-218b8a49fcbb admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:37.789056 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b805205-7b30-4907-8345-218b8a49fcbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:37.789382 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b805205-7b30-4907-8345-218b8a49fcbb admin admin] PATH_INFO: `/v3/projects/13aa308e114a419b8f423620e4e82f50/users/fc42de713a8442a8ae4c2d94b359505d/roles/16e2ccc8bd1b497d8cee780c1c7df0d2` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:37.791214 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b805205-7b30-4907-8345-218b8a49fcbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=13aa308e114a419b8f423620e4e82f50, user_id=fc42de713a8442a8ae4c2d94b359505d, role_id=16e2ccc8bd1b497d8cee780c1c7df0d2)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:37.793857 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b805205-7b30-4907-8345-218b8a49fcbb admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:37.804629 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1334/2684] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 5 12:24:37 2022] PUT /identity/v3/projects/13aa308e114a419b8f423620e4e82f50/users/fc42de713a8442a8ae4c2d94b359505d/roles/16e2ccc8bd1b497d8cee780c1c7df0d2 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:24:37.815833 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bd0e6b-1b8e-46e0-bc15-dac4742f4c5a None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:37.816142 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bd0e6b-1b8e-46e0-bc15-dac4742f4c5a None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:37.816422 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bd0e6b-1b8e-46e0-bc15-dac4742f4c5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:37.844221 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-70bd0e6b-1b8e-46e0-bc15-dac4742f4c5a None None] MFA Rules not processed for user `fc42de713a8442a8ae4c2d94b359505d`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:24:37.845501 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-70bd0e6b-1b8e-46e0-bc15-dac4742f4c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:37.912238 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1351/2685] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:24:37 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:24:37.923624 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b805205-7b30-4907-8345-218b8a49fcbb admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:37.925353 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-5b805205-7b30-4907-8345-218b8a49fcbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:37.973018 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:24:37.985314 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b805205-7b30-4907-8345-218b8a49fcbb admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:37.988919 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8f9cd9-ccb9-4377-b47c-9fc8cf782c3e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37633bbae0c2423c81ccd61ac3a17ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:37.989526 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8f9cd9-ccb9-4377-b47c-9fc8cf782c3e service cinder] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:37.989807 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8f9cd9-ccb9-4377-b47c-9fc8cf782c3e service cinder] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:37.990079 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8f9cd9-ccb9-4377-b47c-9fc8cf782c3e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:38.047096 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8f9cd9-ccb9-4377-b47c-9fc8cf782c3e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:38.048596 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8f9cd9-ccb9-4377-b47c-9fc8cf782c3e service cinder] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:38.057524 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1335/2686] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:24:37 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 12:24:42.388709 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bd0e6b-1b8e-46e0-bc15-dac4742f4c5a None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:42.390546 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-70bd0e6b-1b8e-46e0-bc15-dac4742f4c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:42.403221 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bd0e6b-1b8e-46e0-bc15-dac4742f4c5a None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:42.406863 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aab166-7c12-4fd0-be28-a7d129ebb397 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37633bbae0c2423c81ccd61ac3a17ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:42.407576 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aab166-7c12-4fd0-be28-a7d129ebb397 service cinder] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:42.407861 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aab166-7c12-4fd0-be28-a7d129ebb397 service cinder] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:42.408197 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aab166-7c12-4fd0-be28-a7d129ebb397 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:42.420348 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aab166-7c12-4fd0-be28-a7d129ebb397 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:42.422406 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aab166-7c12-4fd0-be28-a7d129ebb397 service cinder] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:42.435731 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1352/2687] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:24:42 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:24:47.406118 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8f9cd9-ccb9-4377-b47c-9fc8cf782c3e service cinder] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:47.476660 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8f9cd9-ccb9-4377-b47c-9fc8cf782c3e service cinder] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:47.481444 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15406304-fc1b-42cf-97a2-13cf38f56245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:47.482161 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15406304-fc1b-42cf-97a2-13cf38f56245 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:47.482503 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15406304-fc1b-42cf-97a2-13cf38f56245 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:47.482848 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15406304-fc1b-42cf-97a2-13cf38f56245 admin admin] PATH_INFO: `/v3/users/fb3f6788fd2f4c1594e2db14662fc82e` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:47.484134 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15406304-fc1b-42cf-97a2-13cf38f56245 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb3f6788fd2f4c1594e2db14662fc82e)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:47.486146 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15406304-fc1b-42cf-97a2-13cf38f56245 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:47.535010 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-15406304-fc1b-42cf-97a2-13cf38f56245 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb3f6788fd2f4c1594e2db14662fc82e'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:47.535707 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-15406304-fc1b-42cf-97a2-13cf38f56245 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb3f6788fd2f4c1594e2db14662fc82e'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:47.544591 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-15406304-fc1b-42cf-97a2-13cf38f56245 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb3f6788fd2f4c1594e2db14662fc82e'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:47.545276 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-15406304-fc1b-42cf-97a2-13cf38f56245 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb3f6788fd2f4c1594e2db14662fc82e'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:47.559847 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-15406304-fc1b-42cf-97a2-13cf38f56245 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb3f6788fd2f4c1594e2db14662fc82e'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:47.574687 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1336/2688] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 5 12:24:47 2022] DELETE /identity/v3/users/fb3f6788fd2f4c1594e2db14662fc82e => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:24:47.580054 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48db9ac6-11ae-4d11-8d49-b67217ce0dff None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:47.580551 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48db9ac6-11ae-4d11-8d49-b67217ce0dff None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:47.580651 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48db9ac6-11ae-4d11-8d49-b67217ce0dff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:47.611946 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-48db9ac6-11ae-4d11-8d49-b67217ce0dff None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:24:47.613438 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-48db9ac6-11ae-4d11-8d49-b67217ce0dff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:47.670565 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:24:47.679548 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1353/2689] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:24:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 12:24:47.691009 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15406304-fc1b-42cf-97a2-13cf38f56245 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:47.692518 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-15406304-fc1b-42cf-97a2-13cf38f56245 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:47.715186 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:24:47.759789 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15406304-fc1b-42cf-97a2-13cf38f56245 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:47.765765 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3cfc55-79c5-4513-9965-afb21b03097d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4994b4faa4ec4aa088f3dc32c9c5614d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:47.765765 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3cfc55-79c5-4513-9965-afb21b03097d service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:47.766193 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3cfc55-79c5-4513-9965-afb21b03097d service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:47.766491 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3cfc55-79c5-4513-9965-afb21b03097d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:47.777538 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3cfc55-79c5-4513-9965-afb21b03097d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:47.779334 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3cfc55-79c5-4513-9965-afb21b03097d service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:47.796396 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1337/2690] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:24:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:24:48.090985 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48db9ac6-11ae-4d11-8d49-b67217ce0dff None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:48.093551 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-48db9ac6-11ae-4d11-8d49-b67217ce0dff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:48.108016 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48db9ac6-11ae-4d11-8d49-b67217ce0dff None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:48.112923 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f556cd4f-218a-47db-8ff2-806fe05600b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:48.114157 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f556cd4f-218a-47db-8ff2-806fe05600b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:48.114622 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f556cd4f-218a-47db-8ff2-806fe05600b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:48.114907 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f556cd4f-218a-47db-8ff2-806fe05600b1 admin admin] PATH_INFO: `/v3/projects/eaf6d0032ec34b1f90af7ef3e06158cb` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:48.116100 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f556cd4f-218a-47db-8ff2-806fe05600b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eaf6d0032ec34b1f90af7ef3e06158cb)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:48.118137 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f556cd4f-218a-47db-8ff2-806fe05600b1 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:48.165482 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-f556cd4f-218a-47db-8ff2-806fe05600b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eaf6d0032ec34b1f90af7ef3e06158cb', 'request_id': 'req-f556cd4f-218a-47db-8ff2-806fe05600b1'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:48.173537 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-f556cd4f-218a-47db-8ff2-806fe05600b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eaf6d0032ec34b1f90af7ef3e06158cb', 'request_id': 'req-f556cd4f-218a-47db-8ff2-806fe05600b1'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:48.179794 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-f556cd4f-218a-47db-8ff2-806fe05600b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eaf6d0032ec34b1f90af7ef3e06158cb', 'request_id': 'req-f556cd4f-218a-47db-8ff2-806fe05600b1'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:48.193820 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-f556cd4f-218a-47db-8ff2-806fe05600b1 admin admin] The token cache is being invalidate because project eaf6d0032ec34b1f90af7ef3e06158cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:24:48.194110 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-f556cd4f-218a-47db-8ff2-806fe05600b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:48.194799 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-f556cd4f-218a-47db-8ff2-806fe05600b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:48.196320 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1354/2691] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 5 12:24:48 2022] DELETE /identity/v3/projects/eaf6d0032ec34b1f90af7ef3e06158cb => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 12:24:48.200421 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3cfc55-79c5-4513-9965-afb21b03097d service neutron] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:48.211900 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3cfc55-79c5-4513-9965-afb21b03097d service neutron] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:48.403520 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244cda8c-5415-4030-b65c-445d5abefefb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:48.404652 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244cda8c-5415-4030-b65c-445d5abefefb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:48.405281 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244cda8c-5415-4030-b65c-445d5abefefb admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:48.405777 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244cda8c-5415-4030-b65c-445d5abefefb admin admin] PATH_INFO: `/v3/users/fc42de713a8442a8ae4c2d94b359505d` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:48.407990 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244cda8c-5415-4030-b65c-445d5abefefb admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc42de713a8442a8ae4c2d94b359505d)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:48.411550 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244cda8c-5415-4030-b65c-445d5abefefb admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:48.471130 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-244cda8c-5415-4030-b65c-445d5abefefb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc42de713a8442a8ae4c2d94b359505d'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:48.471845 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-244cda8c-5415-4030-b65c-445d5abefefb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc42de713a8442a8ae4c2d94b359505d'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:48.483489 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-244cda8c-5415-4030-b65c-445d5abefefb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc42de713a8442a8ae4c2d94b359505d'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:48.484771 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-244cda8c-5415-4030-b65c-445d5abefefb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc42de713a8442a8ae4c2d94b359505d'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:48.499645 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-244cda8c-5415-4030-b65c-445d5abefefb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc42de713a8442a8ae4c2d94b359505d'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:48.521983 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1338/2692] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 5 12:24:48 2022] DELETE /identity/v3/users/fc42de713a8442a8ae4c2d94b359505d => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:24:48.837801 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f556cd4f-218a-47db-8ff2-806fe05600b1 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:48.840118 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-f556cd4f-218a-47db-8ff2-806fe05600b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:48.872278 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f556cd4f-218a-47db-8ff2-806fe05600b1 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:48.966778 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49288d03-fe4c-4876-a47d-f60b5e6495a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:48.968078 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49288d03-fe4c-4876-a47d-f60b5e6495a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:48.968423 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49288d03-fe4c-4876-a47d-f60b5e6495a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:48.968908 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49288d03-fe4c-4876-a47d-f60b5e6495a9 admin admin] PATH_INFO: `/v3/projects/13aa308e114a419b8f423620e4e82f50` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:48.970293 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49288d03-fe4c-4876-a47d-f60b5e6495a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13aa308e114a419b8f423620e4e82f50)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:48.972379 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49288d03-fe4c-4876-a47d-f60b5e6495a9 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:49.032936 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-49288d03-fe4c-4876-a47d-f60b5e6495a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13aa308e114a419b8f423620e4e82f50', 'request_id': 'req-49288d03-fe4c-4876-a47d-f60b5e6495a9'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:49.044042 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-49288d03-fe4c-4876-a47d-f60b5e6495a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13aa308e114a419b8f423620e4e82f50', 'request_id': 'req-49288d03-fe4c-4876-a47d-f60b5e6495a9'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:49.050927 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-49288d03-fe4c-4876-a47d-f60b5e6495a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13aa308e114a419b8f423620e4e82f50', 'request_id': 'req-49288d03-fe4c-4876-a47d-f60b5e6495a9'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:49.062568 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-49288d03-fe4c-4876-a47d-f60b5e6495a9 admin admin] The token cache is being invalidate because project 13aa308e114a419b8f423620e4e82f50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:24:49.062864 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-49288d03-fe4c-4876-a47d-f60b5e6495a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:49.063754 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-49288d03-fe4c-4876-a47d-f60b5e6495a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:49.065281 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1355/2693] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 5 12:24:48 2022] DELETE /identity/v3/projects/13aa308e114a419b8f423620e4e82f50 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:24:49.072298 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5e8b52-b3a4-42e6-b8f8-b864f1ecd277 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:49.072800 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5e8b52-b3a4-42e6-b8f8-b864f1ecd277 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:49.072963 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5e8b52-b3a4-42e6-b8f8-b864f1ecd277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:49.093374 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-6c5e8b52-b3a4-42e6-b8f8-b864f1ecd277 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:24:49.094592 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-6c5e8b52-b3a4-42e6-b8f8-b864f1ecd277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:49.130671 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:24:49.160993 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1339/2694] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:24:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:24:49.170168 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8a5412-e4aa-4deb-b4dc-49d42c44b736 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:49.171208 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8a5412-e4aa-4deb-b4dc-49d42c44b736 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:49.171559 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8a5412-e4aa-4deb-b4dc-49d42c44b736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:49.194512 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-fc8a5412-e4aa-4deb-b4dc-49d42c44b736 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:24:49.196675 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-fc8a5412-e4aa-4deb-b4dc-49d42c44b736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:49.209651 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1356/2695] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:24:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:24:49.215426 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5e8b52-b3a4-42e6-b8f8-b864f1ecd277 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:49.228092 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5e8b52-b3a4-42e6-b8f8-b864f1ecd277 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:49.235334 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7895224-8229-4998-818b-7203d8ab1bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:49.236246 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7895224-8229-4998-818b-7203d8ab1bcc admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:49.236670 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7895224-8229-4998-818b-7203d8ab1bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:49.237116 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7895224-8229-4998-818b-7203d8ab1bcc admin admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:49.238167 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7895224-8229-4998-818b-7203d8ab1bcc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:24:49.238618 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7895224-8229-4998-818b-7203d8ab1bcc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:49.240273 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7895224-8229-4998-818b-7203d8ab1bcc admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:49.253651 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1340/2696] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Sep 5 12:24:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:24:49.258425 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8a5412-e4aa-4deb-b4dc-49d42c44b736 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:49.268238 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8a5412-e4aa-4deb-b4dc-49d42c44b736 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:49.272987 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f3f68c-00e2-4b12-bde8-305756f410b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:49.273591 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f3f68c-00e2-4b12-bde8-305756f410b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:49.273870 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f3f68c-00e2-4b12-bde8-305756f410b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:49.274143 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f3f68c-00e2-4b12-bde8-305756f410b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:49.274799 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f3f68c-00e2-4b12-bde8-305756f410b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:49.276693 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f3f68c-00e2-4b12-bde8-305756f410b2 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:49.281954 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:24:49.316080 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1357/2697] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 5 12:24:49 2022] POST /identity/v3/projects => generated 385 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 12:24:49.320454 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7895224-8229-4998-818b-7203d8ab1bcc admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:49.331258 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7895224-8229-4998-818b-7203d8ab1bcc admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:49.391436 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c384d6-84d2-475d-a33a-c89490d6bb6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:49.392055 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c384d6-84d2-475d-a33a-c89490d6bb6b admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:49.392337 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c384d6-84d2-475d-a33a-c89490d6bb6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:49.392610 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c384d6-84d2-475d-a33a-c89490d6bb6b admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:49.393309 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c384d6-84d2-475d-a33a-c89490d6bb6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:49.395267 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c384d6-84d2-475d-a33a-c89490d6bb6b admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:49.417994 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1341/2698] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 5 12:24:49 2022] POST /identity/v3/users => generated 293 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:24:49.422770 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f3f68c-00e2-4b12-bde8-305756f410b2 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:49.433591 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f3f68c-00e2-4b12-bde8-305756f410b2 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:49.439323 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414eb919-c909-4984-aed1-3ea4d7bfac33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:49.440100 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414eb919-c909-4984-aed1-3ea4d7bfac33 admin admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:49.440375 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414eb919-c909-4984-aed1-3ea4d7bfac33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:49.440646 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414eb919-c909-4984-aed1-3ea4d7bfac33 admin admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:49.441349 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414eb919-c909-4984-aed1-3ea4d7bfac33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:49.442937 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414eb919-c909-4984-aed1-3ea4d7bfac33 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:49.455129 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1358/2699] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:24:49 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 12:24:49.459193 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c384d6-84d2-475d-a33a-c89490d6bb6b admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:49.470379 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c384d6-84d2-475d-a33a-c89490d6bb6b admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:49.475472 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1585d9-e836-4480-83e2-bf422207bf11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:49.476092 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1585d9-e836-4480-83e2-bf422207bf11 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:49.476371 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1585d9-e836-4480-83e2-bf422207bf11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:49.476647 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1585d9-e836-4480-83e2-bf422207bf11 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:49.477342 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1585d9-e836-4480-83e2-bf422207bf11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:49.478971 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1585d9-e836-4480-83e2-bf422207bf11 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:49.496358 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1342/2700] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:24:49 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:24:49.501358 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414eb919-c909-4984-aed1-3ea4d7bfac33 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:49.511959 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414eb919-c909-4984-aed1-3ea4d7bfac33 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:49.517202 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8199c88-ce49-4fc3-a066-c41ed568232f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:49.517966 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8199c88-ce49-4fc3-a066-c41ed568232f admin admin] REQUEST_METHOD: `PUT` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:49.518250 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8199c88-ce49-4fc3-a066-c41ed568232f admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:49.518527 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8199c88-ce49-4fc3-a066-c41ed568232f admin admin] PATH_INFO: `/v3/projects/af26efa89efb4bf683ff0ab591b1306e/users/81c642a7e43443ca8758a4bbf5b2fbc6/roles/ed72181e1403401facb77dcf33644757` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:49.534348 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8199c88-ce49-4fc3-a066-c41ed568232f admin admin] RBAC: Authorizing `identity:create_grant(project_id=af26efa89efb4bf683ff0ab591b1306e, user_id=81c642a7e43443ca8758a4bbf5b2fbc6, role_id=ed72181e1403401facb77dcf33644757)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:49.537040 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8199c88-ce49-4fc3-a066-c41ed568232f admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:49.552853 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1359/2701] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 5 12:24:49 2022] PUT /identity/v3/projects/af26efa89efb4bf683ff0ab591b1306e/users/81c642a7e43443ca8758a4bbf5b2fbc6/roles/ed72181e1403401facb77dcf33644757 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:24:49.567249 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea3c188-2fb2-42db-afeb-f970b9d4fbc4 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:49.567539 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea3c188-2fb2-42db-afeb-f970b9d4fbc4 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:49.567841 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea3c188-2fb2-42db-afeb-f970b9d4fbc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:49.597208 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-bea3c188-2fb2-42db-afeb-f970b9d4fbc4 None None] MFA Rules not processed for user `81c642a7e43443ca8758a4bbf5b2fbc6`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:24:49.598453 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-bea3c188-2fb2-42db-afeb-f970b9d4fbc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:49.671200 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1343/2702] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:24:49 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:24:49.684109 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8199c88-ce49-4fc3-a066-c41ed568232f admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:49.685916 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-c8199c88-ce49-4fc3-a066-c41ed568232f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:49.746163 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8199c88-ce49-4fc3-a066-c41ed568232f admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:49.749979 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34724021-ec00-4932-8fb9-78ffa022bf52 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37633bbae0c2423c81ccd61ac3a17ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:49.750592 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34724021-ec00-4932-8fb9-78ffa022bf52 service cinder] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:49.750873 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34724021-ec00-4932-8fb9-78ffa022bf52 service cinder] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:49.751147 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34724021-ec00-4932-8fb9-78ffa022bf52 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:49.760223 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34724021-ec00-4932-8fb9-78ffa022bf52 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:49.761709 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34724021-ec00-4932-8fb9-78ffa022bf52 service cinder] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:49.771499 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1360/2703] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:24:49 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:24:49.792923 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea3c188-2fb2-42db-afeb-f970b9d4fbc4 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:49.832675 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:24:49.859944 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea3c188-2fb2-42db-afeb-f970b9d4fbc4 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:49.864556 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92dd49e-76a9-4ac1-9374-79f0a44e57a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:49.865222 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92dd49e-76a9-4ac1-9374-79f0a44e57a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:49.865501 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92dd49e-76a9-4ac1-9374-79f0a44e57a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:49.865769 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92dd49e-76a9-4ac1-9374-79f0a44e57a5 admin admin] PATH_INFO: `/v3/users/81c642a7e43443ca8758a4bbf5b2fbc6` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:49.866898 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92dd49e-76a9-4ac1-9374-79f0a44e57a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81c642a7e43443ca8758a4bbf5b2fbc6)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:49.868797 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92dd49e-76a9-4ac1-9374-79f0a44e57a5 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:49.917119 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-f92dd49e-76a9-4ac1-9374-79f0a44e57a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81c642a7e43443ca8758a4bbf5b2fbc6'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:49.917777 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-f92dd49e-76a9-4ac1-9374-79f0a44e57a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81c642a7e43443ca8758a4bbf5b2fbc6'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:49.925100 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-f92dd49e-76a9-4ac1-9374-79f0a44e57a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81c642a7e43443ca8758a4bbf5b2fbc6'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:49.925756 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-f92dd49e-76a9-4ac1-9374-79f0a44e57a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81c642a7e43443ca8758a4bbf5b2fbc6'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:49.938119 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-f92dd49e-76a9-4ac1-9374-79f0a44e57a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81c642a7e43443ca8758a4bbf5b2fbc6'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:49.951441 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1344/2704] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 5 12:24:49 2022] DELETE /identity/v3/users/81c642a7e43443ca8758a4bbf5b2fbc6 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:24:49.956018 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec7526e-d52a-42be-b8bc-09bd6cf8814a None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:49.956512 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec7526e-d52a-42be-b8bc-09bd6cf8814a None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:49.956638 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec7526e-d52a-42be-b8bc-09bd6cf8814a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:49.975966 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-9ec7526e-d52a-42be-b8bc-09bd6cf8814a None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:24:49.977184 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-9ec7526e-d52a-42be-b8bc-09bd6cf8814a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:50.048060 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1361/2705] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:24:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:24:50.058677 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92dd49e-76a9-4ac1-9374-79f0a44e57a5 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:50.060101 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-f92dd49e-76a9-4ac1-9374-79f0a44e57a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:50.127782 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92dd49e-76a9-4ac1-9374-79f0a44e57a5 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:50.131428 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2d55f9-72d5-4f4e-9647-f464f9a394b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4994b4faa4ec4aa088f3dc32c9c5614d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:50.132035 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2d55f9-72d5-4f4e-9647-f464f9a394b1 service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:50.132310 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2d55f9-72d5-4f4e-9647-f464f9a394b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:50.132579 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2d55f9-72d5-4f4e-9647-f464f9a394b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:50.143179 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2d55f9-72d5-4f4e-9647-f464f9a394b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:50.144662 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2d55f9-72d5-4f4e-9647-f464f9a394b1 service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:50.156058 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1345/2706] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:24:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:24:50.454231 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec7526e-d52a-42be-b8bc-09bd6cf8814a None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:50.455822 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-9ec7526e-d52a-42be-b8bc-09bd6cf8814a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:50.469428 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec7526e-d52a-42be-b8bc-09bd6cf8814a None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:50.474846 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d737b7-7032-44ab-bd5c-e6d382a09b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:50.475528 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d737b7-7032-44ab-bd5c-e6d382a09b1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:50.475813 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d737b7-7032-44ab-bd5c-e6d382a09b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:50.476087 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d737b7-7032-44ab-bd5c-e6d382a09b1e admin admin] PATH_INFO: `/v3/projects/af26efa89efb4bf683ff0ab591b1306e` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:50.477315 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d737b7-7032-44ab-bd5c-e6d382a09b1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=af26efa89efb4bf683ff0ab591b1306e)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:50.479304 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d737b7-7032-44ab-bd5c-e6d382a09b1e admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:50.531724 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:24:50.532944 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-74d737b7-7032-44ab-bd5c-e6d382a09b1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af26efa89efb4bf683ff0ab591b1306e', 'request_id': 'req-74d737b7-7032-44ab-bd5c-e6d382a09b1e'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:50.541519 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-74d737b7-7032-44ab-bd5c-e6d382a09b1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af26efa89efb4bf683ff0ab591b1306e', 'request_id': 'req-74d737b7-7032-44ab-bd5c-e6d382a09b1e'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:50.548365 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-74d737b7-7032-44ab-bd5c-e6d382a09b1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af26efa89efb4bf683ff0ab591b1306e', 'request_id': 'req-74d737b7-7032-44ab-bd5c-e6d382a09b1e'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:50.560269 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-74d737b7-7032-44ab-bd5c-e6d382a09b1e admin admin] The token cache is being invalidate because project af26efa89efb4bf683ff0ab591b1306e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:24:50.560556 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-74d737b7-7032-44ab-bd5c-e6d382a09b1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:50.561851 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-74d737b7-7032-44ab-bd5c-e6d382a09b1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:50.563410 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1362/2707] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 5 12:24:50 2022] DELETE /identity/v3/projects/af26efa89efb4bf683ff0ab591b1306e => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:24:50.568416 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0fa7a4-dfca-4e9c-8bbd-e7c8829dbf7b None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:50.568976 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0fa7a4-dfca-4e9c-8bbd-e7c8829dbf7b None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:50.569112 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0fa7a4-dfca-4e9c-8bbd-e7c8829dbf7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:50.589848 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-cf0fa7a4-dfca-4e9c-8bbd-e7c8829dbf7b None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:24:50.591074 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-cf0fa7a4-dfca-4e9c-8bbd-e7c8829dbf7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:50.643346 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:24:50.655362 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1346/2708] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:24:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:24:50.663274 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdffad37-193e-4dc1-bc13-b3ef6a382c80 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:50.663557 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdffad37-193e-4dc1-bc13-b3ef6a382c80 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:50.663830 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdffad37-193e-4dc1-bc13-b3ef6a382c80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:50.684600 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-cdffad37-193e-4dc1-bc13-b3ef6a382c80 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:24:50.685870 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-cdffad37-193e-4dc1-bc13-b3ef6a382c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:50.694394 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1363/2709] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:24:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:24:50.698688 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0fa7a4-dfca-4e9c-8bbd-e7c8829dbf7b None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:50.708948 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0fa7a4-dfca-4e9c-8bbd-e7c8829dbf7b None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:50.713454 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dd54a1-5cc6-44e6-bb9c-b2c3a0253467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:50.714046 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dd54a1-5cc6-44e6-bb9c-b2c3a0253467 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:50.714320 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dd54a1-5cc6-44e6-bb9c-b2c3a0253467 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:50.714723 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dd54a1-5cc6-44e6-bb9c-b2c3a0253467 admin admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:50.715216 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dd54a1-5cc6-44e6-bb9c-b2c3a0253467 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:24:50.715519 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dd54a1-5cc6-44e6-bb9c-b2c3a0253467 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:50.717129 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dd54a1-5cc6-44e6-bb9c-b2c3a0253467 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:50.729540 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1347/2710] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Sep 5 12:24:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:24:50.734106 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdffad37-193e-4dc1-bc13-b3ef6a382c80 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:50.743684 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdffad37-193e-4dc1-bc13-b3ef6a382c80 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:50.748320 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c4c0f5-6ca9-48cc-b1d9-ed602bb0742f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:50.749509 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c4c0f5-6ca9-48cc-b1d9-ed602bb0742f admin admin] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:50.749841 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c4c0f5-6ca9-48cc-b1d9-ed602bb0742f admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:50.750113 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c4c0f5-6ca9-48cc-b1d9-ed602bb0742f admin admin] PATH_INFO: `/v3/projects` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:50.750758 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c4c0f5-6ca9-48cc-b1d9-ed602bb0742f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:50.752659 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c4c0f5-6ca9-48cc-b1d9-ed602bb0742f admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:50.796251 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1364/2711] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 5 12:24:50 2022] POST /identity/v3/projects => generated 383 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 12:24:50.800997 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dd54a1-5cc6-44e6-bb9c-b2c3a0253467 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:50.811221 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dd54a1-5cc6-44e6-bb9c-b2c3a0253467 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:50.870113 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca15bbd-093a-49a7-836e-f19eabe98928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:50.870730 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca15bbd-093a-49a7-836e-f19eabe98928 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:50.871011 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca15bbd-093a-49a7-836e-f19eabe98928 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:50.871313 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca15bbd-093a-49a7-836e-f19eabe98928 admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:50.871935 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca15bbd-093a-49a7-836e-f19eabe98928 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:50.874551 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca15bbd-093a-49a7-836e-f19eabe98928 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:50.899408 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1348/2712] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 5 12:24:50 2022] POST /identity/v3/users => generated 292 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:24:50.903959 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c4c0f5-6ca9-48cc-b1d9-ed602bb0742f admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:50.915362 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c4c0f5-6ca9-48cc-b1d9-ed602bb0742f admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:50.920084 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eea92e5-0aa1-4c60-bcd6-1e3ce349c7f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:50.921255 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eea92e5-0aa1-4c60-bcd6-1e3ce349c7f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:50.921537 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eea92e5-0aa1-4c60-bcd6-1e3ce349c7f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:50.921808 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eea92e5-0aa1-4c60-bcd6-1e3ce349c7f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:50.922463 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eea92e5-0aa1-4c60-bcd6-1e3ce349c7f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:50.924044 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eea92e5-0aa1-4c60-bcd6-1e3ce349c7f0 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:50.935076 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1365/2713] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:24:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 12:24:50.940137 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca15bbd-093a-49a7-836e-f19eabe98928 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:50.950437 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca15bbd-093a-49a7-836e-f19eabe98928 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:50.955181 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1de15d8-af59-4c73-9010-c115810bf033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:50.955789 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1de15d8-af59-4c73-9010-c115810bf033 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:50.956069 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1de15d8-af59-4c73-9010-c115810bf033 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:50.956344 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1de15d8-af59-4c73-9010-c115810bf033 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:50.957022 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1de15d8-af59-4c73-9010-c115810bf033 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:50.958641 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1de15d8-af59-4c73-9010-c115810bf033 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:50.969847 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1349/2714] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:24:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:24:50.981202 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eea92e5-0aa1-4c60-bcd6-1e3ce349c7f0 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:50.992228 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eea92e5-0aa1-4c60-bcd6-1e3ce349c7f0 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:50.997007 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e07687-2391-4b03-8b1b-d4a4df54007c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:50.997669 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e07687-2391-4b03-8b1b-d4a4df54007c admin admin] REQUEST_METHOD: `PUT` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:50.997945 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e07687-2391-4b03-8b1b-d4a4df54007c admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:50.998212 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e07687-2391-4b03-8b1b-d4a4df54007c admin admin] PATH_INFO: `/v3/projects/963e487bbdc24032bb456d3daa938627/users/0ecedc53f046404c9a51478e752185e1/roles/ed72181e1403401facb77dcf33644757` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:51.014097 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e07687-2391-4b03-8b1b-d4a4df54007c admin admin] RBAC: Authorizing `identity:create_grant(project_id=963e487bbdc24032bb456d3daa938627, user_id=0ecedc53f046404c9a51478e752185e1, role_id=ed72181e1403401facb77dcf33644757)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:51.017081 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e07687-2391-4b03-8b1b-d4a4df54007c admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:51.032516 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1366/2715] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 5 12:24:50 2022] PUT /identity/v3/projects/963e487bbdc24032bb456d3daa938627/users/0ecedc53f046404c9a51478e752185e1/roles/ed72181e1403401facb77dcf33644757 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 12:24:51.042895 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86b3a52-66bc-49ae-bb87-386817507705 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:51.043171 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86b3a52-66bc-49ae-bb87-386817507705 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:51.043313 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86b3a52-66bc-49ae-bb87-386817507705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:51.073245 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-b86b3a52-66bc-49ae-bb87-386817507705 None None] MFA Rules not processed for user `0ecedc53f046404c9a51478e752185e1`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:24:51.074499 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-b86b3a52-66bc-49ae-bb87-386817507705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:51.139244 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1350/2716] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:24:51 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:24:51.144036 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e07687-2391-4b03-8b1b-d4a4df54007c admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:51.215108 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e07687-2391-4b03-8b1b-d4a4df54007c admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:51.220333 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8772c263-05ed-4759-9f31-64ad74d8db73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:51.220958 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8772c263-05ed-4759-9f31-64ad74d8db73 admin admin] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:51.221237 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8772c263-05ed-4759-9f31-64ad74d8db73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:51.221509 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8772c263-05ed-4759-9f31-64ad74d8db73 admin admin] PATH_INFO: `/v3/projects` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:51.222174 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8772c263-05ed-4759-9f31-64ad74d8db73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:51.224024 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8772c263-05ed-4759-9f31-64ad74d8db73 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:51.251530 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1367/2717] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 5 12:24:51 2022] POST /identity/v3/projects => generated 385 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 12:24:51.256621 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86b3a52-66bc-49ae-bb87-386817507705 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:51.268106 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86b3a52-66bc-49ae-bb87-386817507705 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:51.323994 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:24:51.335567 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762f6de5-303a-462a-8fc1-b302676a6b38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:51.336185 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762f6de5-303a-462a-8fc1-b302676a6b38 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:51.336463 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762f6de5-303a-462a-8fc1-b302676a6b38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:51.336730 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762f6de5-303a-462a-8fc1-b302676a6b38 admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:51.337457 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762f6de5-303a-462a-8fc1-b302676a6b38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:51.339291 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762f6de5-303a-462a-8fc1-b302676a6b38 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:51.362540 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1351/2718] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 5 12:24:51 2022] POST /identity/v3/users => generated 293 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:24:51.367574 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8772c263-05ed-4759-9f31-64ad74d8db73 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:51.384977 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8772c263-05ed-4759-9f31-64ad74d8db73 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:51.390328 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd183e4-b663-4e0e-b840-b49f110b1bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:51.390952 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd183e4-b663-4e0e-b840-b49f110b1bfb admin admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:51.391235 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd183e4-b663-4e0e-b840-b49f110b1bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:51.391512 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd183e4-b663-4e0e-b840-b49f110b1bfb admin admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:51.392165 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd183e4-b663-4e0e-b840-b49f110b1bfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:51.393805 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd183e4-b663-4e0e-b840-b49f110b1bfb admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:51.406385 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1368/2719] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:24:51 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:24:51.412565 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762f6de5-303a-462a-8fc1-b302676a6b38 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:51.423798 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762f6de5-303a-462a-8fc1-b302676a6b38 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:51.428596 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b82d15-485b-465a-ab52-c087f3d4c1ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:51.429362 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b82d15-485b-465a-ab52-c087f3d4c1ae admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:51.429734 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b82d15-485b-465a-ab52-c087f3d4c1ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:51.429916 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b82d15-485b-465a-ab52-c087f3d4c1ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:51.430557 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b82d15-485b-465a-ab52-c087f3d4c1ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:51.432152 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b82d15-485b-465a-ab52-c087f3d4c1ae admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:51.443097 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1352/2720] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:24:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:24:51.449053 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd183e4-b663-4e0e-b840-b49f110b1bfb admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:51.463903 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd183e4-b663-4e0e-b840-b49f110b1bfb admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:51.469866 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe0d4a8-d152-4a3e-9ea8-a4b327dbf05a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:51.470605 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe0d4a8-d152-4a3e-9ea8-a4b327dbf05a admin admin] REQUEST_METHOD: `PUT` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:51.470971 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe0d4a8-d152-4a3e-9ea8-a4b327dbf05a admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:51.471306 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe0d4a8-d152-4a3e-9ea8-a4b327dbf05a admin admin] PATH_INFO: `/v3/projects/ac1b1ef089b04fcbb2b2700adbe7fad6/users/145cf907615345ae915410011c39ee9d/roles/ed72181e1403401facb77dcf33644757` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:51.488666 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe0d4a8-d152-4a3e-9ea8-a4b327dbf05a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac1b1ef089b04fcbb2b2700adbe7fad6, user_id=145cf907615345ae915410011c39ee9d, role_id=ed72181e1403401facb77dcf33644757)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:51.491404 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe0d4a8-d152-4a3e-9ea8-a4b327dbf05a admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:51.508376 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1369/2721] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 5 12:24:51 2022] PUT /identity/v3/projects/ac1b1ef089b04fcbb2b2700adbe7fad6/users/145cf907615345ae915410011c39ee9d/roles/ed72181e1403401facb77dcf33644757 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:24:51.580503 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975c9748-f88c-4afa-83ea-5ce4b76fee8f None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:51.580989 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975c9748-f88c-4afa-83ea-5ce4b76fee8f None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:51.581101 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975c9748-f88c-4afa-83ea-5ce4b76fee8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:51.612111 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-975c9748-f88c-4afa-83ea-5ce4b76fee8f None None] MFA Rules not processed for user `145cf907615345ae915410011c39ee9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:24:51.613437 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-975c9748-f88c-4afa-83ea-5ce4b76fee8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:51.684211 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1353/2722] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:24:51 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:24:51.689048 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe0d4a8-d152-4a3e-9ea8-a4b327dbf05a admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:51.715453 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:24:51.754432 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe0d4a8-d152-4a3e-9ea8-a4b327dbf05a admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:51.759505 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970b82e6-ea4f-4b00-8c94-476ed0d6a474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:51.760300 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970b82e6-ea4f-4b00-8c94-476ed0d6a474 admin admin] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:51.760608 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970b82e6-ea4f-4b00-8c94-476ed0d6a474 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:51.760930 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970b82e6-ea4f-4b00-8c94-476ed0d6a474 admin admin] PATH_INFO: `/v3/projects` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:51.761673 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970b82e6-ea4f-4b00-8c94-476ed0d6a474 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:51.763745 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970b82e6-ea4f-4b00-8c94-476ed0d6a474 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:51.792942 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1370/2723] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 5 12:24:51 2022] POST /identity/v3/projects => generated 385 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:24:51.797016 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975c9748-f88c-4afa-83ea-5ce4b76fee8f None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:51.808546 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975c9748-f88c-4afa-83ea-5ce4b76fee8f None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:51.871111 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c36d87-3ed9-436a-bace-d4d158f5e73e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:51.871729 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c36d87-3ed9-436a-bace-d4d158f5e73e admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:51.872012 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c36d87-3ed9-436a-bace-d4d158f5e73e admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:51.872286 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c36d87-3ed9-436a-bace-d4d158f5e73e admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:51.872960 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c36d87-3ed9-436a-bace-d4d158f5e73e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:51.874909 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c36d87-3ed9-436a-bace-d4d158f5e73e admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:51.896361 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1354/2724] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 5 12:24:51 2022] POST /identity/v3/users => generated 299 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:24:51.900421 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970b82e6-ea4f-4b00-8c94-476ed0d6a474 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:51.911383 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970b82e6-ea4f-4b00-8c94-476ed0d6a474 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:51.915939 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c773ce-4953-44c5-829b-c7695449abae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:51.916532 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c773ce-4953-44c5-829b-c7695449abae admin admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:51.916813 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c773ce-4953-44c5-829b-c7695449abae admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:51.917136 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c773ce-4953-44c5-829b-c7695449abae admin admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:51.917776 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c773ce-4953-44c5-829b-c7695449abae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:51.919356 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c773ce-4953-44c5-829b-c7695449abae admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:51.929825 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1371/2725] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:24:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:24:51.933998 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c36d87-3ed9-436a-bace-d4d158f5e73e admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:51.944632 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c36d87-3ed9-436a-bace-d4d158f5e73e admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:51.949391 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08378c60-b62a-4b18-9b38-ee120c70031f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:51.950074 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08378c60-b62a-4b18-9b38-ee120c70031f admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:51.950354 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08378c60-b62a-4b18-9b38-ee120c70031f admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:51.950651 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08378c60-b62a-4b18-9b38-ee120c70031f admin admin] PATH_INFO: `/v3/projects/7c98e652179640b291d1ab5144199ce3/users/8122434a84df47808d728fe1fecbad33/roles/16e2ccc8bd1b497d8cee780c1c7df0d2` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:51.967169 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08378c60-b62a-4b18-9b38-ee120c70031f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c98e652179640b291d1ab5144199ce3, user_id=8122434a84df47808d728fe1fecbad33, role_id=16e2ccc8bd1b497d8cee780c1c7df0d2)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:51.969933 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08378c60-b62a-4b18-9b38-ee120c70031f admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:51.983963 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1355/2726] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 5 12:24:51 2022] PUT /identity/v3/projects/7c98e652179640b291d1ab5144199ce3/users/8122434a84df47808d728fe1fecbad33/roles/16e2ccc8bd1b497d8cee780c1c7df0d2 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:24:51.988037 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c773ce-4953-44c5-829b-c7695449abae admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:51.998223 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c773ce-4953-44c5-829b-c7695449abae admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:52.064102 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019d9efb-ace2-4cfb-8726-453d832039e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:52.064605 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019d9efb-ace2-4cfb-8726-453d832039e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:52.064879 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019d9efb-ace2-4cfb-8726-453d832039e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:52.065176 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019d9efb-ace2-4cfb-8726-453d832039e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:52.065814 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019d9efb-ace2-4cfb-8726-453d832039e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:52.067406 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019d9efb-ace2-4cfb-8726-453d832039e7 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:52.078293 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1372/2727] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:24:51 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:24:52.082474 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08378c60-b62a-4b18-9b38-ee120c70031f admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:52.092930 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08378c60-b62a-4b18-9b38-ee120c70031f admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:52.097628 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c771a354-1eb2-4d50-9994-46422dfa4a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:52.098290 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c771a354-1eb2-4d50-9994-46422dfa4a28 admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:52.098571 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c771a354-1eb2-4d50-9994-46422dfa4a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:52.098845 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c771a354-1eb2-4d50-9994-46422dfa4a28 admin admin] PATH_INFO: `/v3/projects/7c98e652179640b291d1ab5144199ce3/users/8122434a84df47808d728fe1fecbad33/roles/16e2ccc8bd1b497d8cee780c1c7df0d2` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:52.100748 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c771a354-1eb2-4d50-9994-46422dfa4a28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c98e652179640b291d1ab5144199ce3, user_id=8122434a84df47808d728fe1fecbad33, role_id=16e2ccc8bd1b497d8cee780c1c7df0d2)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:52.103645 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c771a354-1eb2-4d50-9994-46422dfa4a28 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:52.114157 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1356/2728] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 5 12:24:52 2022] PUT /identity/v3/projects/7c98e652179640b291d1ab5144199ce3/users/8122434a84df47808d728fe1fecbad33/roles/16e2ccc8bd1b497d8cee780c1c7df0d2 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:24:52.125062 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67735b6c-5c0d-4bc0-8fcd-f4bb1a84bad4 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:52.125349 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67735b6c-5c0d-4bc0-8fcd-f4bb1a84bad4 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:52.125620 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67735b6c-5c0d-4bc0-8fcd-f4bb1a84bad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:52.153648 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-67735b6c-5c0d-4bc0-8fcd-f4bb1a84bad4 None None] MFA Rules not processed for user `8122434a84df47808d728fe1fecbad33`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:24:52.154855 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-67735b6c-5c0d-4bc0-8fcd-f4bb1a84bad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:52.222231 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1373/2729] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:24:52 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:24:52.234008 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c771a354-1eb2-4d50-9994-46422dfa4a28 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:52.235791 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-c771a354-1eb2-4d50-9994-46422dfa4a28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:52.252498 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:24:52.297602 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c771a354-1eb2-4d50-9994-46422dfa4a28 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:52.301247 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12f8564-ff1e-44ac-9a01-bc06984454fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37633bbae0c2423c81ccd61ac3a17ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:52.301842 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12f8564-ff1e-44ac-9a01-bc06984454fb service cinder] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:52.302342 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12f8564-ff1e-44ac-9a01-bc06984454fb service cinder] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:52.302342 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12f8564-ff1e-44ac-9a01-bc06984454fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:52.356726 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12f8564-ff1e-44ac-9a01-bc06984454fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:52.358711 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12f8564-ff1e-44ac-9a01-bc06984454fb service cinder] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:52.367640 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1357/2730] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:24:52 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:24:53.884723 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67735b6c-5c0d-4bc0-8fcd-f4bb1a84bad4 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:53.894698 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67735b6c-5c0d-4bc0-8fcd-f4bb1a84bad4 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:53.898489 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eac0782-bf15-47b3-97ee-f492afd05a5e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37633bbae0c2423c81ccd61ac3a17ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:53.899004 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eac0782-bf15-47b3-97ee-f492afd05a5e service cinder] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:53.899287 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eac0782-bf15-47b3-97ee-f492afd05a5e service cinder] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:53.899565 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eac0782-bf15-47b3-97ee-f492afd05a5e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:53.913139 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:24:53.981079 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eac0782-bf15-47b3-97ee-f492afd05a5e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:53.984235 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eac0782-bf15-47b3-97ee-f492afd05a5e service cinder] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:54.010036 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1374/2731] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:24:53 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:24:54.589741 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12f8564-ff1e-44ac-9a01-bc06984454fb service cinder] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:54.599700 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12f8564-ff1e-44ac-9a01-bc06984454fb service cinder] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:54.603449 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bebf40e-7a17-44a8-8594-ee6b7d79a5db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37633bbae0c2423c81ccd61ac3a17ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:54.604061 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bebf40e-7a17-44a8-8594-ee6b7d79a5db service cinder] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:54.604336 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bebf40e-7a17-44a8-8594-ee6b7d79a5db service cinder] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:54.604607 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bebf40e-7a17-44a8-8594-ee6b7d79a5db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:54.614252 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bebf40e-7a17-44a8-8594-ee6b7d79a5db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:54.615703 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bebf40e-7a17-44a8-8594-ee6b7d79a5db service cinder] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:54.625465 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1358/2732] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:24:54 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:24:56.656545 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eac0782-bf15-47b3-97ee-f492afd05a5e service cinder] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:56.658065 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-8eac0782-bf15-47b3-97ee-f492afd05a5e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:56.729309 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eac0782-bf15-47b3-97ee-f492afd05a5e service cinder] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:56.734009 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f02538-1858-4e9f-89a3-60f47b41e9a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:56.734657 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f02538-1858-4e9f-89a3-60f47b41e9a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:56.734938 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f02538-1858-4e9f-89a3-60f47b41e9a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:56.735241 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f02538-1858-4e9f-89a3-60f47b41e9a5 admin admin] PATH_INFO: `/v3/users/39d7b72419d84aa386c35db1a31d356c` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:56.736423 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f02538-1858-4e9f-89a3-60f47b41e9a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39d7b72419d84aa386c35db1a31d356c)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:56.738398 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f02538-1858-4e9f-89a3-60f47b41e9a5 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:56.797676 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-e7f02538-1858-4e9f-89a3-60f47b41e9a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39d7b72419d84aa386c35db1a31d356c'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:56.798466 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-e7f02538-1858-4e9f-89a3-60f47b41e9a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39d7b72419d84aa386c35db1a31d356c'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:56.807018 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-e7f02538-1858-4e9f-89a3-60f47b41e9a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39d7b72419d84aa386c35db1a31d356c'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:56.807783 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-e7f02538-1858-4e9f-89a3-60f47b41e9a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39d7b72419d84aa386c35db1a31d356c'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:56.821228 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-e7f02538-1858-4e9f-89a3-60f47b41e9a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39d7b72419d84aa386c35db1a31d356c'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:56.834041 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1375/2733] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 5 12:24:56 2022] DELETE /identity/v3/users/39d7b72419d84aa386c35db1a31d356c => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 12:24:57.026377 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bebf40e-7a17-44a8-8594-ee6b7d79a5db service cinder] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:57.038174 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bebf40e-7a17-44a8-8594-ee6b7d79a5db service cinder] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:57.112288 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95c9959-4d30-46b5-9b06-447ba5cac86c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:57.112968 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95c9959-4d30-46b5-9b06-447ba5cac86c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:57.113249 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95c9959-4d30-46b5-9b06-447ba5cac86c admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:57.113670 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95c9959-4d30-46b5-9b06-447ba5cac86c admin admin] PATH_INFO: `/v3/projects/6177288cb4174cefb547fc5aa0d067a6` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:57.114912 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95c9959-4d30-46b5-9b06-447ba5cac86c admin admin] RBAC: Authorizing `identity:delete_project(project_id=6177288cb4174cefb547fc5aa0d067a6)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:57.117168 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95c9959-4d30-46b5-9b06-447ba5cac86c admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:57.179771 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-c95c9959-4d30-46b5-9b06-447ba5cac86c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6177288cb4174cefb547fc5aa0d067a6', 'request_id': 'req-c95c9959-4d30-46b5-9b06-447ba5cac86c'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:57.187975 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-c95c9959-4d30-46b5-9b06-447ba5cac86c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6177288cb4174cefb547fc5aa0d067a6', 'request_id': 'req-c95c9959-4d30-46b5-9b06-447ba5cac86c'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:57.189540 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:24:57.195685 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-c95c9959-4d30-46b5-9b06-447ba5cac86c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6177288cb4174cefb547fc5aa0d067a6', 'request_id': 'req-c95c9959-4d30-46b5-9b06-447ba5cac86c'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:57.217036 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-c95c9959-4d30-46b5-9b06-447ba5cac86c admin admin] The token cache is being invalidate because project 6177288cb4174cefb547fc5aa0d067a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:24:57.217332 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-c95c9959-4d30-46b5-9b06-447ba5cac86c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:57.219280 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-c95c9959-4d30-46b5-9b06-447ba5cac86c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:57.220213 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1359/2734] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 5 12:24:57 2022] DELETE /identity/v3/projects/6177288cb4174cefb547fc5aa0d067a6 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:24:57.224399 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f02538-1858-4e9f-89a3-60f47b41e9a5 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:57.225829 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-e7f02538-1858-4e9f-89a3-60f47b41e9a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:57.240055 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f02538-1858-4e9f-89a3-60f47b41e9a5 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:57.281203 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:24:57.312605 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d0befa-8524-4d2c-b161-2722b6fbac88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:57.313237 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d0befa-8524-4d2c-b161-2722b6fbac88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:57.313515 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d0befa-8524-4d2c-b161-2722b6fbac88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:57.313788 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d0befa-8524-4d2c-b161-2722b6fbac88 admin admin] PATH_INFO: `/v3/users/994d5f9787314d86b1a5f2f21d3eb056` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:57.314976 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d0befa-8524-4d2c-b161-2722b6fbac88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=994d5f9787314d86b1a5f2f21d3eb056)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:57.316881 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d0befa-8524-4d2c-b161-2722b6fbac88 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:57.374932 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-12d0befa-8524-4d2c-b161-2722b6fbac88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '994d5f9787314d86b1a5f2f21d3eb056'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:57.375647 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-12d0befa-8524-4d2c-b161-2722b6fbac88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '994d5f9787314d86b1a5f2f21d3eb056'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:57.383663 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-12d0befa-8524-4d2c-b161-2722b6fbac88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '994d5f9787314d86b1a5f2f21d3eb056'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:57.384428 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-12d0befa-8524-4d2c-b161-2722b6fbac88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '994d5f9787314d86b1a5f2f21d3eb056'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:57.397510 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-12d0befa-8524-4d2c-b161-2722b6fbac88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '994d5f9787314d86b1a5f2f21d3eb056'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:57.415924 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1376/2735] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 5 12:24:57 2022] DELETE /identity/v3/users/994d5f9787314d86b1a5f2f21d3eb056 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 12:24:57.611073 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95c9959-4d30-46b5-9b06-447ba5cac86c admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:57.612744 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-c95c9959-4d30-46b5-9b06-447ba5cac86c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:57.627204 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95c9959-4d30-46b5-9b06-447ba5cac86c admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:57.689040 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c823e35b-6207-41c5-895b-a1e5b870f40a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:57.689678 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c823e35b-6207-41c5-895b-a1e5b870f40a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:57.689955 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c823e35b-6207-41c5-895b-a1e5b870f40a admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:57.690225 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c823e35b-6207-41c5-895b-a1e5b870f40a admin admin] PATH_INFO: `/v3/projects/93f7aa939aac422ab88426d71f76dbfd` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:57.691355 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c823e35b-6207-41c5-895b-a1e5b870f40a admin admin] RBAC: Authorizing `identity:delete_project(project_id=93f7aa939aac422ab88426d71f76dbfd)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:57.693303 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c823e35b-6207-41c5-895b-a1e5b870f40a admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:57.739970 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-c823e35b-6207-41c5-895b-a1e5b870f40a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93f7aa939aac422ab88426d71f76dbfd', 'request_id': 'req-c823e35b-6207-41c5-895b-a1e5b870f40a'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:57.747027 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-c823e35b-6207-41c5-895b-a1e5b870f40a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93f7aa939aac422ab88426d71f76dbfd', 'request_id': 'req-c823e35b-6207-41c5-895b-a1e5b870f40a'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:57.753909 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-c823e35b-6207-41c5-895b-a1e5b870f40a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93f7aa939aac422ab88426d71f76dbfd', 'request_id': 'req-c823e35b-6207-41c5-895b-a1e5b870f40a'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:57.766339 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-c823e35b-6207-41c5-895b-a1e5b870f40a admin admin] The token cache is being invalidate because project 93f7aa939aac422ab88426d71f76dbfd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:24:57.766632 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-c823e35b-6207-41c5-895b-a1e5b870f40a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:57.767416 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-c823e35b-6207-41c5-895b-a1e5b870f40a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:57.769010 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1360/2736] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 5 12:24:57 2022] DELETE /identity/v3/projects/93f7aa939aac422ab88426d71f76dbfd => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:24:57.775148 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41129e1-7fa4-4ff3-a620-92a234e22c0a None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:57.775747 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41129e1-7fa4-4ff3-a620-92a234e22c0a None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:57.776014 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41129e1-7fa4-4ff3-a620-92a234e22c0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:57.803854 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-c41129e1-7fa4-4ff3-a620-92a234e22c0a None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:24:57.805112 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-c41129e1-7fa4-4ff3-a620-92a234e22c0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:57.885587 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1377/2737] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:24:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:24:57.895864 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8444d68-938a-4471-b28f-e9e4d79f34f4 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:57.896412 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8444d68-938a-4471-b28f-e9e4d79f34f4 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:57.896660 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8444d68-938a-4471-b28f-e9e4d79f34f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:57.919545 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-e8444d68-938a-4471-b28f-e9e4d79f34f4 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:24:57.920799 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-e8444d68-938a-4471-b28f-e9e4d79f34f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:57.929213 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1361/2738] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:24:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:24:57.933714 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41129e1-7fa4-4ff3-a620-92a234e22c0a None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:57.944831 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41129e1-7fa4-4ff3-a620-92a234e22c0a None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:57.950569 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f8a1c4-1fd8-4a57-82a7-4e6a87c29bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:57.951204 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f8a1c4-1fd8-4a57-82a7-4e6a87c29bc4 admin admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:57.951488 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f8a1c4-1fd8-4a57-82a7-4e6a87c29bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:57.951765 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f8a1c4-1fd8-4a57-82a7-4e6a87c29bc4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:57.953033 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f8a1c4-1fd8-4a57-82a7-4e6a87c29bc4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:24:57.953380 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f8a1c4-1fd8-4a57-82a7-4e6a87c29bc4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:57.955150 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f8a1c4-1fd8-4a57-82a7-4e6a87c29bc4 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:57.967874 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1378/2739] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Sep 5 12:24:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:24:57.972682 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8444d68-938a-4471-b28f-e9e4d79f34f4 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:57.982833 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8444d68-938a-4471-b28f-e9e4d79f34f4 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:57.987651 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f2f61f-4ed3-4ba3-bed8-9d5bb821b047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:57.988268 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f2f61f-4ed3-4ba3-bed8-9d5bb821b047 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:57.988551 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f2f61f-4ed3-4ba3-bed8-9d5bb821b047 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:57.988826 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f2f61f-4ed3-4ba3-bed8-9d5bb821b047 admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:57.989500 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f2f61f-4ed3-4ba3-bed8-9d5bb821b047 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:57.991417 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f2f61f-4ed3-4ba3-bed8-9d5bb821b047 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:58.022829 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1362/2740] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 5 12:24:57 2022] POST /identity/v3/projects => generated 375 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:24:58.027283 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f8a1c4-1fd8-4a57-82a7-4e6a87c29bc4 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:58.037849 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f8a1c4-1fd8-4a57-82a7-4e6a87c29bc4 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:58.081922 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:24:58.099977 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88282d1-0f42-4c54-952d-96ac157f1b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:58.100588 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88282d1-0f42-4c54-952d-96ac157f1b55 admin admin] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:58.100868 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88282d1-0f42-4c54-952d-96ac157f1b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:58.101174 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88282d1-0f42-4c54-952d-96ac157f1b55 admin admin] PATH_INFO: `/v3/users` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:58.101818 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88282d1-0f42-4c54-952d-96ac157f1b55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:58.103748 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88282d1-0f42-4c54-952d-96ac157f1b55 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:58.126529 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1379/2741] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 5 12:24:58 2022] POST /identity/v3/users => generated 288 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:24:58.130731 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f2f61f-4ed3-4ba3-bed8-9d5bb821b047 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:58.142386 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f2f61f-4ed3-4ba3-bed8-9d5bb821b047 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:58.147055 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473dc91e-897a-4b40-9f57-33a78b96fc87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:58.147650 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473dc91e-897a-4b40-9f57-33a78b96fc87 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:58.147923 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473dc91e-897a-4b40-9f57-33a78b96fc87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:58.148191 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473dc91e-897a-4b40-9f57-33a78b96fc87 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:58.148827 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473dc91e-897a-4b40-9f57-33a78b96fc87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:58.150435 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473dc91e-897a-4b40-9f57-33a78b96fc87 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:58.160588 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1363/2742] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:24:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:24:58.164558 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88282d1-0f42-4c54-952d-96ac157f1b55 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:58.175258 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88282d1-0f42-4c54-952d-96ac157f1b55 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:58.179805 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb511f0-6a93-48f3-aea6-128f7013ec04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:58.180402 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb511f0-6a93-48f3-aea6-128f7013ec04 admin admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:58.180683 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb511f0-6a93-48f3-aea6-128f7013ec04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:58.180993 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb511f0-6a93-48f3-aea6-128f7013ec04 admin admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:58.181635 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb511f0-6a93-48f3-aea6-128f7013ec04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:58.183209 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb511f0-6a93-48f3-aea6-128f7013ec04 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:58.194181 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1380/2743] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:24:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:24:58.198323 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473dc91e-897a-4b40-9f57-33a78b96fc87 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:58.208654 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473dc91e-897a-4b40-9f57-33a78b96fc87 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:58.214237 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6618e458-aca8-4419-a6bc-f8153fbb5c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:58.214893 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6618e458-aca8-4419-a6bc-f8153fbb5c76 admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:58.215172 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6618e458-aca8-4419-a6bc-f8153fbb5c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:58.215443 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6618e458-aca8-4419-a6bc-f8153fbb5c76 admin admin] PATH_INFO: `/v3/projects/3a3e652ee4c4458ab3e83ea96450cc08/users/e46454e874644bbcb0490539840b4b39/roles/ed72181e1403401facb77dcf33644757` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:58.230301 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6618e458-aca8-4419-a6bc-f8153fbb5c76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a3e652ee4c4458ab3e83ea96450cc08, user_id=e46454e874644bbcb0490539840b4b39, role_id=ed72181e1403401facb77dcf33644757)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:58.232957 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6618e458-aca8-4419-a6bc-f8153fbb5c76 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:58.247092 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1364/2744] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 5 12:24:58 2022] PUT /identity/v3/projects/3a3e652ee4c4458ab3e83ea96450cc08/users/e46454e874644bbcb0490539840b4b39/roles/ed72181e1403401facb77dcf33644757 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:24:58.258864 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296d0ea4-2b46-4c0d-8fd7-c3095712060e None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:58.259149 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296d0ea4-2b46-4c0d-8fd7-c3095712060e None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:58.259427 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296d0ea4-2b46-4c0d-8fd7-c3095712060e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:58.297570 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-296d0ea4-2b46-4c0d-8fd7-c3095712060e None None] MFA Rules not processed for user `e46454e874644bbcb0490539840b4b39`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:24:58.298802 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-296d0ea4-2b46-4c0d-8fd7-c3095712060e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:58.365693 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1381/2745] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:24:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:24:58.370392 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6618e458-aca8-4419-a6bc-f8153fbb5c76 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:58.383703 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:24:58.437980 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6618e458-aca8-4419-a6bc-f8153fbb5c76 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:58.442492 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df56a5e-d28e-4081-85e6-b11b678b26dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:58.443093 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df56a5e-d28e-4081-85e6-b11b678b26dd admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:58.443376 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df56a5e-d28e-4081-85e6-b11b678b26dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:58.443649 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df56a5e-d28e-4081-85e6-b11b678b26dd admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:58.444272 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df56a5e-d28e-4081-85e6-b11b678b26dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:58.446263 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df56a5e-d28e-4081-85e6-b11b678b26dd admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:58.471832 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1365/2746] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 5 12:24:58 2022] POST /identity/v3/projects => generated 375 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:24:58.476081 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296d0ea4-2b46-4c0d-8fd7-c3095712060e None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:58.487551 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296d0ea4-2b46-4c0d-8fd7-c3095712060e None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:58.543387 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cf7676-f837-42a1-87f1-9d0f038e7567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:58.544030 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cf7676-f837-42a1-87f1-9d0f038e7567 admin admin] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:58.544333 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cf7676-f837-42a1-87f1-9d0f038e7567 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:58.544604 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cf7676-f837-42a1-87f1-9d0f038e7567 admin admin] PATH_INFO: `/v3/users` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:58.545261 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cf7676-f837-42a1-87f1-9d0f038e7567 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:58.547674 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cf7676-f837-42a1-87f1-9d0f038e7567 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:58.572942 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1382/2747] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 5 12:24:58 2022] POST /identity/v3/users => generated 294 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:24:58.575586 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df56a5e-d28e-4081-85e6-b11b678b26dd admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:58.586073 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df56a5e-d28e-4081-85e6-b11b678b26dd admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:58.590762 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccbc6cc-8a21-4244-ad69-99475dac999c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:58.591356 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccbc6cc-8a21-4244-ad69-99475dac999c admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:58.591635 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccbc6cc-8a21-4244-ad69-99475dac999c admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:58.591906 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccbc6cc-8a21-4244-ad69-99475dac999c admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:58.592592 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccbc6cc-8a21-4244-ad69-99475dac999c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:58.594235 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccbc6cc-8a21-4244-ad69-99475dac999c admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:58.605325 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1366/2748] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:24:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:24:58.610175 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cf7676-f837-42a1-87f1-9d0f038e7567 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:58.619036 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccbc6cc-8a21-4244-ad69-99475dac999c admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:58.620736 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-6ccbc6cc-8a21-4244-ad69-99475dac999c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:58.621063 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cf7676-f837-42a1-87f1-9d0f038e7567 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:58.626285 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18f66f3-41b1-439e-85c0-296b91f349f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:58.626947 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18f66f3-41b1-439e-85c0-296b91f349f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:58.627226 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18f66f3-41b1-439e-85c0-296b91f349f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:58.627503 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18f66f3-41b1-439e-85c0-296b91f349f6 admin admin] PATH_INFO: `/v3/projects/bbe52ba0d39d407584ce51d4dc6e1b9c/users/8b2e4e82d9154558a607ff421db3c7f0/roles/16e2ccc8bd1b497d8cee780c1c7df0d2` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:58.633935 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccbc6cc-8a21-4244-ad69-99475dac999c admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:58.638779 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7ceab7-ca2d-4c89-b5da-71776ea52b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:58.639470 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7ceab7-ca2d-4c89-b5da-71776ea52b4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:58.639754 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7ceab7-ca2d-4c89-b5da-71776ea52b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:58.640033 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7ceab7-ca2d-4c89-b5da-71776ea52b4e admin admin] PATH_INFO: `/v3/users/0ecedc53f046404c9a51478e752185e1` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:58.641435 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7ceab7-ca2d-4c89-b5da-71776ea52b4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ecedc53f046404c9a51478e752185e1)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:58.643033 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18f66f3-41b1-439e-85c0-296b91f349f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbe52ba0d39d407584ce51d4dc6e1b9c, user_id=8b2e4e82d9154558a607ff421db3c7f0, role_id=16e2ccc8bd1b497d8cee780c1c7df0d2)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:58.643342 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7ceab7-ca2d-4c89-b5da-71776ea52b4e admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:58.645695 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18f66f3-41b1-439e-85c0-296b91f349f6 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:58.662183 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1383/2749] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 5 12:24:58 2022] PUT /identity/v3/projects/bbe52ba0d39d407584ce51d4dc6e1b9c/users/8b2e4e82d9154558a607ff421db3c7f0/roles/16e2ccc8bd1b497d8cee780c1c7df0d2 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:24:58.666245 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18f66f3-41b1-439e-85c0-296b91f349f6 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:58.689646 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:24:58.695906 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-ab7ceab7-ca2d-4c89-b5da-71776ea52b4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ecedc53f046404c9a51478e752185e1'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:58.696580 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-ab7ceab7-ca2d-4c89-b5da-71776ea52b4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ecedc53f046404c9a51478e752185e1'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:58.705555 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-ab7ceab7-ca2d-4c89-b5da-71776ea52b4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ecedc53f046404c9a51478e752185e1'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:58.706180 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-ab7ceab7-ca2d-4c89-b5da-71776ea52b4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ecedc53f046404c9a51478e752185e1'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:58.719688 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-ab7ceab7-ca2d-4c89-b5da-71776ea52b4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ecedc53f046404c9a51478e752185e1'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:58.736339 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1367/2750] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 5 12:24:58 2022] DELETE /identity/v3/users/0ecedc53f046404c9a51478e752185e1 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 12:24:58.738221 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18f66f3-41b1-439e-85c0-296b91f349f6 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:58.740946 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54302c57-cb46-48ea-8506-559fbc092e20 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:58.741235 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54302c57-cb46-48ea-8506-559fbc092e20 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:58.741509 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54302c57-cb46-48ea-8506-559fbc092e20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:58.760482 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-54302c57-cb46-48ea-8506-559fbc092e20 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:24:58.761730 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-54302c57-cb46-48ea-8506-559fbc092e20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:58.800415 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce3a8a0-cf28-4ae5-a574-2063c047396f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:58.801745 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce3a8a0-cf28-4ae5-a574-2063c047396f admin admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:58.801745 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce3a8a0-cf28-4ae5-a574-2063c047396f admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:58.801972 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce3a8a0-cf28-4ae5-a574-2063c047396f admin admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:58.802606 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce3a8a0-cf28-4ae5-a574-2063c047396f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:58.804199 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce3a8a0-cf28-4ae5-a574-2063c047396f admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:58.812849 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:24:58.814176 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1384/2751] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:24:58 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 05 12:24:58.818775 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce3a8a0-cf28-4ae5-a574-2063c047396f admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:58.820517 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-4ce3a8a0-cf28-4ae5-a574-2063c047396f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:58.824406 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1368/2752] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:24:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 12:24:58.833638 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce3a8a0-cf28-4ae5-a574-2063c047396f admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:58.833977 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54302c57-cb46-48ea-8506-559fbc092e20 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:58.835086 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-54302c57-cb46-48ea-8506-559fbc092e20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:58.838574 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db79ee4-8942-421b-b683-4d40b64603db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:58.839289 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db79ee4-8942-421b-b683-4d40b64603db admin admin] REQUEST_METHOD: `PUT` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:58.839602 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db79ee4-8942-421b-b683-4d40b64603db admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:58.839880 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db79ee4-8942-421b-b683-4d40b64603db admin admin] PATH_INFO: `/v3/projects/bbe52ba0d39d407584ce51d4dc6e1b9c/users/8b2e4e82d9154558a607ff421db3c7f0/roles/16e2ccc8bd1b497d8cee780c1c7df0d2` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:58.842021 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db79ee4-8942-421b-b683-4d40b64603db admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbe52ba0d39d407584ce51d4dc6e1b9c, user_id=8b2e4e82d9154558a607ff421db3c7f0, role_id=16e2ccc8bd1b497d8cee780c1c7df0d2)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:58.845236 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db79ee4-8942-421b-b683-4d40b64603db admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:58.856060 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1385/2753] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 5 12:24:58 2022] PUT /identity/v3/projects/bbe52ba0d39d407584ce51d4dc6e1b9c/users/8b2e4e82d9154558a607ff421db3c7f0/roles/16e2ccc8bd1b497d8cee780c1c7df0d2 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 12:24:58.868441 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e9c2d8-9879-4eea-8b9d-0a8aa38c2b18 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:58.868744 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e9c2d8-9879-4eea-8b9d-0a8aa38c2b18 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:58.869043 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e9c2d8-9879-4eea-8b9d-0a8aa38c2b18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:58.893826 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54302c57-cb46-48ea-8506-559fbc092e20 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:58.897655 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-15e9c2d8-9879-4eea-8b9d-0a8aa38c2b18 None None] MFA Rules not processed for user `8b2e4e82d9154558a607ff421db3c7f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:24:58.898910 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-15e9c2d8-9879-4eea-8b9d-0a8aa38c2b18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:58.947556 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca582c36-f377-47cc-b353-0e3599dcb5fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4994b4faa4ec4aa088f3dc32c9c5614d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:58.948173 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca582c36-f377-47cc-b353-0e3599dcb5fb service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:58.948671 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca582c36-f377-47cc-b353-0e3599dcb5fb service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:58.949022 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca582c36-f377-47cc-b353-0e3599dcb5fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:58.971238 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1386/2754] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:24:58 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 12:24:58.982922 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e9c2d8-9879-4eea-8b9d-0a8aa38c2b18 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:58.984960 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-15e9c2d8-9879-4eea-8b9d-0a8aa38c2b18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:59.013360 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca582c36-f377-47cc-b353-0e3599dcb5fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:59.014932 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca582c36-f377-47cc-b353-0e3599dcb5fb service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:59.020842 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:24:59.025984 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1369/2755] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:24:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 12:24:59.046527 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e9c2d8-9879-4eea-8b9d-0a8aa38c2b18 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:59.050225 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772b8d17-64dd-4102-afbf-0e990049a4a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37633bbae0c2423c81ccd61ac3a17ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:59.050832 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772b8d17-64dd-4102-afbf-0e990049a4a0 service cinder] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:59.051119 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772b8d17-64dd-4102-afbf-0e990049a4a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:59.051388 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772b8d17-64dd-4102-afbf-0e990049a4a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:59.053251 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-772b8d17-64dd-4102-afbf-0e990049a4a0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:59.125042 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772b8d17-64dd-4102-afbf-0e990049a4a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:59.126505 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772b8d17-64dd-4102-afbf-0e990049a4a0 service cinder] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:59.136190 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1387/2756] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:24:58 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 12:24:59.347102 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca582c36-f377-47cc-b353-0e3599dcb5fb service neutron] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:59.349440 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-ca582c36-f377-47cc-b353-0e3599dcb5fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:24:59.396462 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca582c36-f377-47cc-b353-0e3599dcb5fb service neutron] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:59.403045 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f97d9f-af2d-4766-a70d-c0482112308c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:59.403825 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f97d9f-af2d-4766-a70d-c0482112308c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:59.404238 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f97d9f-af2d-4766-a70d-c0482112308c admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:59.404526 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f97d9f-af2d-4766-a70d-c0482112308c admin admin] PATH_INFO: `/v3/projects/963e487bbdc24032bb456d3daa938627` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:59.407164 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f97d9f-af2d-4766-a70d-c0482112308c admin admin] RBAC: Authorizing `identity:delete_project(project_id=963e487bbdc24032bb456d3daa938627)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:59.410029 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f97d9f-af2d-4766-a70d-c0482112308c admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:59.466034 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-e0f97d9f-af2d-4766-a70d-c0482112308c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '963e487bbdc24032bb456d3daa938627', 'request_id': 'req-e0f97d9f-af2d-4766-a70d-c0482112308c'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:59.487922 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-e0f97d9f-af2d-4766-a70d-c0482112308c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '963e487bbdc24032bb456d3daa938627', 'request_id': 'req-e0f97d9f-af2d-4766-a70d-c0482112308c'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:59.490276 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:24:59.496863 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-e0f97d9f-af2d-4766-a70d-c0482112308c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '963e487bbdc24032bb456d3daa938627', 'request_id': 'req-e0f97d9f-af2d-4766-a70d-c0482112308c'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:59.533139 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-e0f97d9f-af2d-4766-a70d-c0482112308c admin admin] The token cache is being invalidate because project 963e487bbdc24032bb456d3daa938627 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:24:59.533139 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-e0f97d9f-af2d-4766-a70d-c0482112308c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:59.533139 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-e0f97d9f-af2d-4766-a70d-c0482112308c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:59.535916 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1370/2757] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 5 12:24:59 2022] DELETE /identity/v3/projects/963e487bbdc24032bb456d3daa938627 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:24:59.537082 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772b8d17-64dd-4102-afbf-0e990049a4a0 service cinder] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:24:59.569166 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772b8d17-64dd-4102-afbf-0e990049a4a0 service cinder] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:24:59.647463 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb3055b-f1ba-451c-8052-ecccf0798b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:24:59.648096 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb3055b-f1ba-451c-8052-ecccf0798b70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:24:59.648377 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb3055b-f1ba-451c-8052-ecccf0798b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:24:59.648644 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb3055b-f1ba-451c-8052-ecccf0798b70 admin admin] PATH_INFO: `/v3/users/145cf907615345ae915410011c39ee9d` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:24:59.649797 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb3055b-f1ba-451c-8052-ecccf0798b70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=145cf907615345ae915410011c39ee9d)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:24:59.651690 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb3055b-f1ba-451c-8052-ecccf0798b70 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:24:59.698342 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:24:59.700334 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-2fb3055b-f1ba-451c-8052-ecccf0798b70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '145cf907615345ae915410011c39ee9d'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:59.701369 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-2fb3055b-f1ba-451c-8052-ecccf0798b70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '145cf907615345ae915410011c39ee9d'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:59.709542 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-2fb3055b-f1ba-451c-8052-ecccf0798b70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '145cf907615345ae915410011c39ee9d'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:59.710417 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-2fb3055b-f1ba-451c-8052-ecccf0798b70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '145cf907615345ae915410011c39ee9d'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:59.724227 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-2fb3055b-f1ba-451c-8052-ecccf0798b70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '145cf907615345ae915410011c39ee9d'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:24:59.736916 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1388/2758] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 5 12:24:59 2022] DELETE /identity/v3/users/145cf907615345ae915410011c39ee9d => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:25:00.019103 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f97d9f-af2d-4766-a70d-c0482112308c admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:25:00.020547 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-e0f97d9f-af2d-4766-a70d-c0482112308c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:25:00.079231 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f97d9f-af2d-4766-a70d-c0482112308c admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:25:00.136319 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014702d3-3b5b-4fa6-9f10-58b17e195072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:25:00.136990 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014702d3-3b5b-4fa6-9f10-58b17e195072 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:25:00.137275 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014702d3-3b5b-4fa6-9f10-58b17e195072 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:25:00.137549 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014702d3-3b5b-4fa6-9f10-58b17e195072 admin admin] PATH_INFO: `/v3/projects/ac1b1ef089b04fcbb2b2700adbe7fad6` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:25:00.138700 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014702d3-3b5b-4fa6-9f10-58b17e195072 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac1b1ef089b04fcbb2b2700adbe7fad6)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:25:00.141398 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014702d3-3b5b-4fa6-9f10-58b17e195072 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:25:00.191697 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-014702d3-3b5b-4fa6-9f10-58b17e195072 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac1b1ef089b04fcbb2b2700adbe7fad6', 'request_id': 'req-014702d3-3b5b-4fa6-9f10-58b17e195072'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:25:00.199447 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-014702d3-3b5b-4fa6-9f10-58b17e195072 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac1b1ef089b04fcbb2b2700adbe7fad6', 'request_id': 'req-014702d3-3b5b-4fa6-9f10-58b17e195072'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:25:00.206741 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-014702d3-3b5b-4fa6-9f10-58b17e195072 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac1b1ef089b04fcbb2b2700adbe7fad6', 'request_id': 'req-014702d3-3b5b-4fa6-9f10-58b17e195072'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:25:00.217548 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-014702d3-3b5b-4fa6-9f10-58b17e195072 admin admin] The token cache is being invalidate because project ac1b1ef089b04fcbb2b2700adbe7fad6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:25:00.217842 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-014702d3-3b5b-4fa6-9f10-58b17e195072 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:25:00.218522 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-014702d3-3b5b-4fa6-9f10-58b17e195072 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:25:00.220061 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1371/2759] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 5 12:25:00 2022] DELETE /identity/v3/projects/ac1b1ef089b04fcbb2b2700adbe7fad6 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:25:00.224126 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb3055b-f1ba-451c-8052-ecccf0798b70 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:25:00.225591 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-2fb3055b-f1ba-451c-8052-ecccf0798b70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:25:00.238456 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb3055b-f1ba-451c-8052-ecccf0798b70 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:25:00.297767 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f1d74b-56f7-4079-81ab-01df2d1a9769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:25:00.298348 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f1d74b-56f7-4079-81ab-01df2d1a9769 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:25:00.298644 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f1d74b-56f7-4079-81ab-01df2d1a9769 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:25:00.298902 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f1d74b-56f7-4079-81ab-01df2d1a9769 admin admin] PATH_INFO: `/v3/users/8122434a84df47808d728fe1fecbad33` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:25:00.300041 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f1d74b-56f7-4079-81ab-01df2d1a9769 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8122434a84df47808d728fe1fecbad33)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:25:00.301994 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f1d74b-56f7-4079-81ab-01df2d1a9769 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:25:00.349454 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-55f1d74b-56f7-4079-81ab-01df2d1a9769 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8122434a84df47808d728fe1fecbad33'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:25:00.350132 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-55f1d74b-56f7-4079-81ab-01df2d1a9769 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8122434a84df47808d728fe1fecbad33'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:25:00.359123 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-55f1d74b-56f7-4079-81ab-01df2d1a9769 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8122434a84df47808d728fe1fecbad33'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:25:00.360176 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-55f1d74b-56f7-4079-81ab-01df2d1a9769 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8122434a84df47808d728fe1fecbad33'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:25:00.378297 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-55f1d74b-56f7-4079-81ab-01df2d1a9769 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8122434a84df47808d728fe1fecbad33'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:25:00.392928 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1389/2760] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 5 12:25:00 2022] DELETE /identity/v3/users/8122434a84df47808d728fe1fecbad33 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:25:00.690940 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014702d3-3b5b-4fa6-9f10-58b17e195072 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:25:00.692661 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-014702d3-3b5b-4fa6-9f10-58b17e195072 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:25:00.706625 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014702d3-3b5b-4fa6-9f10-58b17e195072 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:25:00.732042 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:25:00.793356 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1941794c-481b-40fa-a4a3-7e196709a1e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:25:00.793858 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1941794c-481b-40fa-a4a3-7e196709a1e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:25:00.794137 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1941794c-481b-40fa-a4a3-7e196709a1e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:25:00.794409 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1941794c-481b-40fa-a4a3-7e196709a1e7 admin admin] PATH_INFO: `/v3/projects/7c98e652179640b291d1ab5144199ce3` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:25:00.796211 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1941794c-481b-40fa-a4a3-7e196709a1e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c98e652179640b291d1ab5144199ce3)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:25:00.798180 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1941794c-481b-40fa-a4a3-7e196709a1e7 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:25:00.852348 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-1941794c-481b-40fa-a4a3-7e196709a1e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c98e652179640b291d1ab5144199ce3', 'request_id': 'req-1941794c-481b-40fa-a4a3-7e196709a1e7'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:25:00.860870 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-1941794c-481b-40fa-a4a3-7e196709a1e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c98e652179640b291d1ab5144199ce3', 'request_id': 'req-1941794c-481b-40fa-a4a3-7e196709a1e7'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:25:00.871657 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-1941794c-481b-40fa-a4a3-7e196709a1e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c98e652179640b291d1ab5144199ce3', 'request_id': 'req-1941794c-481b-40fa-a4a3-7e196709a1e7'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:25:00.895188 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-1941794c-481b-40fa-a4a3-7e196709a1e7 admin admin] The token cache is being invalidate because project 7c98e652179640b291d1ab5144199ce3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:25:00.895578 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-1941794c-481b-40fa-a4a3-7e196709a1e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:25:00.896248 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-1941794c-481b-40fa-a4a3-7e196709a1e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:25:00.898773 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1372/2761] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 5 12:25:00 2022] DELETE /identity/v3/projects/7c98e652179640b291d1ab5144199ce3 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:25:00.907468 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b85a1a-2d11-4c71-b1d9-b5eaf54f9807 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:25:00.907811 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b85a1a-2d11-4c71-b1d9-b5eaf54f9807 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:25:00.908233 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b85a1a-2d11-4c71-b1d9-b5eaf54f9807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:25:00.978530 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-e7b85a1a-2d11-4c71-b1d9-b5eaf54f9807 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:25:00.979771 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-e7b85a1a-2d11-4c71-b1d9-b5eaf54f9807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:25:00.986372 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:25:01.047625 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1390/2762] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:25:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:25:01.055578 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ee23ed-405a-4647-9e79-3616fdcc2daa None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:25:01.055795 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ee23ed-405a-4647-9e79-3616fdcc2daa None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:25:01.056081 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ee23ed-405a-4647-9e79-3616fdcc2daa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:25:01.075440 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-70ee23ed-405a-4647-9e79-3616fdcc2daa None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:25:01.076644 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-70ee23ed-405a-4647-9e79-3616fdcc2daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:25:01.084388 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1373/2763] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:25:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:25:01.088646 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b85a1a-2d11-4c71-b1d9-b5eaf54f9807 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:25:01.098578 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b85a1a-2d11-4c71-b1d9-b5eaf54f9807 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:25:01.103013 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3364dab-8d16-4580-8e29-91b65accbe5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:25:01.103598 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3364dab-8d16-4580-8e29-91b65accbe5f admin admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:25:01.103872 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3364dab-8d16-4580-8e29-91b65accbe5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:25:01.104145 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3364dab-8d16-4580-8e29-91b65accbe5f admin admin] PATH_INFO: `/v3/domains` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:25:01.104783 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3364dab-8d16-4580-8e29-91b65accbe5f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:25:01.105111 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3364dab-8d16-4580-8e29-91b65accbe5f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:25:01.106677 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3364dab-8d16-4580-8e29-91b65accbe5f admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:25:01.118534 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1391/2764] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Sep 5 12:25:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:25:01.123383 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ee23ed-405a-4647-9e79-3616fdcc2daa None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:25:01.132749 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ee23ed-405a-4647-9e79-3616fdcc2daa None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:25:01.137368 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc6e822-8d1f-43ca-b7f6-dc7c9d075566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:25:01.137958 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc6e822-8d1f-43ca-b7f6-dc7c9d075566 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:25:01.138246 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc6e822-8d1f-43ca-b7f6-dc7c9d075566 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:25:01.138510 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc6e822-8d1f-43ca-b7f6-dc7c9d075566 admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:25:01.139135 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc6e822-8d1f-43ca-b7f6-dc7c9d075566 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:25:01.141392 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc6e822-8d1f-43ca-b7f6-dc7c9d075566 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:25:01.170200 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1374/2765] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 5 12:25:01 2022] POST /identity/v3/projects => generated 381 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:25:01.175089 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3364dab-8d16-4580-8e29-91b65accbe5f admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:25:01.185609 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3364dab-8d16-4580-8e29-91b65accbe5f admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:25:01.243643 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15939e4-9e78-44f7-918e-af3b99938081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:25:01.244342 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15939e4-9e78-44f7-918e-af3b99938081 admin admin] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:25:01.244521 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15939e4-9e78-44f7-918e-af3b99938081 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:25:01.244793 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15939e4-9e78-44f7-918e-af3b99938081 admin admin] PATH_INFO: `/v3/users` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:25:01.245474 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15939e4-9e78-44f7-918e-af3b99938081 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:25:01.247387 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15939e4-9e78-44f7-918e-af3b99938081 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:25:01.268625 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1392/2766] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 5 12:25:01 2022] POST /identity/v3/users => generated 291 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:25:01.272751 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc6e822-8d1f-43ca-b7f6-dc7c9d075566 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:25:01.283467 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc6e822-8d1f-43ca-b7f6-dc7c9d075566 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:25:01.288006 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d4296f-8522-473b-a43a-420466637a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:25:01.288595 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d4296f-8522-473b-a43a-420466637a7a admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:25:01.288876 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d4296f-8522-473b-a43a-420466637a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:25:01.289180 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d4296f-8522-473b-a43a-420466637a7a admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:25:01.289813 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d4296f-8522-473b-a43a-420466637a7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:25:01.291400 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d4296f-8522-473b-a43a-420466637a7a admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:25:01.301686 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1375/2767] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:25:01 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:25:01.307583 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15939e4-9e78-44f7-918e-af3b99938081 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:25:01.317479 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15939e4-9e78-44f7-918e-af3b99938081 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:25:01.322100 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c782f2f-d2bf-4b09-886a-d5872e1c88ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:25:01.322719 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c782f2f-d2bf-4b09-886a-d5872e1c88ff admin admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:25:01.322975 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c782f2f-d2bf-4b09-886a-d5872e1c88ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:25:01.323253 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c782f2f-d2bf-4b09-886a-d5872e1c88ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:25:01.323890 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c782f2f-d2bf-4b09-886a-d5872e1c88ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:25:01.325508 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c782f2f-d2bf-4b09-886a-d5872e1c88ff admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:25:01.336634 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1393/2768] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:25:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:25:01.340872 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d4296f-8522-473b-a43a-420466637a7a admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:25:01.351883 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d4296f-8522-473b-a43a-420466637a7a admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:25:01.356641 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6e96c0-b1b0-4a25-9dea-6645d9ea2f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:25:01.357335 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6e96c0-b1b0-4a25-9dea-6645d9ea2f37 admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:25:01.357641 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6e96c0-b1b0-4a25-9dea-6645d9ea2f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:25:01.357934 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6e96c0-b1b0-4a25-9dea-6645d9ea2f37 admin admin] PATH_INFO: `/v3/projects/e036045fbb844b178d2360fe785161ed/users/00e6ebaaf24040a889df07682cce490b/roles/ed72181e1403401facb77dcf33644757` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:25:01.373344 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6e96c0-b1b0-4a25-9dea-6645d9ea2f37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e036045fbb844b178d2360fe785161ed, user_id=00e6ebaaf24040a889df07682cce490b, role_id=ed72181e1403401facb77dcf33644757)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:25:01.376586 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6e96c0-b1b0-4a25-9dea-6645d9ea2f37 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:25:01.389867 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1376/2769] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 5 12:25:01 2022] PUT /identity/v3/projects/e036045fbb844b178d2360fe785161ed/users/00e6ebaaf24040a889df07682cce490b/roles/ed72181e1403401facb77dcf33644757 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:25:01.395213 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b81b88-262a-4bc7-924e-6362203bd4b4 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:25:01.395504 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b81b88-262a-4bc7-924e-6362203bd4b4 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:25:01.395781 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b81b88-262a-4bc7-924e-6362203bd4b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:25:01.415020 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-59b81b88-262a-4bc7-924e-6362203bd4b4 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:25:01.416187 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-59b81b88-262a-4bc7-924e-6362203bd4b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:25:01.480816 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1394/2770] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:25:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:25:01.491061 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6e96c0-b1b0-4a25-9dea-6645d9ea2f37 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:25:01.492772 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-6f6e96c0-b1b0-4a25-9dea-6645d9ea2f37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:25:01.547471 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:25:01.569432 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6e96c0-b1b0-4a25-9dea-6645d9ea2f37 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:25:01.573150 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b6ab84-ba29-49fb-9035-2d9060ae814a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4994b4faa4ec4aa088f3dc32c9c5614d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:25:01.573766 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b6ab84-ba29-49fb-9035-2d9060ae814a service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:25:01.574045 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b6ab84-ba29-49fb-9035-2d9060ae814a service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:25:01.574316 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b6ab84-ba29-49fb-9035-2d9060ae814a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:25:01.584125 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b6ab84-ba29-49fb-9035-2d9060ae814a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:25:01.585651 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b6ab84-ba29-49fb-9035-2d9060ae814a service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:25:01.595883 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1377/2771] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:25:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:25:01.835649 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b81b88-262a-4bc7-924e-6362203bd4b4 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:25:01.837936 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-59b81b88-262a-4bc7-924e-6362203bd4b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:25:01.851911 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b81b88-262a-4bc7-924e-6362203bd4b4 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:25:01.857384 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1785929a-7280-415e-8e3a-56bf7991dbaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:25:01.859221 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1785929a-7280-415e-8e3a-56bf7991dbaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:25:01.859505 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1785929a-7280-415e-8e3a-56bf7991dbaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:25:01.859817 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1785929a-7280-415e-8e3a-56bf7991dbaf admin admin] PATH_INFO: `/v3/users/e46454e874644bbcb0490539840b4b39` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:25:01.861499 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1785929a-7280-415e-8e3a-56bf7991dbaf admin admin] RBAC: Authorizing `identity:delete_user(user_id=e46454e874644bbcb0490539840b4b39)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:25:01.866078 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1785929a-7280-415e-8e3a-56bf7991dbaf admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:25:01.880488 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:25:01.929419 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-1785929a-7280-415e-8e3a-56bf7991dbaf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e46454e874644bbcb0490539840b4b39'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:25:01.930502 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-1785929a-7280-415e-8e3a-56bf7991dbaf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e46454e874644bbcb0490539840b4b39'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:25:01.942492 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-1785929a-7280-415e-8e3a-56bf7991dbaf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e46454e874644bbcb0490539840b4b39'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:25:01.944255 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-1785929a-7280-415e-8e3a-56bf7991dbaf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e46454e874644bbcb0490539840b4b39'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:25:01.975037 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-1785929a-7280-415e-8e3a-56bf7991dbaf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e46454e874644bbcb0490539840b4b39'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:25:01.999748 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce26c1a3-8e63-4657-9aa8-046a904bd4c2 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:25:01.999748 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce26c1a3-8e63-4657-9aa8-046a904bd4c2 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:25:02.000804 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce26c1a3-8e63-4657-9aa8-046a904bd4c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:25:02.004931 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1395/2772] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 5 12:25:01 2022] DELETE /identity/v3/users/e46454e874644bbcb0490539840b4b39 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:25:02.022371 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-ce26c1a3-8e63-4657-9aa8-046a904bd4c2 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:25:02.023717 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-ce26c1a3-8e63-4657-9aa8-046a904bd4c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:25:02.097391 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1378/2773] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:25:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:25:02.104609 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1785929a-7280-415e-8e3a-56bf7991dbaf admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:25:02.106079 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-1785929a-7280-415e-8e3a-56bf7991dbaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:25:02.168396 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1785929a-7280-415e-8e3a-56bf7991dbaf admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:25:02.172514 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bc3cd1-6279-4dce-ab40-dafd081af9e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4994b4faa4ec4aa088f3dc32c9c5614d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:25:02.173211 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bc3cd1-6279-4dce-ab40-dafd081af9e2 service neutron] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:25:02.173491 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bc3cd1-6279-4dce-ab40-dafd081af9e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:25:02.173765 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bc3cd1-6279-4dce-ab40-dafd081af9e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:25:02.183924 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bc3cd1-6279-4dce-ab40-dafd081af9e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:25:02.185434 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bc3cd1-6279-4dce-ab40-dafd081af9e2 service neutron] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:25:02.196761 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1396/2774] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:25:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:25:02.505746 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce26c1a3-8e63-4657-9aa8-046a904bd4c2 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:25:02.507328 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-ce26c1a3-8e63-4657-9aa8-046a904bd4c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:25:02.523719 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce26c1a3-8e63-4657-9aa8-046a904bd4c2 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:25:02.529620 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45a361c-971e-436a-9122-34adadcc002b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:25:02.530293 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45a361c-971e-436a-9122-34adadcc002b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:25:02.530655 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45a361c-971e-436a-9122-34adadcc002b admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:25:02.530920 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45a361c-971e-436a-9122-34adadcc002b admin admin] PATH_INFO: `/v3/projects/3a3e652ee4c4458ab3e83ea96450cc08` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:25:02.532199 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45a361c-971e-436a-9122-34adadcc002b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a3e652ee4c4458ab3e83ea96450cc08)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:25:02.534267 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45a361c-971e-436a-9122-34adadcc002b admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:25:02.587581 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-d45a361c-971e-436a-9122-34adadcc002b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a3e652ee4c4458ab3e83ea96450cc08', 'request_id': 'req-d45a361c-971e-436a-9122-34adadcc002b'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:25:02.595915 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-d45a361c-971e-436a-9122-34adadcc002b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a3e652ee4c4458ab3e83ea96450cc08', 'request_id': 'req-d45a361c-971e-436a-9122-34adadcc002b'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:25:02.603891 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-d45a361c-971e-436a-9122-34adadcc002b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a3e652ee4c4458ab3e83ea96450cc08', 'request_id': 'req-d45a361c-971e-436a-9122-34adadcc002b'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:25:02.617647 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-d45a361c-971e-436a-9122-34adadcc002b admin admin] The token cache is being invalidate because project 3a3e652ee4c4458ab3e83ea96450cc08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:25:02.618080 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-d45a361c-971e-436a-9122-34adadcc002b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:25:02.619060 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-d45a361c-971e-436a-9122-34adadcc002b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:25:02.622135 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1379/2775] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 5 12:25:02 2022] DELETE /identity/v3/projects/3a3e652ee4c4458ab3e83ea96450cc08 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:25:02.627377 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a126d1-ff4c-47b6-9cee-86bdc7343f1e None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:25:02.627924 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a126d1-ff4c-47b6-9cee-86bdc7343f1e None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:25:02.628113 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a126d1-ff4c-47b6-9cee-86bdc7343f1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:25:02.630469 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45a361c-971e-436a-9122-34adadcc002b admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:25:02.631953 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-d45a361c-971e-436a-9122-34adadcc002b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:25:02.658845 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-90a126d1-ff4c-47b6-9cee-86bdc7343f1e None None] MFA Rules not processed for user `00e6ebaaf24040a889df07682cce490b`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:25:02.660420 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-90a126d1-ff4c-47b6-9cee-86bdc7343f1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:25:02.709580 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45a361c-971e-436a-9122-34adadcc002b admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:25:02.718759 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f3a48e-e192-4ae0-91d6-93007608dcc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:25:02.719410 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f3a48e-e192-4ae0-91d6-93007608dcc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:25:02.719690 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f3a48e-e192-4ae0-91d6-93007608dcc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:25:02.719965 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f3a48e-e192-4ae0-91d6-93007608dcc5 admin admin] PATH_INFO: `/v3/users/8b2e4e82d9154558a607ff421db3c7f0` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:25:02.721412 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f3a48e-e192-4ae0-91d6-93007608dcc5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b2e4e82d9154558a607ff421db3c7f0)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:25:02.723524 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f3a48e-e192-4ae0-91d6-93007608dcc5 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:25:02.727550 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:25:02.738488 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1397/2776] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:25:02 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:25:02.751064 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a126d1-ff4c-47b6-9cee-86bdc7343f1e None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:25:02.752497 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-90a126d1-ff4c-47b6-9cee-86bdc7343f1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:25:02.803006 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-41f3a48e-e192-4ae0-91d6-93007608dcc5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b2e4e82d9154558a607ff421db3c7f0'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:25:02.803737 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-41f3a48e-e192-4ae0-91d6-93007608dcc5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b2e4e82d9154558a607ff421db3c7f0'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:25:02.807104 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:25:02.814392 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-41f3a48e-e192-4ae0-91d6-93007608dcc5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b2e4e82d9154558a607ff421db3c7f0'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:25:02.815588 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-41f3a48e-e192-4ae0-91d6-93007608dcc5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b2e4e82d9154558a607ff421db3c7f0'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:25:02.835944 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-41f3a48e-e192-4ae0-91d6-93007608dcc5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b2e4e82d9154558a607ff421db3c7f0'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:25:02.861077 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1380/2777] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 5 12:25:02 2022] DELETE /identity/v3/users/8b2e4e82d9154558a607ff421db3c7f0 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 12:25:02.869358 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a126d1-ff4c-47b6-9cee-86bdc7343f1e None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:25:02.933729 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e27dcc-500b-47c7-89ed-b5ee4e1b0dbf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37633bbae0c2423c81ccd61ac3a17ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:25:02.934396 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e27dcc-500b-47c7-89ed-b5ee4e1b0dbf service cinder] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:25:02.934678 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e27dcc-500b-47c7-89ed-b5ee4e1b0dbf service cinder] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:25:02.934950 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e27dcc-500b-47c7-89ed-b5ee4e1b0dbf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:25:02.937489 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-16e27dcc-500b-47c7-89ed-b5ee4e1b0dbf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:25:03.002012 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e27dcc-500b-47c7-89ed-b5ee4e1b0dbf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:25:03.003568 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e27dcc-500b-47c7-89ed-b5ee4e1b0dbf service cinder] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:25:03.012883 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1398/2778] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:25:02 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 12:25:03.153911 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f3a48e-e192-4ae0-91d6-93007608dcc5 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:25:03.155898 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-41f3a48e-e192-4ae0-91d6-93007608dcc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:25:03.246933 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f3a48e-e192-4ae0-91d6-93007608dcc5 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:25:03.252523 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c15b49-3e63-4c6a-a03c-11a77894a85b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:25:03.253289 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c15b49-3e63-4c6a-a03c-11a77894a85b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:25:03.253629 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c15b49-3e63-4c6a-a03c-11a77894a85b admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:25:03.253910 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c15b49-3e63-4c6a-a03c-11a77894a85b admin admin] PATH_INFO: `/v3/projects/bbe52ba0d39d407584ce51d4dc6e1b9c` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:25:03.255168 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c15b49-3e63-4c6a-a03c-11a77894a85b admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbe52ba0d39d407584ce51d4dc6e1b9c)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:25:03.257571 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c15b49-3e63-4c6a-a03c-11a77894a85b admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:25:03.317926 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-d5c15b49-3e63-4c6a-a03c-11a77894a85b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbe52ba0d39d407584ce51d4dc6e1b9c', 'request_id': 'req-d5c15b49-3e63-4c6a-a03c-11a77894a85b'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:25:03.327989 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-d5c15b49-3e63-4c6a-a03c-11a77894a85b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbe52ba0d39d407584ce51d4dc6e1b9c', 'request_id': 'req-d5c15b49-3e63-4c6a-a03c-11a77894a85b'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:25:03.335995 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-d5c15b49-3e63-4c6a-a03c-11a77894a85b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbe52ba0d39d407584ce51d4dc6e1b9c', 'request_id': 'req-d5c15b49-3e63-4c6a-a03c-11a77894a85b'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:25:03.353516 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-d5c15b49-3e63-4c6a-a03c-11a77894a85b admin admin] The token cache is being invalidate because project bbe52ba0d39d407584ce51d4dc6e1b9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:25:03.353516 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-d5c15b49-3e63-4c6a-a03c-11a77894a85b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:25:03.353516 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-d5c15b49-3e63-4c6a-a03c-11a77894a85b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:25:03.353516 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1381/2779] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 5 12:25:03 2022] DELETE /identity/v3/projects/bbe52ba0d39d407584ce51d4dc6e1b9c => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:25:03.356660 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe252e6-a1ed-4991-9c18-97ee671b1179 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:25:03.356972 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe252e6-a1ed-4991-9c18-97ee671b1179 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:25:03.357251 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe252e6-a1ed-4991-9c18-97ee671b1179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:25:03.382903 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-bbe252e6-a1ed-4991-9c18-97ee671b1179 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:25:03.384029 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-bbe252e6-a1ed-4991-9c18-97ee671b1179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:25:03.444987 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1399/2780] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:25:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 12:25:03.452737 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf40edfa-eabb-4802-8d12-f88eaccac0ca None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:25:03.453058 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf40edfa-eabb-4802-8d12-f88eaccac0ca None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:25:03.453331 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf40edfa-eabb-4802-8d12-f88eaccac0ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:25:03.475342 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-bf40edfa-eabb-4802-8d12-f88eaccac0ca None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:25:03.476565 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-bf40edfa-eabb-4802-8d12-f88eaccac0ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:25:03.485252 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1382/2781] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:25:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:25:03.489567 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe252e6-a1ed-4991-9c18-97ee671b1179 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:25:03.500165 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe252e6-a1ed-4991-9c18-97ee671b1179 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:25:03.504981 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fadb2c-cb94-4e9a-b118-aa0c6e487059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:25:03.505586 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fadb2c-cb94-4e9a-b118-aa0c6e487059 admin admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:25:03.505869 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fadb2c-cb94-4e9a-b118-aa0c6e487059 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:25:03.506143 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fadb2c-cb94-4e9a-b118-aa0c6e487059 admin admin] PATH_INFO: `/v3/domains` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:25:03.506794 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fadb2c-cb94-4e9a-b118-aa0c6e487059 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:25:03.507099 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fadb2c-cb94-4e9a-b118-aa0c6e487059 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:25:03.508696 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fadb2c-cb94-4e9a-b118-aa0c6e487059 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:25:03.521805 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1400/2782] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Sep 5 12:25:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:25:03.526019 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf40edfa-eabb-4802-8d12-f88eaccac0ca None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:25:03.532191 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:25:03.536854 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf40edfa-eabb-4802-8d12-f88eaccac0ca None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:25:03.544059 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2ef5c3-f82a-4901-a90e-e30354405a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:25:03.544988 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2ef5c3-f82a-4901-a90e-e30354405a51 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:25:03.546058 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2ef5c3-f82a-4901-a90e-e30354405a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:25:03.546507 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2ef5c3-f82a-4901-a90e-e30354405a51 admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:25:03.547223 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2ef5c3-f82a-4901-a90e-e30354405a51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:25:03.549180 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2ef5c3-f82a-4901-a90e-e30354405a51 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:25:03.577483 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1383/2783] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 5 12:25:03 2022] POST /identity/v3/projects => generated 383 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:25:03.581609 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fadb2c-cb94-4e9a-b118-aa0c6e487059 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:25:03.593298 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fadb2c-cb94-4e9a-b118-aa0c6e487059 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:25:03.611414 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=100 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:25:03.656147 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727864a1-a0c8-45ef-9118-f46c1a30225b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:25:03.656836 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727864a1-a0c8-45ef-9118-f46c1a30225b admin admin] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:25:03.656959 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727864a1-a0c8-45ef-9118-f46c1a30225b admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:25:03.657228 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727864a1-a0c8-45ef-9118-f46c1a30225b admin admin] PATH_INFO: `/v3/users` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:25:03.657864 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727864a1-a0c8-45ef-9118-f46c1a30225b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:25:03.660489 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727864a1-a0c8-45ef-9118-f46c1a30225b admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:25:03.682564 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1401/2784] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 5 12:25:03 2022] POST /identity/v3/users => generated 292 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:25:03.686998 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2ef5c3-f82a-4901-a90e-e30354405a51 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:25:03.697311 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2ef5c3-f82a-4901-a90e-e30354405a51 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:25:03.702392 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa8469d-400e-4e54-9491-f13c81f989db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:25:03.702987 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa8469d-400e-4e54-9491-f13c81f989db admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:25:03.703263 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa8469d-400e-4e54-9491-f13c81f989db admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:25:03.703532 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa8469d-400e-4e54-9491-f13c81f989db admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:25:03.704168 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa8469d-400e-4e54-9491-f13c81f989db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:25:03.705771 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa8469d-400e-4e54-9491-f13c81f989db admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:25:03.716267 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1384/2785] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:25:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:25:03.721180 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727864a1-a0c8-45ef-9118-f46c1a30225b admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:25:03.731086 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727864a1-a0c8-45ef-9118-f46c1a30225b admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:25:03.735719 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6525ae8f-93c2-49fa-9028-0d62e7ba6922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:25:03.736310 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6525ae8f-93c2-49fa-9028-0d62e7ba6922 admin admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:25:03.736591 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6525ae8f-93c2-49fa-9028-0d62e7ba6922 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:25:03.736863 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6525ae8f-93c2-49fa-9028-0d62e7ba6922 admin admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:25:03.737539 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6525ae8f-93c2-49fa-9028-0d62e7ba6922 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:25:03.739133 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6525ae8f-93c2-49fa-9028-0d62e7ba6922 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:25:03.750169 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1402/2786] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:25:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:25:03.754640 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa8469d-400e-4e54-9491-f13c81f989db admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:25:03.765638 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa8469d-400e-4e54-9491-f13c81f989db admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:25:03.770534 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659ebd59-f922-4181-9e63-1b04a01eca82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:25:03.771278 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659ebd59-f922-4181-9e63-1b04a01eca82 admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:25:03.771629 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659ebd59-f922-4181-9e63-1b04a01eca82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:25:03.771933 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659ebd59-f922-4181-9e63-1b04a01eca82 admin admin] PATH_INFO: `/v3/projects/f402c82a41f04b1c9832ea57412fe44b/users/f1f98e18e13c473fb4b686580277c086/roles/ed72181e1403401facb77dcf33644757` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:25:03.787315 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659ebd59-f922-4181-9e63-1b04a01eca82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f402c82a41f04b1c9832ea57412fe44b, user_id=f1f98e18e13c473fb4b686580277c086, role_id=ed72181e1403401facb77dcf33644757)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:25:03.789989 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659ebd59-f922-4181-9e63-1b04a01eca82 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:25:03.802491 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1385/2787] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 5 12:25:03 2022] PUT /identity/v3/projects/f402c82a41f04b1c9832ea57412fe44b/users/f1f98e18e13c473fb4b686580277c086/roles/ed72181e1403401facb77dcf33644757 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:25:03.812834 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e3ae3e-76ac-4e23-94b3-bc291977bff2 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:25:03.813149 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e3ae3e-76ac-4e23-94b3-bc291977bff2 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:25:03.813424 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e3ae3e-76ac-4e23-94b3-bc291977bff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:25:03.841119 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-17e3ae3e-76ac-4e23-94b3-bc291977bff2 None None] MFA Rules not processed for user `f1f98e18e13c473fb4b686580277c086`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:25:03.842419 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-17e3ae3e-76ac-4e23-94b3-bc291977bff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:25:03.913174 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1403/2788] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:25:03 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:25:03.925158 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659ebd59-f922-4181-9e63-1b04a01eca82 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:25:03.926905 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-659ebd59-f922-4181-9e63-1b04a01eca82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:25:03.996283 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659ebd59-f922-4181-9e63-1b04a01eca82 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:25:04.000592 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179191a2-70af-49cd-8579-fa62fadea168 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37633bbae0c2423c81ccd61ac3a17ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:25:04.001275 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179191a2-70af-49cd-8579-fa62fadea168 service cinder] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:25:04.001554 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179191a2-70af-49cd-8579-fa62fadea168 service cinder] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:25:04.001824 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179191a2-70af-49cd-8579-fa62fadea168 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:25:04.011462 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179191a2-70af-49cd-8579-fa62fadea168 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:25:04.012941 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179191a2-70af-49cd-8579-fa62fadea168 service cinder] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:25:04.029934 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1386/2789] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:25:03 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:25:04.459513 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2941dc52-4f8a-4901-a2e5-eecc8d931579 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:25:04.459823 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2941dc52-4f8a-4901-a2e5-eecc8d931579 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:25:04.460067 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2941dc52-4f8a-4901-a2e5-eecc8d931579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:25:04.479595 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-2941dc52-4f8a-4901-a2e5-eecc8d931579 None None] MFA Rules not processed for user `00e6ebaaf24040a889df07682cce490b`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:25:04.480823 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-2941dc52-4f8a-4901-a2e5-eecc8d931579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:25:04.550509 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1404/2790] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:25:04 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:25:06.738504 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179191a2-70af-49cd-8579-fa62fadea168 service cinder] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:25:06.841954 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179191a2-70af-49cd-8579-fa62fadea168 service cinder] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:25:06.848334 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2d3a66-331f-424a-aa07-7846e2440967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:25:06.849665 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2d3a66-331f-424a-aa07-7846e2440967 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:25:06.850044 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2d3a66-331f-424a-aa07-7846e2440967 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:25:06.850383 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2d3a66-331f-424a-aa07-7846e2440967 admin admin] PATH_INFO: `/v3/users/f1f98e18e13c473fb4b686580277c086` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:25:06.852366 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2d3a66-331f-424a-aa07-7846e2440967 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1f98e18e13c473fb4b686580277c086)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:25:06.854741 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2d3a66-331f-424a-aa07-7846e2440967 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:25:06.926778 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-9f2d3a66-331f-424a-aa07-7846e2440967 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1f98e18e13c473fb4b686580277c086'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:25:06.927510 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-9f2d3a66-331f-424a-aa07-7846e2440967 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1f98e18e13c473fb4b686580277c086'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:25:06.932086 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:25:06.938182 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-9f2d3a66-331f-424a-aa07-7846e2440967 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1f98e18e13c473fb4b686580277c086'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:25:06.938836 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-9f2d3a66-331f-424a-aa07-7846e2440967 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1f98e18e13c473fb4b686580277c086'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:25:06.954755 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-9f2d3a66-331f-424a-aa07-7846e2440967 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1f98e18e13c473fb4b686580277c086'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:25:06.968666 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1387/2791] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 5 12:25:06 2022] DELETE /identity/v3/users/f1f98e18e13c473fb4b686580277c086 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:25:06.973599 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9165cc93-e4b7-450b-9afc-3316ef09adb8 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:25:06.974206 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9165cc93-e4b7-450b-9afc-3316ef09adb8 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:25:06.974206 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9165cc93-e4b7-450b-9afc-3316ef09adb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:25:07.000048 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-9165cc93-e4b7-450b-9afc-3316ef09adb8 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:25:07.001445 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-9165cc93-e4b7-450b-9afc-3316ef09adb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:25:07.035330 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:25:07.067049 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2d3a66-331f-424a-aa07-7846e2440967 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:25:07.068761 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-9f2d3a66-331f-424a-aa07-7846e2440967 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:25:07.072151 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1405/2792] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:25:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:25:07.079230 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9165cc93-e4b7-450b-9afc-3316ef09adb8 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:25:07.081134 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-9165cc93-e4b7-450b-9afc-3316ef09adb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:25:07.143649 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9165cc93-e4b7-450b-9afc-3316ef09adb8 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:25:07.147340 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a863e42a-30fc-464e-afd1-a1b7c8ae654b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4994b4faa4ec4aa088f3dc32c9c5614d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:25:07.147958 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a863e42a-30fc-464e-afd1-a1b7c8ae654b service neutron] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:25:07.148247 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a863e42a-30fc-464e-afd1-a1b7c8ae654b service neutron] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:25:07.148516 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a863e42a-30fc-464e-afd1-a1b7c8ae654b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:25:07.158907 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a863e42a-30fc-464e-afd1-a1b7c8ae654b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:25:07.160354 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a863e42a-30fc-464e-afd1-a1b7c8ae654b service neutron] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:25:07.172868 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1406/2793] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:25:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 12:25:07.187461 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2d3a66-331f-424a-aa07-7846e2440967 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:25:07.192588 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a49a05-bba4-4e54-883a-e08c36ff9861 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5427d0752de4817b6aa25e28c2d9a30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:25:07.193225 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a49a05-bba4-4e54-883a-e08c36ff9861 service placement] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:25:07.193503 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a49a05-bba4-4e54-883a-e08c36ff9861 service placement] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:25:07.193774 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a49a05-bba4-4e54-883a-e08c36ff9861 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:25:07.195516 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-d3a49a05-bba4-4e54-883a-e08c36ff9861 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:25:07.207394 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a49a05-bba4-4e54-883a-e08c36ff9861 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:25:07.209040 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a49a05-bba4-4e54-883a-e08c36ff9861 service placement] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:25:07.219492 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1388/2794] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:25:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 12:25:07.706857 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a863e42a-30fc-464e-afd1-a1b7c8ae654b service neutron] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:25:07.706857 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-a863e42a-30fc-464e-afd1-a1b7c8ae654b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:25:07.719810 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a863e42a-30fc-464e-afd1-a1b7c8ae654b service neutron] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:25:07.725606 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa88130-9390-45e9-ad0b-3a3e67cecde7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:25:07.726479 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa88130-9390-45e9-ad0b-3a3e67cecde7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:25:07.727019 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa88130-9390-45e9-ad0b-3a3e67cecde7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:25:07.727180 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa88130-9390-45e9-ad0b-3a3e67cecde7 admin admin] PATH_INFO: `/v3/projects/f402c82a41f04b1c9832ea57412fe44b` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:25:07.728540 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa88130-9390-45e9-ad0b-3a3e67cecde7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f402c82a41f04b1c9832ea57412fe44b)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:25:07.730680 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa88130-9390-45e9-ad0b-3a3e67cecde7 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:25:07.814011 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-4aa88130-9390-45e9-ad0b-3a3e67cecde7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f402c82a41f04b1c9832ea57412fe44b', 'request_id': 'req-4aa88130-9390-45e9-ad0b-3a3e67cecde7'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:25:07.825890 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-4aa88130-9390-45e9-ad0b-3a3e67cecde7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f402c82a41f04b1c9832ea57412fe44b', 'request_id': 'req-4aa88130-9390-45e9-ad0b-3a3e67cecde7'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:25:07.834721 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-4aa88130-9390-45e9-ad0b-3a3e67cecde7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f402c82a41f04b1c9832ea57412fe44b', 'request_id': 'req-4aa88130-9390-45e9-ad0b-3a3e67cecde7'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:25:07.851866 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-4aa88130-9390-45e9-ad0b-3a3e67cecde7 admin admin] The token cache is being invalidate because project f402c82a41f04b1c9832ea57412fe44b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:25:07.852187 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-4aa88130-9390-45e9-ad0b-3a3e67cecde7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:25:07.852872 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-4aa88130-9390-45e9-ad0b-3a3e67cecde7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:25:07.854605 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1407/2795] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 5 12:25:07 2022] DELETE /identity/v3/projects/f402c82a41f04b1c9832ea57412fe44b => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:25:08.476967 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7eaaa7-73af-49ac-b5d6-44f6d0b67e2a None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:25:08.477514 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7eaaa7-73af-49ac-b5d6-44f6d0b67e2a None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:25:08.477514 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7eaaa7-73af-49ac-b5d6-44f6d0b67e2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:25:08.497828 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-bb7eaaa7-73af-49ac-b5d6-44f6d0b67e2a None None] MFA Rules not processed for user `60c08df8e0b34c568b2d1f740947f6f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:25:08.499644 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-bb7eaaa7-73af-49ac-b5d6-44f6d0b67e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:25:08.566793 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1389/2796] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:25:08 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:25:17.845639 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=65,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:25:18.559146 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=78,keystone:DELETE=2 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:25:32.511116 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7775c48-2ceb-4c2b-8fe6-34ee2eb5d512 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:25:32.511778 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7775c48-2ceb-4c2b-8fe6-34ee2eb5d512 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:25:32.511778 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7775c48-2ceb-4c2b-8fe6-34ee2eb5d512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:25:32.533890 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-d7775c48-2ceb-4c2b-8fe6-34ee2eb5d512 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:25:32.535104 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-d7775c48-2ceb-4c2b-8fe6-34ee2eb5d512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:25:32.599751 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1408/2797] 10.222.0.26 () {58 vars in 1016 bytes} [Mon Sep 5 12:25:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 12:25:32.617325 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7eaaa7-73af-49ac-b5d6-44f6d0b67e2a None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:25:32.619347 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-bb7eaaa7-73af-49ac-b5d6-44f6d0b67e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:25:32.731522 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7eaaa7-73af-49ac-b5d6-44f6d0b67e2a None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:25:32.737238 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6deab8-5efe-466b-9713-4831d01f7b35 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb060ff495bc4abb83ff88992fb7be09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:25:32.737858 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6deab8-5efe-466b-9713-4831d01f7b35 service nova] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:25:32.738138 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6deab8-5efe-466b-9713-4831d01f7b35 service nova] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:25:32.738411 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6deab8-5efe-466b-9713-4831d01f7b35 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:25:32.747189 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6deab8-5efe-466b-9713-4831d01f7b35 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:25:32.748802 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6deab8-5efe-466b-9713-4831d01f7b35 service nova] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:25:32.759725 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1390/2798] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:25:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:25:35.519767 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43320aa6-e9ef-471d-8bdb-155b07b19712 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:25:35.520438 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43320aa6-e9ef-471d-8bdb-155b07b19712 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:25:35.520552 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43320aa6-e9ef-471d-8bdb-155b07b19712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:25:35.547379 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-43320aa6-e9ef-471d-8bdb-155b07b19712 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:25:35.548620 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-43320aa6-e9ef-471d-8bdb-155b07b19712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:25:35.557130 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1409/2799] 10.222.0.26 () {58 vars in 1016 bytes} [Mon Sep 5 12:25:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:25:35.572242 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6deab8-5efe-466b-9713-4831d01f7b35 service nova] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:25:35.574463 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-3a6deab8-5efe-466b-9713-4831d01f7b35 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:25:35.593968 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6deab8-5efe-466b-9713-4831d01f7b35 service nova] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:25:35.600771 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5628492e-5f5d-42bc-8ad9-fe5ebf6f1f52 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb060ff495bc4abb83ff88992fb7be09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:25:35.601508 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5628492e-5f5d-42bc-8ad9-fe5ebf6f1f52 service nova] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:25:35.601714 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5628492e-5f5d-42bc-8ad9-fe5ebf6f1f52 service nova] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:25:35.601998 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5628492e-5f5d-42bc-8ad9-fe5ebf6f1f52 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:25:35.611357 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5628492e-5f5d-42bc-8ad9-fe5ebf6f1f52 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:25:35.613096 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5628492e-5f5d-42bc-8ad9-fe5ebf6f1f52 service nova] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:25:35.624131 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1391/2800] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:25:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:25:38.825472 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de53a1f7-50d7-41fa-bc03-3519a2c1e198 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:25:38.826054 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de53a1f7-50d7-41fa-bc03-3519a2c1e198 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:25:38.826054 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de53a1f7-50d7-41fa-bc03-3519a2c1e198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:25:38.846968 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-de53a1f7-50d7-41fa-bc03-3519a2c1e198 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:25:38.848180 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-de53a1f7-50d7-41fa-bc03-3519a2c1e198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:25:38.855981 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1410/2801] 10.222.0.26 () {58 vars in 1016 bytes} [Mon Sep 5 12:25:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:25:38.873292 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5628492e-5f5d-42bc-8ad9-fe5ebf6f1f52 service nova] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:25:38.886638 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5628492e-5f5d-42bc-8ad9-fe5ebf6f1f52 service nova] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:25:38.896927 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a75329-3f60-4b9b-8853-5bac03dc6ef3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb060ff495bc4abb83ff88992fb7be09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:25:38.897998 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a75329-3f60-4b9b-8853-5bac03dc6ef3 service nova] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:25:38.898513 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a75329-3f60-4b9b-8853-5bac03dc6ef3 service nova] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:25:38.899022 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a75329-3f60-4b9b-8853-5bac03dc6ef3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:25:38.912468 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a75329-3f60-4b9b-8853-5bac03dc6ef3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:25:38.914131 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a75329-3f60-4b9b-8853-5bac03dc6ef3 service nova] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:25:38.924704 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1392/2802] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:25:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:25:41.953238 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37f8af1-030c-49d2-86ca-44005340658b None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:25:41.954571 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37f8af1-030c-49d2-86ca-44005340658b None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:25:41.954571 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37f8af1-030c-49d2-86ca-44005340658b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:25:41.974753 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-e37f8af1-030c-49d2-86ca-44005340658b None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:25:41.975971 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-e37f8af1-030c-49d2-86ca-44005340658b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:25:41.984412 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1411/2803] 10.222.0.26 () {58 vars in 1016 bytes} [Mon Sep 5 12:25:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:25:42.002310 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a75329-3f60-4b9b-8853-5bac03dc6ef3 service nova] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:25:42.014509 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a75329-3f60-4b9b-8853-5bac03dc6ef3 service nova] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:25:42.022158 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410d792b-444e-423d-9298-fa5254af04f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb060ff495bc4abb83ff88992fb7be09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:25:42.022833 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410d792b-444e-423d-9298-fa5254af04f7 service nova] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:25:42.023187 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410d792b-444e-423d-9298-fa5254af04f7 service nova] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:25:42.023555 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410d792b-444e-423d-9298-fa5254af04f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:25:42.033368 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410d792b-444e-423d-9298-fa5254af04f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:25:42.035036 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410d792b-444e-423d-9298-fa5254af04f7 service nova] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:25:42.045594 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1393/2804] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:25:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:25:50.278599 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc85abec-58cf-4656-861e-fe77fcc0bf05 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:25:50.279090 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc85abec-58cf-4656-861e-fe77fcc0bf05 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:25:50.279207 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc85abec-58cf-4656-861e-fe77fcc0bf05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:25:50.300724 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-cc85abec-58cf-4656-861e-fe77fcc0bf05 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:25:50.301980 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-cc85abec-58cf-4656-861e-fe77fcc0bf05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:25:50.309824 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1412/2805] 10.222.0.26 () {58 vars in 1016 bytes} [Mon Sep 5 12:25:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:25:50.330646 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410d792b-444e-423d-9298-fa5254af04f7 service nova] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:25:50.342127 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410d792b-444e-423d-9298-fa5254af04f7 service nova] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:25:50.348132 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43723b66-7b14-4d28-98c3-cc1a5ecc0ff1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb060ff495bc4abb83ff88992fb7be09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:25:50.348718 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43723b66-7b14-4d28-98c3-cc1a5ecc0ff1 service nova] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:25:50.349029 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43723b66-7b14-4d28-98c3-cc1a5ecc0ff1 service nova] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:25:50.349300 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43723b66-7b14-4d28-98c3-cc1a5ecc0ff1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:25:50.357366 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43723b66-7b14-4d28-98c3-cc1a5ecc0ff1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:25:50.358941 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43723b66-7b14-4d28-98c3-cc1a5ecc0ff1 service nova] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:25:50.369539 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1394/2806] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:25:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:25:53.440160 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f35ab8-04f2-4076-aedd-31e5ba899491 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:25:53.440652 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f35ab8-04f2-4076-aedd-31e5ba899491 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:25:53.440758 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f35ab8-04f2-4076-aedd-31e5ba899491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:25:53.460763 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-59f35ab8-04f2-4076-aedd-31e5ba899491 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:25:53.462020 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-59f35ab8-04f2-4076-aedd-31e5ba899491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:25:53.469811 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1413/2807] 10.222.0.26 () {58 vars in 1016 bytes} [Mon Sep 5 12:25:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:25:53.488969 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43723b66-7b14-4d28-98c3-cc1a5ecc0ff1 service nova] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:25:53.500097 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43723b66-7b14-4d28-98c3-cc1a5ecc0ff1 service nova] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:25:53.505894 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f6c599-be44-404b-8675-2d917c4d42b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb060ff495bc4abb83ff88992fb7be09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:25:53.506530 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f6c599-be44-404b-8675-2d917c4d42b3 service nova] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:25:53.506842 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f6c599-be44-404b-8675-2d917c4d42b3 service nova] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:25:53.507183 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f6c599-be44-404b-8675-2d917c4d42b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:25:53.516109 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f6c599-be44-404b-8675-2d917c4d42b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:25:53.518220 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f6c599-be44-404b-8675-2d917c4d42b3 service nova] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:25:53.528114 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1395/2808] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:25:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:26:03.455207 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=42 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:26:03.523856 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=76 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:26:08.690512 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b1175b-4a2b-49de-9ddc-561c9c0b8c02 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:26:08.691065 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b1175b-4a2b-49de-9ddc-561c9c0b8c02 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:26:08.691065 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b1175b-4a2b-49de-9ddc-561c9c0b8c02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:26:08.712454 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-d3b1175b-4a2b-49de-9ddc-561c9c0b8c02 None None] MFA Rules not processed for user `00e6ebaaf24040a889df07682cce490b`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:26:08.713920 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-d3b1175b-4a2b-49de-9ddc-561c9c0b8c02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:26:08.779967 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1414/2809] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:26:08 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:26:18.773101 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=25 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:26:20.923795 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160f4e0b-9c72-4153-a28b-611e88138eea None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:26:20.924417 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160f4e0b-9c72-4153-a28b-611e88138eea None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:26:20.924776 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160f4e0b-9c72-4153-a28b-611e88138eea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:26:20.955139 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-160f4e0b-9c72-4153-a28b-611e88138eea None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:26:20.956360 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-160f4e0b-9c72-4153-a28b-611e88138eea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:26:20.965052 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1396/2810] 10.222.0.26 () {58 vars in 1016 bytes} [Mon Sep 5 12:26:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:26:20.979115 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b1175b-4a2b-49de-9ddc-561c9c0b8c02 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:26:20.992637 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b1175b-4a2b-49de-9ddc-561c9c0b8c02 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:26:20.998184 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d2c98d-5b77-4ba9-bd8e-5277f9fe4108 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb060ff495bc4abb83ff88992fb7be09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:26:20.998805 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d2c98d-5b77-4ba9-bd8e-5277f9fe4108 service nova] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:26:20.999189 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d2c98d-5b77-4ba9-bd8e-5277f9fe4108 service nova] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:26:20.999358 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d2c98d-5b77-4ba9-bd8e-5277f9fe4108 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:26:21.009538 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d2c98d-5b77-4ba9-bd8e-5277f9fe4108 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:26:21.011257 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d2c98d-5b77-4ba9-bd8e-5277f9fe4108 service nova] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:26:21.021962 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1415/2811] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:26:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:26:23.711482 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160f4e0b-9c72-4153-a28b-611e88138eea None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:26:23.712970 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-160f4e0b-9c72-4153-a28b-611e88138eea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:26:23.727856 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160f4e0b-9c72-4153-a28b-611e88138eea None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:26:23.732538 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f94cf75-013c-4352-a9f1-186f50a402f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:26:23.733427 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f94cf75-013c-4352-a9f1-186f50a402f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:26:23.733708 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f94cf75-013c-4352-a9f1-186f50a402f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:26:23.734168 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f94cf75-013c-4352-a9f1-186f50a402f0 admin admin] PATH_INFO: `/v3/users/60c08df8e0b34c568b2d1f740947f6f4` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:26:23.735327 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f94cf75-013c-4352-a9f1-186f50a402f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60c08df8e0b34c568b2d1f740947f6f4)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:26:23.737313 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f94cf75-013c-4352-a9f1-186f50a402f0 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:26:23.796833 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-7f94cf75-013c-4352-a9f1-186f50a402f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60c08df8e0b34c568b2d1f740947f6f4'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:26:23.797515 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-7f94cf75-013c-4352-a9f1-186f50a402f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60c08df8e0b34c568b2d1f740947f6f4'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:26:23.805173 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-7f94cf75-013c-4352-a9f1-186f50a402f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60c08df8e0b34c568b2d1f740947f6f4'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:26:23.805815 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-7f94cf75-013c-4352-a9f1-186f50a402f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60c08df8e0b34c568b2d1f740947f6f4'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:26:23.818137 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-7f94cf75-013c-4352-a9f1-186f50a402f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60c08df8e0b34c568b2d1f740947f6f4'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:26:23.830469 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1397/2812] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 5 12:26:23 2022] DELETE /identity/v3/users/60c08df8e0b34c568b2d1f740947f6f4 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:26:24.005655 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d2c98d-5b77-4ba9-bd8e-5277f9fe4108 service nova] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:26:24.015821 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d2c98d-5b77-4ba9-bd8e-5277f9fe4108 service nova] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:26:24.084275 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c2b5c7-5547-420f-b46a-af198b837f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:26:24.085033 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c2b5c7-5547-420f-b46a-af198b837f28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:26:24.085315 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c2b5c7-5547-420f-b46a-af198b837f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:26:24.085608 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c2b5c7-5547-420f-b46a-af198b837f28 admin admin] PATH_INFO: `/v3/projects/439a9c1d9bf04c0f86fed3fc93e67e40` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:26:24.086745 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c2b5c7-5547-420f-b46a-af198b837f28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=439a9c1d9bf04c0f86fed3fc93e67e40)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:26:24.088627 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c2b5c7-5547-420f-b46a-af198b837f28 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:26:24.137640 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-70c2b5c7-5547-420f-b46a-af198b837f28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '439a9c1d9bf04c0f86fed3fc93e67e40', 'request_id': 'req-70c2b5c7-5547-420f-b46a-af198b837f28'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:26:24.145874 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-70c2b5c7-5547-420f-b46a-af198b837f28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '439a9c1d9bf04c0f86fed3fc93e67e40', 'request_id': 'req-70c2b5c7-5547-420f-b46a-af198b837f28'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:26:24.151607 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-70c2b5c7-5547-420f-b46a-af198b837f28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '439a9c1d9bf04c0f86fed3fc93e67e40', 'request_id': 'req-70c2b5c7-5547-420f-b46a-af198b837f28'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:26:24.162730 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-70c2b5c7-5547-420f-b46a-af198b837f28 admin admin] The token cache is being invalidate because project 439a9c1d9bf04c0f86fed3fc93e67e40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:26:24.163049 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-70c2b5c7-5547-420f-b46a-af198b837f28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:26:24.163679 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-70c2b5c7-5547-420f-b46a-af198b837f28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:26:24.165188 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1416/2813] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 5 12:26:24 2022] DELETE /identity/v3/projects/439a9c1d9bf04c0f86fed3fc93e67e40 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:26:24.169997 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0982773a-8603-4aa0-a22b-bf5fa79a1e32 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:26:24.170289 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0982773a-8603-4aa0-a22b-bf5fa79a1e32 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:26:24.170599 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0982773a-8603-4aa0-a22b-bf5fa79a1e32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:26:24.192119 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-0982773a-8603-4aa0-a22b-bf5fa79a1e32 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:26:24.193378 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-0982773a-8603-4aa0-a22b-bf5fa79a1e32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:26:24.212094 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b384c787-52a3-435a-93b6-729ab11c414b None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:26:24.212394 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b384c787-52a3-435a-93b6-729ab11c414b None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:26:24.212668 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b384c787-52a3-435a-93b6-729ab11c414b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:26:24.233698 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-b384c787-52a3-435a-93b6-729ab11c414b None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:26:24.235040 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-b384c787-52a3-435a-93b6-729ab11c414b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:26:24.256552 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1398/2814] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:26:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:26:24.265861 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cbfed9-8e08-411d-9118-a97a98926ff6 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:26:24.266367 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cbfed9-8e08-411d-9118-a97a98926ff6 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:26:24.266659 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cbfed9-8e08-411d-9118-a97a98926ff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:26:24.289750 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-16cbfed9-8e08-411d-9118-a97a98926ff6 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:26:24.290984 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-16cbfed9-8e08-411d-9118-a97a98926ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:26:24.299087 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1399/2815] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:26:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 12:26:24.302541 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1417/2816] 10.222.0.26 () {58 vars in 1016 bytes} [Mon Sep 5 12:26:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 12:26:24.303572 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cbfed9-8e08-411d-9118-a97a98926ff6 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:26:24.313122 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cbfed9-8e08-411d-9118-a97a98926ff6 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:26:24.317199 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b384c787-52a3-435a-93b6-729ab11c414b None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:26:24.318368 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961e0df5-033a-4c90-a667-976ac74a9b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:26:24.318722 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-b384c787-52a3-435a-93b6-729ab11c414b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:26:24.318973 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961e0df5-033a-4c90-a667-976ac74a9b0e admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:26:24.319250 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961e0df5-033a-4c90-a667-976ac74a9b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:26:24.319521 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961e0df5-033a-4c90-a667-976ac74a9b0e admin admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:26:24.320208 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961e0df5-033a-4c90-a667-976ac74a9b0e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:26:24.320510 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961e0df5-033a-4c90-a667-976ac74a9b0e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:26:24.322152 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961e0df5-033a-4c90-a667-976ac74a9b0e admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:26:24.335497 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1400/2817] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Sep 5 12:26:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:26:24.339801 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961e0df5-033a-4c90-a667-976ac74a9b0e admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:26:24.342389 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:26:24.351095 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961e0df5-033a-4c90-a667-976ac74a9b0e admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:26:24.356530 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c454374-0124-4e36-9a3c-ccb3547c5b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:26:24.357488 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c454374-0124-4e36-9a3c-ccb3547c5b41 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:26:24.357891 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c454374-0124-4e36-9a3c-ccb3547c5b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:26:24.358257 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c454374-0124-4e36-9a3c-ccb3547c5b41 admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:26:24.359280 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c454374-0124-4e36-9a3c-ccb3547c5b41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:26:24.361934 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c454374-0124-4e36-9a3c-ccb3547c5b41 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:26:24.391992 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1401/2818] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 5 12:26:24 2022] POST /identity/v3/projects => generated 369 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 12:26:24.397161 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c454374-0124-4e36-9a3c-ccb3547c5b41 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:26:24.406062 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b384c787-52a3-435a-93b6-729ab11c414b None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:26:24.424827 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:26:24.464670 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c454374-0124-4e36-9a3c-ccb3547c5b41 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:26:24.469569 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff2b149-9865-4127-9ff2-ec8d36949ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:26:24.470175 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff2b149-9865-4127-9ff2-ec8d36949ee0 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:26:24.470460 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff2b149-9865-4127-9ff2-ec8d36949ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:26:24.470765 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff2b149-9865-4127-9ff2-ec8d36949ee0 admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:26:24.471540 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff2b149-9865-4127-9ff2-ec8d36949ee0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:26:24.472636 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0647cd2-d7e4-4922-acf2-f7d28074c683 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb060ff495bc4abb83ff88992fb7be09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:26:24.473287 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0647cd2-d7e4-4922-acf2-f7d28074c683 service nova] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:26:24.473532 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff2b149-9865-4127-9ff2-ec8d36949ee0 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:26:24.473636 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0647cd2-d7e4-4922-acf2-f7d28074c683 service nova] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:26:24.473824 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0647cd2-d7e4-4922-acf2-f7d28074c683 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:26:24.482542 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0647cd2-d7e4-4922-acf2-f7d28074c683 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:26:24.484133 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0647cd2-d7e4-4922-acf2-f7d28074c683 service nova] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:26:24.494597 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1418/2819] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:26:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 12:26:24.499895 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1402/2820] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 5 12:26:24 2022] POST /identity/v3/users => generated 285 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:26:24.500818 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0647cd2-d7e4-4922-acf2-f7d28074c683 service nova] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:26:24.511154 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0647cd2-d7e4-4922-acf2-f7d28074c683 service nova] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:26:24.516179 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45a9d7c-ee4e-43dd-bd0c-ccffd483eb98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:26:24.516776 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45a9d7c-ee4e-43dd-bd0c-ccffd483eb98 admin admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:26:24.517099 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45a9d7c-ee4e-43dd-bd0c-ccffd483eb98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:26:24.517374 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45a9d7c-ee4e-43dd-bd0c-ccffd483eb98 admin admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:26:24.518048 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45a9d7c-ee4e-43dd-bd0c-ccffd483eb98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:26:24.519662 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45a9d7c-ee4e-43dd-bd0c-ccffd483eb98 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:26:24.530634 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1419/2821] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:26:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:26:24.535055 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff2b149-9865-4127-9ff2-ec8d36949ee0 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:26:24.545357 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff2b149-9865-4127-9ff2-ec8d36949ee0 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:26:24.550935 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30f1cf5-1c62-46cd-b08d-3820aafe7127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:26:24.551557 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30f1cf5-1c62-46cd-b08d-3820aafe7127 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:26:24.551864 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30f1cf5-1c62-46cd-b08d-3820aafe7127 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:26:24.552146 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30f1cf5-1c62-46cd-b08d-3820aafe7127 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:26:24.552794 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30f1cf5-1c62-46cd-b08d-3820aafe7127 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:26:24.554438 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30f1cf5-1c62-46cd-b08d-3820aafe7127 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:26:24.565317 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1403/2822] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:26:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:26:24.570482 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45a9d7c-ee4e-43dd-bd0c-ccffd483eb98 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:26:24.583792 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45a9d7c-ee4e-43dd-bd0c-ccffd483eb98 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:26:24.588858 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38506575-e99a-4f24-a76e-9a915df690cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:26:24.589595 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38506575-e99a-4f24-a76e-9a915df690cf admin admin] REQUEST_METHOD: `PUT` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:26:24.589945 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38506575-e99a-4f24-a76e-9a915df690cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:26:24.590289 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38506575-e99a-4f24-a76e-9a915df690cf admin admin] PATH_INFO: `/v3/projects/9d2e71ba717f492186d8e5489d4b7887/users/c2a9bc0a75444739b6272b51655abca2/roles/ed72181e1403401facb77dcf33644757` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:26:24.605995 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38506575-e99a-4f24-a76e-9a915df690cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d2e71ba717f492186d8e5489d4b7887, user_id=c2a9bc0a75444739b6272b51655abca2, role_id=ed72181e1403401facb77dcf33644757)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:26:24.608880 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38506575-e99a-4f24-a76e-9a915df690cf admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:26:24.622374 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1420/2823] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 5 12:26:24 2022] PUT /identity/v3/projects/9d2e71ba717f492186d8e5489d4b7887/users/c2a9bc0a75444739b6272b51655abca2/roles/ed72181e1403401facb77dcf33644757 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:26:24.634300 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9f9745-4582-420e-bd33-753714ee7eaf None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:26:24.634588 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9f9745-4582-420e-bd33-753714ee7eaf None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:26:24.634866 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9f9745-4582-420e-bd33-753714ee7eaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:26:24.662908 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-2a9f9745-4582-420e-bd33-753714ee7eaf None None] MFA Rules not processed for user `c2a9bc0a75444739b6272b51655abca2`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:26:24.664134 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-2a9f9745-4582-420e-bd33-753714ee7eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:26:24.726722 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1404/2824] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:26:24 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:26:24.731149 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38506575-e99a-4f24-a76e-9a915df690cf admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:26:24.793633 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38506575-e99a-4f24-a76e-9a915df690cf admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:26:24.798227 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ceb5e1-0ab5-4d08-815a-f12e156ab313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:26:24.798829 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ceb5e1-0ab5-4d08-815a-f12e156ab313 admin admin] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:26:24.799110 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ceb5e1-0ab5-4d08-815a-f12e156ab313 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:26:24.799386 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ceb5e1-0ab5-4d08-815a-f12e156ab313 admin admin] PATH_INFO: `/v3/projects` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:26:24.800028 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ceb5e1-0ab5-4d08-815a-f12e156ab313 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:26:24.802542 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ceb5e1-0ab5-4d08-815a-f12e156ab313 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:26:24.813607 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:26:24.830203 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1421/2825] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 5 12:26:24 2022] POST /identity/v3/projects => generated 367 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:26:24.834385 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9f9745-4582-420e-bd33-753714ee7eaf None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:26:24.844981 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9f9745-4582-420e-bd33-753714ee7eaf None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:26:24.900289 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42537014-d3a6-42d8-b30b-869d0ef114d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:26:24.900918 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42537014-d3a6-42d8-b30b-869d0ef114d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:26:24.901200 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42537014-d3a6-42d8-b30b-869d0ef114d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:26:24.901470 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42537014-d3a6-42d8-b30b-869d0ef114d7 admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:26:24.902094 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42537014-d3a6-42d8-b30b-869d0ef114d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:26:24.904012 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42537014-d3a6-42d8-b30b-869d0ef114d7 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:26:24.924139 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1405/2826] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 5 12:26:24 2022] POST /identity/v3/users => generated 290 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 12:26:24.928704 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ceb5e1-0ab5-4d08-815a-f12e156ab313 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:26:24.939361 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ceb5e1-0ab5-4d08-815a-f12e156ab313 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:26:24.943568 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324ed01a-3a7c-4cbf-b9d6-c5415c07a53b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:26:24.944157 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324ed01a-3a7c-4cbf-b9d6-c5415c07a53b admin admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:26:24.944435 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324ed01a-3a7c-4cbf-b9d6-c5415c07a53b admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:26:24.944708 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324ed01a-3a7c-4cbf-b9d6-c5415c07a53b admin admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:26:24.945392 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324ed01a-3a7c-4cbf-b9d6-c5415c07a53b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:26:24.946955 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324ed01a-3a7c-4cbf-b9d6-c5415c07a53b admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:26:24.956818 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1422/2827] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:26:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:26:24.961112 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42537014-d3a6-42d8-b30b-869d0ef114d7 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:26:24.971076 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42537014-d3a6-42d8-b30b-869d0ef114d7 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:26:24.976441 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba49fd39-83db-451a-9ac2-c4925a0e5512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:26:24.977128 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba49fd39-83db-451a-9ac2-c4925a0e5512 admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:26:24.977407 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba49fd39-83db-451a-9ac2-c4925a0e5512 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:26:24.977680 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba49fd39-83db-451a-9ac2-c4925a0e5512 admin admin] PATH_INFO: `/v3/projects/5665f06bdf084dd8a5c2e25f276ed07a/users/0bbc6562fca847a8ac82db22737c5801/roles/16e2ccc8bd1b497d8cee780c1c7df0d2` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:26:24.993123 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba49fd39-83db-451a-9ac2-c4925a0e5512 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5665f06bdf084dd8a5c2e25f276ed07a, user_id=0bbc6562fca847a8ac82db22737c5801, role_id=16e2ccc8bd1b497d8cee780c1c7df0d2)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:26:24.995769 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba49fd39-83db-451a-9ac2-c4925a0e5512 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:26:25.004296 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:26:25.010702 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1406/2828] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 5 12:26:24 2022] PUT /identity/v3/projects/5665f06bdf084dd8a5c2e25f276ed07a/users/0bbc6562fca847a8ac82db22737c5801/roles/16e2ccc8bd1b497d8cee780c1c7df0d2 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:26:25.016381 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324ed01a-3a7c-4cbf-b9d6-c5415c07a53b admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:26:25.027617 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324ed01a-3a7c-4cbf-b9d6-c5415c07a53b admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:26:25.086493 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d88d01-07ce-4ee7-92a0-5e410644eda9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:26:25.087095 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d88d01-07ce-4ee7-92a0-5e410644eda9 admin admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:26:25.087379 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d88d01-07ce-4ee7-92a0-5e410644eda9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:26:25.087650 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d88d01-07ce-4ee7-92a0-5e410644eda9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:26:25.088282 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d88d01-07ce-4ee7-92a0-5e410644eda9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:26:25.089886 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d88d01-07ce-4ee7-92a0-5e410644eda9 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:26:25.100027 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1423/2829] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:26:25 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:26:25.104212 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba49fd39-83db-451a-9ac2-c4925a0e5512 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:26:25.115087 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba49fd39-83db-451a-9ac2-c4925a0e5512 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:26:25.119690 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a30f32-bb75-4e8b-8bdd-034a2e0e7491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:26:25.120333 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a30f32-bb75-4e8b-8bdd-034a2e0e7491 admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:26:25.120615 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a30f32-bb75-4e8b-8bdd-034a2e0e7491 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:26:25.120910 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a30f32-bb75-4e8b-8bdd-034a2e0e7491 admin admin] PATH_INFO: `/v3/projects/5665f06bdf084dd8a5c2e25f276ed07a/users/0bbc6562fca847a8ac82db22737c5801/roles/16e2ccc8bd1b497d8cee780c1c7df0d2` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:26:25.122853 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a30f32-bb75-4e8b-8bdd-034a2e0e7491 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5665f06bdf084dd8a5c2e25f276ed07a, user_id=0bbc6562fca847a8ac82db22737c5801, role_id=16e2ccc8bd1b497d8cee780c1c7df0d2)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:26:25.125571 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a30f32-bb75-4e8b-8bdd-034a2e0e7491 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:26:25.136371 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1407/2830] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 5 12:26:25 2022] PUT /identity/v3/projects/5665f06bdf084dd8a5c2e25f276ed07a/users/0bbc6562fca847a8ac82db22737c5801/roles/16e2ccc8bd1b497d8cee780c1c7df0d2 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:26:25.147995 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18399ea-dc84-4bd3-9f95-16e850d83386 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:26:25.148286 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18399ea-dc84-4bd3-9f95-16e850d83386 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:26:25.148608 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18399ea-dc84-4bd3-9f95-16e850d83386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:26:25.177778 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-b18399ea-dc84-4bd3-9f95-16e850d83386 None None] MFA Rules not processed for user `0bbc6562fca847a8ac82db22737c5801`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:26:25.178976 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-b18399ea-dc84-4bd3-9f95-16e850d83386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:26:25.248278 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1424/2831] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:26:25 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:26:25.261090 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a30f32-bb75-4e8b-8bdd-034a2e0e7491 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:26:25.263637 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-a2a30f32-bb75-4e8b-8bdd-034a2e0e7491 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:26:25.348805 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a30f32-bb75-4e8b-8bdd-034a2e0e7491 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:26:25.352516 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b81c195-f9ef-4292-9428-c660b78d4967 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37633bbae0c2423c81ccd61ac3a17ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:26:25.353079 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b81c195-f9ef-4292-9428-c660b78d4967 service cinder] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:26:25.353357 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b81c195-f9ef-4292-9428-c660b78d4967 service cinder] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:26:25.353629 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b81c195-f9ef-4292-9428-c660b78d4967 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:26:25.362752 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b81c195-f9ef-4292-9428-c660b78d4967 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:26:25.364188 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b81c195-f9ef-4292-9428-c660b78d4967 service cinder] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:26:25.373487 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1408/2832] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:26:25 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:26:26.750477 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18399ea-dc84-4bd3-9f95-16e850d83386 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:26:26.827542 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18399ea-dc84-4bd3-9f95-16e850d83386 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:26:26.832754 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53a4888-a80e-4567-8e30-e18231eb58f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:26:26.833471 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53a4888-a80e-4567-8e30-e18231eb58f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:26:26.833756 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53a4888-a80e-4567-8e30-e18231eb58f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:26:26.834032 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53a4888-a80e-4567-8e30-e18231eb58f4 admin admin] PATH_INFO: `/v3/users/c2a9bc0a75444739b6272b51655abca2` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:26:26.835203 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53a4888-a80e-4567-8e30-e18231eb58f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2a9bc0a75444739b6272b51655abca2)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:26:26.837207 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53a4888-a80e-4567-8e30-e18231eb58f4 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:26:26.839971 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:26:26.889231 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-a53a4888-a80e-4567-8e30-e18231eb58f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2a9bc0a75444739b6272b51655abca2'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:26:26.890142 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-a53a4888-a80e-4567-8e30-e18231eb58f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2a9bc0a75444739b6272b51655abca2'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:26:26.898528 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-a53a4888-a80e-4567-8e30-e18231eb58f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2a9bc0a75444739b6272b51655abca2'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:26:26.899124 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-a53a4888-a80e-4567-8e30-e18231eb58f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2a9bc0a75444739b6272b51655abca2'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:26:26.912817 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-a53a4888-a80e-4567-8e30-e18231eb58f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2a9bc0a75444739b6272b51655abca2'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:26:26.924865 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1425/2833] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 5 12:26:26 2022] DELETE /identity/v3/users/c2a9bc0a75444739b6272b51655abca2 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:26:26.929561 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65c228c-3ab6-4e53-944c-440420939947 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:26:26.930050 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65c228c-3ab6-4e53-944c-440420939947 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:26:26.930181 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65c228c-3ab6-4e53-944c-440420939947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:26:26.949201 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-d65c228c-3ab6-4e53-944c-440420939947 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:26:26.950415 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-d65c228c-3ab6-4e53-944c-440420939947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:26:27.012079 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1409/2834] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:26:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:26:27.022733 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53a4888-a80e-4567-8e30-e18231eb58f4 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:26:27.024171 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-a53a4888-a80e-4567-8e30-e18231eb58f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:26:27.107764 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53a4888-a80e-4567-8e30-e18231eb58f4 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:26:27.111518 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b0b55c-dc1f-4f1a-86f3-0fc363dffbf4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4994b4faa4ec4aa088f3dc32c9c5614d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:26:27.112123 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b0b55c-dc1f-4f1a-86f3-0fc363dffbf4 service neutron] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:26:27.112405 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b0b55c-dc1f-4f1a-86f3-0fc363dffbf4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:26:27.112674 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b0b55c-dc1f-4f1a-86f3-0fc363dffbf4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:26:27.121946 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b0b55c-dc1f-4f1a-86f3-0fc363dffbf4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:26:27.123382 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b0b55c-dc1f-4f1a-86f3-0fc363dffbf4 service neutron] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:26:27.133422 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1426/2835] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:26:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:26:27.304327 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c789c00d-3535-4e65-81df-8eddf6dfd807 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:26:27.304683 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c789c00d-3535-4e65-81df-8eddf6dfd807 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:26:27.304995 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c789c00d-3535-4e65-81df-8eddf6dfd807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:26:27.326693 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-c789c00d-3535-4e65-81df-8eddf6dfd807 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:26:27.327922 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-c789c00d-3535-4e65-81df-8eddf6dfd807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:26:27.336370 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1410/2836] 10.222.0.26 () {58 vars in 1016 bytes} [Mon Sep 5 12:26:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:26:27.351970 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b0b55c-dc1f-4f1a-86f3-0fc363dffbf4 service neutron] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:26:27.353391 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-10b0b55c-dc1f-4f1a-86f3-0fc363dffbf4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:26:27.416488 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c789c00d-3535-4e65-81df-8eddf6dfd807 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:26:27.417994 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-c789c00d-3535-4e65-81df-8eddf6dfd807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:26:27.428927 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:26:27.437815 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b0b55c-dc1f-4f1a-86f3-0fc363dffbf4 service neutron] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:26:27.438306 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c789c00d-3535-4e65-81df-8eddf6dfd807 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:26:27.445140 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf12e488-9d56-4eb5-9512-86ae33266fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:26:27.445857 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf12e488-9d56-4eb5-9512-86ae33266fd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:26:27.446433 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf12e488-9d56-4eb5-9512-86ae33266fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:26:27.446740 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf12e488-9d56-4eb5-9512-86ae33266fd9 admin admin] PATH_INFO: `/v3/projects/9d2e71ba717f492186d8e5489d4b7887` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:26:27.447214 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d9dd42-a19e-486a-b044-dab65896061a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb060ff495bc4abb83ff88992fb7be09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:26:27.447835 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf12e488-9d56-4eb5-9512-86ae33266fd9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d2e71ba717f492186d8e5489d4b7887)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:26:27.448123 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d9dd42-a19e-486a-b044-dab65896061a service nova] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:26:27.448508 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d9dd42-a19e-486a-b044-dab65896061a service nova] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:26:27.449084 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d9dd42-a19e-486a-b044-dab65896061a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:26:27.450304 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf12e488-9d56-4eb5-9512-86ae33266fd9 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:26:27.458024 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d9dd42-a19e-486a-b044-dab65896061a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:26:27.459627 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d9dd42-a19e-486a-b044-dab65896061a service nova] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:26:27.469448 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1427/2837] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:26:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:26:27.499532 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-bf12e488-9d56-4eb5-9512-86ae33266fd9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d2e71ba717f492186d8e5489d4b7887', 'request_id': 'req-bf12e488-9d56-4eb5-9512-86ae33266fd9'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:26:27.509602 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-bf12e488-9d56-4eb5-9512-86ae33266fd9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d2e71ba717f492186d8e5489d4b7887', 'request_id': 'req-bf12e488-9d56-4eb5-9512-86ae33266fd9'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:26:27.516393 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-bf12e488-9d56-4eb5-9512-86ae33266fd9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d2e71ba717f492186d8e5489d4b7887', 'request_id': 'req-bf12e488-9d56-4eb5-9512-86ae33266fd9'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:26:27.517831 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:26:27.530633 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-bf12e488-9d56-4eb5-9512-86ae33266fd9 admin admin] The token cache is being invalidate because project 9d2e71ba717f492186d8e5489d4b7887 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:26:27.530927 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-bf12e488-9d56-4eb5-9512-86ae33266fd9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:26:27.531606 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-bf12e488-9d56-4eb5-9512-86ae33266fd9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:26:27.533170 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1411/2838] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 5 12:26:27 2022] DELETE /identity/v3/projects/9d2e71ba717f492186d8e5489d4b7887 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 12:26:27.537126 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d9dd42-a19e-486a-b044-dab65896061a service nova] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:26:27.547896 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d9dd42-a19e-486a-b044-dab65896061a service nova] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:26:27.604256 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ad212a-fa4c-4f0e-83da-9bf4d445d589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:26:27.604888 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ad212a-fa4c-4f0e-83da-9bf4d445d589 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:26:27.605194 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ad212a-fa4c-4f0e-83da-9bf4d445d589 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:26:27.605476 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ad212a-fa4c-4f0e-83da-9bf4d445d589 admin admin] PATH_INFO: `/v3/users/0bbc6562fca847a8ac82db22737c5801` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:26:27.606609 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ad212a-fa4c-4f0e-83da-9bf4d445d589 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0bbc6562fca847a8ac82db22737c5801)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:26:27.608513 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ad212a-fa4c-4f0e-83da-9bf4d445d589 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:26:27.656672 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-f8ad212a-fa4c-4f0e-83da-9bf4d445d589 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0bbc6562fca847a8ac82db22737c5801'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:26:27.657347 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-f8ad212a-fa4c-4f0e-83da-9bf4d445d589 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0bbc6562fca847a8ac82db22737c5801'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:26:27.664763 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-f8ad212a-fa4c-4f0e-83da-9bf4d445d589 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0bbc6562fca847a8ac82db22737c5801'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:26:27.665400 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-f8ad212a-fa4c-4f0e-83da-9bf4d445d589 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0bbc6562fca847a8ac82db22737c5801'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:26:27.677921 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-f8ad212a-fa4c-4f0e-83da-9bf4d445d589 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0bbc6562fca847a8ac82db22737c5801'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:26:27.690136 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1428/2839] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 5 12:26:27 2022] DELETE /identity/v3/users/0bbc6562fca847a8ac82db22737c5801 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:26:27.973254 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf12e488-9d56-4eb5-9512-86ae33266fd9 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:26:27.974863 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-bf12e488-9d56-4eb5-9512-86ae33266fd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:26:27.988737 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf12e488-9d56-4eb5-9512-86ae33266fd9 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:26:28.046413 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a85d4f0-1a40-4d40-80bf-524ceadf3235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:26:28.047043 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a85d4f0-1a40-4d40-80bf-524ceadf3235 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:26:28.047321 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a85d4f0-1a40-4d40-80bf-524ceadf3235 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:26:28.047591 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a85d4f0-1a40-4d40-80bf-524ceadf3235 admin admin] PATH_INFO: `/v3/projects/5665f06bdf084dd8a5c2e25f276ed07a` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:26:28.048699 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a85d4f0-1a40-4d40-80bf-524ceadf3235 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5665f06bdf084dd8a5c2e25f276ed07a)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:26:28.051322 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a85d4f0-1a40-4d40-80bf-524ceadf3235 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:26:28.096788 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-0a85d4f0-1a40-4d40-80bf-524ceadf3235 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5665f06bdf084dd8a5c2e25f276ed07a', 'request_id': 'req-0a85d4f0-1a40-4d40-80bf-524ceadf3235'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:26:28.104330 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-0a85d4f0-1a40-4d40-80bf-524ceadf3235 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5665f06bdf084dd8a5c2e25f276ed07a', 'request_id': 'req-0a85d4f0-1a40-4d40-80bf-524ceadf3235'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:26:28.110602 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-0a85d4f0-1a40-4d40-80bf-524ceadf3235 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5665f06bdf084dd8a5c2e25f276ed07a', 'request_id': 'req-0a85d4f0-1a40-4d40-80bf-524ceadf3235'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:26:28.121766 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-0a85d4f0-1a40-4d40-80bf-524ceadf3235 admin admin] The token cache is being invalidate because project 5665f06bdf084dd8a5c2e25f276ed07a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:26:28.122091 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-0a85d4f0-1a40-4d40-80bf-524ceadf3235 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:26:28.122740 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-0a85d4f0-1a40-4d40-80bf-524ceadf3235 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:26:28.124267 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1412/2840] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 5 12:26:27 2022] DELETE /identity/v3/projects/5665f06bdf084dd8a5c2e25f276ed07a => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:26:28.129621 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c172b7-c095-4da0-8b58-4b4fe3c73a2b None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:26:28.130146 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c172b7-c095-4da0-8b58-4b4fe3c73a2b None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:26:28.130285 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c172b7-c095-4da0-8b58-4b4fe3c73a2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:26:28.150010 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-c7c172b7-c095-4da0-8b58-4b4fe3c73a2b None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:26:28.151208 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-c7c172b7-c095-4da0-8b58-4b4fe3c73a2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:26:28.210037 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1429/2841] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:26:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:26:28.219262 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13798dba-f806-4a97-9b3d-3c22b68d727f None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:26:28.219478 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13798dba-f806-4a97-9b3d-3c22b68d727f None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:26:28.219747 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13798dba-f806-4a97-9b3d-3c22b68d727f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:26:28.241033 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-13798dba-f806-4a97-9b3d-3c22b68d727f None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:26:28.242273 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-13798dba-f806-4a97-9b3d-3c22b68d727f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:26:28.250285 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1413/2842] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:26:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:26:28.254777 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c172b7-c095-4da0-8b58-4b4fe3c73a2b None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:26:28.266060 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c172b7-c095-4da0-8b58-4b4fe3c73a2b None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:26:28.271525 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3375f27-ba40-42fe-921f-f6a52d943f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:26:28.272177 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3375f27-ba40-42fe-921f-f6a52d943f21 admin admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:26:28.272452 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3375f27-ba40-42fe-921f-f6a52d943f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:26:28.272722 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3375f27-ba40-42fe-921f-f6a52d943f21 admin admin] PATH_INFO: `/v3/domains` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:26:28.273437 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3375f27-ba40-42fe-921f-f6a52d943f21 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81719) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:26:28.273736 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3375f27-ba40-42fe-921f-f6a52d943f21 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:26:28.275334 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3375f27-ba40-42fe-921f-f6a52d943f21 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:26:28.278013 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:26:28.293067 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1430/2843] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Sep 5 12:26:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:26:28.294540 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13798dba-f806-4a97-9b3d-3c22b68d727f None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:26:28.304438 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13798dba-f806-4a97-9b3d-3c22b68d727f None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:26:28.308682 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76ad1b8-cf42-431e-babf-5bb906c0209b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:26:28.309430 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76ad1b8-cf42-431e-babf-5bb906c0209b admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:26:28.309770 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76ad1b8-cf42-431e-babf-5bb906c0209b admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:26:28.310104 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76ad1b8-cf42-431e-babf-5bb906c0209b admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:26:28.310810 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76ad1b8-cf42-431e-babf-5bb906c0209b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:26:28.312778 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76ad1b8-cf42-431e-babf-5bb906c0209b admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:26:28.340246 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1414/2844] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 5 12:26:28 2022] POST /identity/v3/projects => generated 387 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:26:28.344462 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3375f27-ba40-42fe-921f-f6a52d943f21 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:26:28.355143 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3375f27-ba40-42fe-921f-f6a52d943f21 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:26:28.412208 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f52f843-f440-4564-97ab-38ab9a8d0cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:26:28.412862 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f52f843-f440-4564-97ab-38ab9a8d0cf0 admin admin] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:26:28.413248 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f52f843-f440-4564-97ab-38ab9a8d0cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:26:28.413564 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f52f843-f440-4564-97ab-38ab9a8d0cf0 admin admin] PATH_INFO: `/v3/users` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:26:28.414373 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f52f843-f440-4564-97ab-38ab9a8d0cf0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:26:28.416707 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f52f843-f440-4564-97ab-38ab9a8d0cf0 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:26:28.438130 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1431/2845] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 5 12:26:28 2022] POST /identity/v3/users => generated 294 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:26:28.442430 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76ad1b8-cf42-431e-babf-5bb906c0209b admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:26:28.452678 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76ad1b8-cf42-431e-babf-5bb906c0209b admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:26:28.457842 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be111647-ecd8-4fb9-b096-852b583935f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:26:28.458439 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be111647-ecd8-4fb9-b096-852b583935f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:26:28.458722 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be111647-ecd8-4fb9-b096-852b583935f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:26:28.458997 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be111647-ecd8-4fb9-b096-852b583935f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:26:28.459644 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be111647-ecd8-4fb9-b096-852b583935f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:26:28.461277 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be111647-ecd8-4fb9-b096-852b583935f7 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:26:28.471581 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1415/2846] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:26:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:26:28.476112 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f52f843-f440-4564-97ab-38ab9a8d0cf0 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:26:28.486514 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f52f843-f440-4564-97ab-38ab9a8d0cf0 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:26:28.491121 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0463abc8-78a9-46dd-90ca-67f3c435d7e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:26:28.491712 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0463abc8-78a9-46dd-90ca-67f3c435d7e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:26:28.491992 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0463abc8-78a9-46dd-90ca-67f3c435d7e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:26:28.492264 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0463abc8-78a9-46dd-90ca-67f3c435d7e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:26:28.492920 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0463abc8-78a9-46dd-90ca-67f3c435d7e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:26:28.494504 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0463abc8-78a9-46dd-90ca-67f3c435d7e9 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:26:28.505126 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1432/2847] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:26:28 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:26:28.509255 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be111647-ecd8-4fb9-b096-852b583935f7 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:26:28.519880 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be111647-ecd8-4fb9-b096-852b583935f7 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:26:28.524702 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1657e9e6-c6e9-49f2-a99a-9b9bd9ba8259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:26:28.525424 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1657e9e6-c6e9-49f2-a99a-9b9bd9ba8259 admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:26:28.525705 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1657e9e6-c6e9-49f2-a99a-9b9bd9ba8259 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:26:28.525979 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1657e9e6-c6e9-49f2-a99a-9b9bd9ba8259 admin admin] PATH_INFO: `/v3/projects/c15410e18b41430cb9acf50483824413/users/82db569c5f35453c99ed04ac2a8bbf31/roles/ed72181e1403401facb77dcf33644757` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:26:28.541850 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1657e9e6-c6e9-49f2-a99a-9b9bd9ba8259 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c15410e18b41430cb9acf50483824413, user_id=82db569c5f35453c99ed04ac2a8bbf31, role_id=ed72181e1403401facb77dcf33644757)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:26:28.544650 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1657e9e6-c6e9-49f2-a99a-9b9bd9ba8259 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:26:28.557210 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1416/2848] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 5 12:26:28 2022] PUT /identity/v3/projects/c15410e18b41430cb9acf50483824413/users/82db569c5f35453c99ed04ac2a8bbf31/roles/ed72181e1403401facb77dcf33644757 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:26:28.567991 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0904edaf-bd82-413c-aa2d-cfe1a9a39a14 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:26:28.568280 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0904edaf-bd82-413c-aa2d-cfe1a9a39a14 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:26:28.568608 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0904edaf-bd82-413c-aa2d-cfe1a9a39a14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:26:28.597594 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-0904edaf-bd82-413c-aa2d-cfe1a9a39a14 None None] MFA Rules not processed for user `82db569c5f35453c99ed04ac2a8bbf31`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:26:28.598819 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-0904edaf-bd82-413c-aa2d-cfe1a9a39a14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:26:28.666377 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1433/2849] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:26:28 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:26:28.671012 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1657e9e6-c6e9-49f2-a99a-9b9bd9ba8259 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:26:28.683729 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:26:28.734972 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1657e9e6-c6e9-49f2-a99a-9b9bd9ba8259 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:26:28.739575 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f49e86-49ea-476e-8faf-2a93560f3237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:26:28.740185 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f49e86-49ea-476e-8faf-2a93560f3237 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:26:28.740465 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f49e86-49ea-476e-8faf-2a93560f3237 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:26:28.740741 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f49e86-49ea-476e-8faf-2a93560f3237 admin admin] PATH_INFO: `/v3/projects` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:26:28.741405 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f49e86-49ea-476e-8faf-2a93560f3237 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:26:28.743325 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f49e86-49ea-476e-8faf-2a93560f3237 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:26:28.771320 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1417/2850] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 5 12:26:28 2022] POST /identity/v3/projects => generated 387 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:26:28.775473 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0904edaf-bd82-413c-aa2d-cfe1a9a39a14 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:26:28.786952 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0904edaf-bd82-413c-aa2d-cfe1a9a39a14 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:26:28.842310 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367e8c85-7932-4993-9bf2-a5ec189e7e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:26:28.842913 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367e8c85-7932-4993-9bf2-a5ec189e7e90 admin admin] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:26:28.843193 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367e8c85-7932-4993-9bf2-a5ec189e7e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:26:28.843466 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367e8c85-7932-4993-9bf2-a5ec189e7e90 admin admin] PATH_INFO: `/v3/users` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:26:28.844135 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367e8c85-7932-4993-9bf2-a5ec189e7e90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:26:28.846104 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367e8c85-7932-4993-9bf2-a5ec189e7e90 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:26:28.855907 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:26:28.867002 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1434/2851] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 5 12:26:28 2022] POST /identity/v3/users => generated 300 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 12:26:28.871065 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f49e86-49ea-476e-8faf-2a93560f3237 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:26:28.882107 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f49e86-49ea-476e-8faf-2a93560f3237 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:26:28.886862 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdfecaf-a7e4-46bd-8171-e51c48004204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:26:28.887452 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdfecaf-a7e4-46bd-8171-e51c48004204 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:26:28.887736 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdfecaf-a7e4-46bd-8171-e51c48004204 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:26:28.888011 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdfecaf-a7e4-46bd-8171-e51c48004204 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:26:28.888643 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdfecaf-a7e4-46bd-8171-e51c48004204 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:26:28.890560 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdfecaf-a7e4-46bd-8171-e51c48004204 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:26:28.901705 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1418/2852] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:26:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:26:28.905783 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367e8c85-7932-4993-9bf2-a5ec189e7e90 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:26:28.915717 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367e8c85-7932-4993-9bf2-a5ec189e7e90 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:26:28.920285 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e3cada-6dd7-4439-a3c2-10bdf1c9cadc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:26:28.920953 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e3cada-6dd7-4439-a3c2-10bdf1c9cadc admin admin] REQUEST_METHOD: `PUT` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:26:28.921232 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e3cada-6dd7-4439-a3c2-10bdf1c9cadc admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:26:28.921504 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e3cada-6dd7-4439-a3c2-10bdf1c9cadc admin admin] PATH_INFO: `/v3/projects/76a2c3b0adb749ce836a314453c3fd24/users/6fc501917b2a4b718fcc0f74d3f31ef0/roles/16e2ccc8bd1b497d8cee780c1c7df0d2` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:26:28.936310 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e3cada-6dd7-4439-a3c2-10bdf1c9cadc admin admin] RBAC: Authorizing `identity:create_grant(project_id=76a2c3b0adb749ce836a314453c3fd24, user_id=6fc501917b2a4b718fcc0f74d3f31ef0, role_id=16e2ccc8bd1b497d8cee780c1c7df0d2)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:26:28.938971 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e3cada-6dd7-4439-a3c2-10bdf1c9cadc admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:26:28.951974 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1435/2853] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 5 12:26:28 2022] PUT /identity/v3/projects/76a2c3b0adb749ce836a314453c3fd24/users/6fc501917b2a4b718fcc0f74d3f31ef0/roles/16e2ccc8bd1b497d8cee780c1c7df0d2 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:26:28.956083 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdfecaf-a7e4-46bd-8171-e51c48004204 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:26:28.965988 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdfecaf-a7e4-46bd-8171-e51c48004204 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:26:29.023097 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f1f03b-f943-422c-aec1-210d752a69b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:26:29.023782 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f1f03b-f943-422c-aec1-210d752a69b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:26:29.023901 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f1f03b-f943-422c-aec1-210d752a69b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:26:29.024135 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f1f03b-f943-422c-aec1-210d752a69b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:26:29.024778 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f1f03b-f943-422c-aec1-210d752a69b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:26:29.026426 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f1f03b-f943-422c-aec1-210d752a69b6 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:26:29.037026 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1419/2854] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:26:28 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:26:29.041516 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e3cada-6dd7-4439-a3c2-10bdf1c9cadc admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:26:29.052410 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e3cada-6dd7-4439-a3c2-10bdf1c9cadc admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:26:29.057019 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735c4be1-03e8-4e52-81f4-a722b35511b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:26:29.057670 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735c4be1-03e8-4e52-81f4-a722b35511b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:26:29.057953 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735c4be1-03e8-4e52-81f4-a722b35511b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:26:29.058227 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735c4be1-03e8-4e52-81f4-a722b35511b7 admin admin] PATH_INFO: `/v3/projects/76a2c3b0adb749ce836a314453c3fd24/users/6fc501917b2a4b718fcc0f74d3f31ef0/roles/16e2ccc8bd1b497d8cee780c1c7df0d2` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:26:29.060183 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735c4be1-03e8-4e52-81f4-a722b35511b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76a2c3b0adb749ce836a314453c3fd24, user_id=6fc501917b2a4b718fcc0f74d3f31ef0, role_id=16e2ccc8bd1b497d8cee780c1c7df0d2)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:26:29.062867 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735c4be1-03e8-4e52-81f4-a722b35511b7 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:26:29.074808 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1436/2855] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 5 12:26:29 2022] PUT /identity/v3/projects/76a2c3b0adb749ce836a314453c3fd24/users/6fc501917b2a4b718fcc0f74d3f31ef0/roles/16e2ccc8bd1b497d8cee780c1c7df0d2 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:26:29.085782 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ae9afb-627c-4a7b-a27e-87616aa57932 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:26:29.086083 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ae9afb-627c-4a7b-a27e-87616aa57932 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:26:29.086360 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ae9afb-627c-4a7b-a27e-87616aa57932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:26:29.117717 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-67ae9afb-627c-4a7b-a27e-87616aa57932 None None] MFA Rules not processed for user `6fc501917b2a4b718fcc0f74d3f31ef0`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:26:29.119512 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-67ae9afb-627c-4a7b-a27e-87616aa57932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:26:29.194651 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1420/2856] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:26:29 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:26:29.205992 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735c4be1-03e8-4e52-81f4-a722b35511b7 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:26:29.207738 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-735c4be1-03e8-4e52-81f4-a722b35511b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:26:29.273441 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735c4be1-03e8-4e52-81f4-a722b35511b7 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:26:29.279220 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b216c390-f4d9-4211-a250-29817869f7e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37633bbae0c2423c81ccd61ac3a17ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:26:29.279803 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b216c390-f4d9-4211-a250-29817869f7e1 service cinder] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:26:29.279803 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b216c390-f4d9-4211-a250-29817869f7e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:26:29.279988 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b216c390-f4d9-4211-a250-29817869f7e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:26:29.291131 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b216c390-f4d9-4211-a250-29817869f7e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:26:29.292580 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b216c390-f4d9-4211-a250-29817869f7e1 service cinder] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:26:29.306558 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1437/2857] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:26:29 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:26:29.905012 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ae9afb-627c-4a7b-a27e-87616aa57932 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:26:29.913433 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:26:29.967348 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ae9afb-627c-4a7b-a27e-87616aa57932 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:26:29.971954 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234cb7fc-8581-477b-b569-3f1ef9cb591d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:26:29.972607 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234cb7fc-8581-477b-b569-3f1ef9cb591d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:26:29.972886 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234cb7fc-8581-477b-b569-3f1ef9cb591d admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:26:29.973188 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234cb7fc-8581-477b-b569-3f1ef9cb591d admin admin] PATH_INFO: `/v3/users/82db569c5f35453c99ed04ac2a8bbf31` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:26:29.974318 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234cb7fc-8581-477b-b569-3f1ef9cb591d admin admin] RBAC: Authorizing `identity:delete_user(user_id=82db569c5f35453c99ed04ac2a8bbf31)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:26:29.976238 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234cb7fc-8581-477b-b569-3f1ef9cb591d admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:26:30.023496 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-234cb7fc-8581-477b-b569-3f1ef9cb591d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82db569c5f35453c99ed04ac2a8bbf31'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:26:30.024298 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-234cb7fc-8581-477b-b569-3f1ef9cb591d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82db569c5f35453c99ed04ac2a8bbf31'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:26:30.031489 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-234cb7fc-8581-477b-b569-3f1ef9cb591d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82db569c5f35453c99ed04ac2a8bbf31'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:26:30.032143 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-234cb7fc-8581-477b-b569-3f1ef9cb591d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82db569c5f35453c99ed04ac2a8bbf31'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:26:30.044820 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-234cb7fc-8581-477b-b569-3f1ef9cb591d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82db569c5f35453c99ed04ac2a8bbf31'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:26:30.057618 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1421/2858] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 5 12:26:29 2022] DELETE /identity/v3/users/82db569c5f35453c99ed04ac2a8bbf31 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:26:30.062143 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce469df1-7753-460b-8e07-7e9bc1281bed None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:26:30.062427 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce469df1-7753-460b-8e07-7e9bc1281bed None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:26:30.062699 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce469df1-7753-460b-8e07-7e9bc1281bed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:26:30.080980 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-ce469df1-7753-460b-8e07-7e9bc1281bed None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:26:30.082168 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-ce469df1-7753-460b-8e07-7e9bc1281bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:26:30.140287 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1438/2859] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:26:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:26:30.150214 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234cb7fc-8581-477b-b569-3f1ef9cb591d admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:26:30.151619 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-234cb7fc-8581-477b-b569-3f1ef9cb591d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:26:30.211066 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234cb7fc-8581-477b-b569-3f1ef9cb591d admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:26:30.214700 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296d1099-ec34-43ce-b37f-83e9d4315806 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4994b4faa4ec4aa088f3dc32c9c5614d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:26:30.215312 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296d1099-ec34-43ce-b37f-83e9d4315806 service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:26:30.215591 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296d1099-ec34-43ce-b37f-83e9d4315806 service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:26:30.215862 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296d1099-ec34-43ce-b37f-83e9d4315806 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:26:30.226255 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296d1099-ec34-43ce-b37f-83e9d4315806 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:26:30.227696 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296d1099-ec34-43ce-b37f-83e9d4315806 service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:26:30.240983 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1422/2860] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:26:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:26:30.462412 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8560145d-3c3e-479d-830b-cb26c7153c9a None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:26:30.462890 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8560145d-3c3e-479d-830b-cb26c7153c9a None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:26:30.462976 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8560145d-3c3e-479d-830b-cb26c7153c9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:26:30.484243 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-8560145d-3c3e-479d-830b-cb26c7153c9a None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:26:30.485483 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-8560145d-3c3e-479d-830b-cb26c7153c9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:26:30.493501 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1439/2861] 10.222.0.26 () {58 vars in 1016 bytes} [Mon Sep 5 12:26:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:26:30.509961 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296d1099-ec34-43ce-b37f-83e9d4315806 service neutron] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:26:30.511480 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-296d1099-ec34-43ce-b37f-83e9d4315806 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:26:30.532275 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8560145d-3c3e-479d-830b-cb26c7153c9a None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:26:30.533823 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-8560145d-3c3e-479d-830b-cb26c7153c9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:26:30.553175 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:26:30.560762 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8560145d-3c3e-479d-830b-cb26c7153c9a None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:26:30.566374 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fb5ae5-bfcc-4c3a-993e-9d849081a4c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:26:30.567399 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fb5ae5-bfcc-4c3a-993e-9d849081a4c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:26:30.567683 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fb5ae5-bfcc-4c3a-993e-9d849081a4c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:26:30.568015 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fb5ae5-bfcc-4c3a-993e-9d849081a4c2 admin admin] PATH_INFO: `/v3/projects/c15410e18b41430cb9acf50483824413` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:26:30.569563 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fb5ae5-bfcc-4c3a-993e-9d849081a4c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c15410e18b41430cb9acf50483824413)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:26:30.571586 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fb5ae5-bfcc-4c3a-993e-9d849081a4c2 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:26:30.599257 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296d1099-ec34-43ce-b37f-83e9d4315806 service neutron] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:26:30.605428 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5684074-8118-4bac-b203-e19d1d0324f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb060ff495bc4abb83ff88992fb7be09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:26:30.606044 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5684074-8118-4bac-b203-e19d1d0324f4 service nova] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:26:30.606324 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5684074-8118-4bac-b203-e19d1d0324f4 service nova] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:26:30.606594 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5684074-8118-4bac-b203-e19d1d0324f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:26:30.615349 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5684074-8118-4bac-b203-e19d1d0324f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:26:30.617140 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5684074-8118-4bac-b203-e19d1d0324f4 service nova] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:26:30.618935 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:INSERT=3,keystone:SELECT=93,keystone:DELETE=4 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:26:30.620403 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-f3fb5ae5-bfcc-4c3a-993e-9d849081a4c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c15410e18b41430cb9acf50483824413', 'request_id': 'req-f3fb5ae5-bfcc-4c3a-993e-9d849081a4c2'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:26:30.627337 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1423/2862] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:26:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:26:30.629169 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-f3fb5ae5-bfcc-4c3a-993e-9d849081a4c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c15410e18b41430cb9acf50483824413', 'request_id': 'req-f3fb5ae5-bfcc-4c3a-993e-9d849081a4c2'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:26:30.635252 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-f3fb5ae5-bfcc-4c3a-993e-9d849081a4c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c15410e18b41430cb9acf50483824413', 'request_id': 'req-f3fb5ae5-bfcc-4c3a-993e-9d849081a4c2'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:26:30.647645 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-f3fb5ae5-bfcc-4c3a-993e-9d849081a4c2 admin admin] The token cache is being invalidate because project c15410e18b41430cb9acf50483824413 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:26:30.647788 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-f3fb5ae5-bfcc-4c3a-993e-9d849081a4c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:26:30.648460 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-f3fb5ae5-bfcc-4c3a-993e-9d849081a4c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:26:30.650046 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1440/2863] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 5 12:26:30 2022] DELETE /identity/v3/projects/c15410e18b41430cb9acf50483824413 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:26:30.654093 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5684074-8118-4bac-b203-e19d1d0324f4 service nova] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:26:30.664746 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5684074-8118-4bac-b203-e19d1d0324f4 service nova] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:26:30.724131 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ab5e4a-8867-4447-b912-e6d18cf9e68a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:26:30.724763 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ab5e4a-8867-4447-b912-e6d18cf9e68a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:26:30.725073 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ab5e4a-8867-4447-b912-e6d18cf9e68a admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:26:30.725349 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ab5e4a-8867-4447-b912-e6d18cf9e68a admin admin] PATH_INFO: `/v3/users/6fc501917b2a4b718fcc0f74d3f31ef0` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:26:30.726486 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ab5e4a-8867-4447-b912-e6d18cf9e68a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6fc501917b2a4b718fcc0f74d3f31ef0)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:26:30.728401 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ab5e4a-8867-4447-b912-e6d18cf9e68a admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:26:30.774583 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-21ab5e4a-8867-4447-b912-e6d18cf9e68a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6fc501917b2a4b718fcc0f74d3f31ef0'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:26:30.775256 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-21ab5e4a-8867-4447-b912-e6d18cf9e68a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6fc501917b2a4b718fcc0f74d3f31ef0'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:26:30.783357 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-21ab5e4a-8867-4447-b912-e6d18cf9e68a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6fc501917b2a4b718fcc0f74d3f31ef0'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:26:30.784141 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-21ab5e4a-8867-4447-b912-e6d18cf9e68a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6fc501917b2a4b718fcc0f74d3f31ef0'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:26:30.798287 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-21ab5e4a-8867-4447-b912-e6d18cf9e68a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6fc501917b2a4b718fcc0f74d3f31ef0'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:26:30.810206 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1424/2864] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 5 12:26:30 2022] DELETE /identity/v3/users/6fc501917b2a4b718fcc0f74d3f31ef0 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:26:31.081980 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fb5ae5-bfcc-4c3a-993e-9d849081a4c2 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:26:31.084028 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-f3fb5ae5-bfcc-4c3a-993e-9d849081a4c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:26:31.104856 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fb5ae5-bfcc-4c3a-993e-9d849081a4c2 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:26:31.162099 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364befc0-f11c-4a89-9cf0-b679a1117b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:26:31.162643 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364befc0-f11c-4a89-9cf0-b679a1117b23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:26:31.162922 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364befc0-f11c-4a89-9cf0-b679a1117b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:26:31.163195 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364befc0-f11c-4a89-9cf0-b679a1117b23 admin admin] PATH_INFO: `/v3/projects/76a2c3b0adb749ce836a314453c3fd24` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:26:31.164311 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364befc0-f11c-4a89-9cf0-b679a1117b23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76a2c3b0adb749ce836a314453c3fd24)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:26:31.166258 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364befc0-f11c-4a89-9cf0-b679a1117b23 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:26:31.213043 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-364befc0-f11c-4a89-9cf0-b679a1117b23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76a2c3b0adb749ce836a314453c3fd24', 'request_id': 'req-364befc0-f11c-4a89-9cf0-b679a1117b23'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:26:31.220812 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-364befc0-f11c-4a89-9cf0-b679a1117b23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76a2c3b0adb749ce836a314453c3fd24', 'request_id': 'req-364befc0-f11c-4a89-9cf0-b679a1117b23'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:26:31.226385 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-364befc0-f11c-4a89-9cf0-b679a1117b23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76a2c3b0adb749ce836a314453c3fd24', 'request_id': 'req-364befc0-f11c-4a89-9cf0-b679a1117b23'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:26:31.238349 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-364befc0-f11c-4a89-9cf0-b679a1117b23 admin admin] The token cache is being invalidate because project 76a2c3b0adb749ce836a314453c3fd24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:26:31.238632 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-364befc0-f11c-4a89-9cf0-b679a1117b23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:26:31.239300 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-364befc0-f11c-4a89-9cf0-b679a1117b23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:26:31.240783 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1441/2865] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 5 12:26:31 2022] DELETE /identity/v3/projects/76a2c3b0adb749ce836a314453c3fd24 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:26:31.245641 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf36cf08-a398-454a-854a-d18ffcdb1cfe None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:26:31.246108 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf36cf08-a398-454a-854a-d18ffcdb1cfe None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:26:31.246209 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf36cf08-a398-454a-854a-d18ffcdb1cfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:26:31.267520 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-bf36cf08-a398-454a-854a-d18ffcdb1cfe None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:26:31.268717 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-bf36cf08-a398-454a-854a-d18ffcdb1cfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:26:31.297511 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:26:31.330315 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1425/2866] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:26:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:26:31.339159 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8e6c00-eed1-4a9a-b275-7cbe4cbf230a None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:26:31.339499 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8e6c00-eed1-4a9a-b275-7cbe4cbf230a None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:26:31.339772 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8e6c00-eed1-4a9a-b275-7cbe4cbf230a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:26:31.363514 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-ee8e6c00-eed1-4a9a-b275-7cbe4cbf230a None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:26:31.365330 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-ee8e6c00-eed1-4a9a-b275-7cbe4cbf230a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:26:31.373702 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1442/2867] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:26:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:26:31.378047 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf36cf08-a398-454a-854a-d18ffcdb1cfe None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:26:31.388517 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf36cf08-a398-454a-854a-d18ffcdb1cfe None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:26:31.393380 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee26e491-cc6e-4fc0-9dd9-fa70d4649221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:26:31.394016 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee26e491-cc6e-4fc0-9dd9-fa70d4649221 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:26:31.394293 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee26e491-cc6e-4fc0-9dd9-fa70d4649221 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:26:31.394563 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee26e491-cc6e-4fc0-9dd9-fa70d4649221 admin admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:26:31.395211 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee26e491-cc6e-4fc0-9dd9-fa70d4649221 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:26:31.395627 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee26e491-cc6e-4fc0-9dd9-fa70d4649221 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:26:31.397257 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee26e491-cc6e-4fc0-9dd9-fa70d4649221 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:26:31.409383 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1426/2868] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Sep 5 12:26:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:26:31.414114 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8e6c00-eed1-4a9a-b275-7cbe4cbf230a None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:26:31.423684 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8e6c00-eed1-4a9a-b275-7cbe4cbf230a None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:26:31.429256 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f4a846-cd63-4947-a515-9258f5f29b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:26:31.429878 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f4a846-cd63-4947-a515-9258f5f29b47 admin admin] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:26:31.430215 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f4a846-cd63-4947-a515-9258f5f29b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:26:31.430569 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f4a846-cd63-4947-a515-9258f5f29b47 admin admin] PATH_INFO: `/v3/projects` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:26:31.431256 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f4a846-cd63-4947-a515-9258f5f29b47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:26:31.433204 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f4a846-cd63-4947-a515-9258f5f29b47 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:26:31.463895 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1443/2869] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 5 12:26:31 2022] POST /identity/v3/projects => generated 381 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:26:31.468678 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee26e491-cc6e-4fc0-9dd9-fa70d4649221 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:26:31.479626 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee26e491-cc6e-4fc0-9dd9-fa70d4649221 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:26:31.540669 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3c09cf-486a-44ab-ba0d-b71e217a60ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:26:31.541307 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3c09cf-486a-44ab-ba0d-b71e217a60ed admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:26:31.541585 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3c09cf-486a-44ab-ba0d-b71e217a60ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:26:31.541853 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3c09cf-486a-44ab-ba0d-b71e217a60ed admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:26:31.542491 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3c09cf-486a-44ab-ba0d-b71e217a60ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:26:31.544389 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3c09cf-486a-44ab-ba0d-b71e217a60ed admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:26:31.566763 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1427/2870] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 5 12:26:31 2022] POST /identity/v3/users => generated 291 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:26:31.570850 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f4a846-cd63-4947-a515-9258f5f29b47 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:26:31.581102 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f4a846-cd63-4947-a515-9258f5f29b47 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:26:31.585587 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c64191-7155-4521-91ee-1796cc92cd66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:26:31.586177 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c64191-7155-4521-91ee-1796cc92cd66 admin admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:26:31.586459 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c64191-7155-4521-91ee-1796cc92cd66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:26:31.586727 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c64191-7155-4521-91ee-1796cc92cd66 admin admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:26:31.587360 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c64191-7155-4521-91ee-1796cc92cd66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:26:31.588966 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c64191-7155-4521-91ee-1796cc92cd66 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:26:31.599276 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1444/2871] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:26:31 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:26:31.603190 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3c09cf-486a-44ab-ba0d-b71e217a60ed admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:26:31.613998 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3c09cf-486a-44ab-ba0d-b71e217a60ed admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:26:31.618613 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25fc1c2-b954-438e-baf5-f2f273c46915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:26:31.619209 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25fc1c2-b954-438e-baf5-f2f273c46915 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:26:31.619487 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25fc1c2-b954-438e-baf5-f2f273c46915 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:26:31.619758 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25fc1c2-b954-438e-baf5-f2f273c46915 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:26:31.620394 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25fc1c2-b954-438e-baf5-f2f273c46915 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:26:31.622011 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25fc1c2-b954-438e-baf5-f2f273c46915 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:26:31.632596 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1428/2872] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:26:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:26:31.636697 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c64191-7155-4521-91ee-1796cc92cd66 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:26:31.647085 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c64191-7155-4521-91ee-1796cc92cd66 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:26:31.652321 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c8fade-11a2-4fc2-881d-4cda76bafca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:26:31.652882 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c8fade-11a2-4fc2-881d-4cda76bafca7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:26:31.653193 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c8fade-11a2-4fc2-881d-4cda76bafca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:26:31.653480 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c8fade-11a2-4fc2-881d-4cda76bafca7 admin admin] PATH_INFO: `/v3/projects/b9707dadf4b54672af48f04a2c82c5a9/users/110fbe0b06eb403bab25cbc03c18d52c/roles/ed72181e1403401facb77dcf33644757` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:26:31.669801 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c8fade-11a2-4fc2-881d-4cda76bafca7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9707dadf4b54672af48f04a2c82c5a9, user_id=110fbe0b06eb403bab25cbc03c18d52c, role_id=ed72181e1403401facb77dcf33644757)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:26:31.672391 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c8fade-11a2-4fc2-881d-4cda76bafca7 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:26:31.688708 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1445/2873] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 5 12:26:31 2022] PUT /identity/v3/projects/b9707dadf4b54672af48f04a2c82c5a9/users/110fbe0b06eb403bab25cbc03c18d52c/roles/ed72181e1403401facb77dcf33644757 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:26:31.699104 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627a129f-feba-474c-98e0-cfcb03e8e751 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:26:31.699385 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627a129f-feba-474c-98e0-cfcb03e8e751 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:26:31.699655 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627a129f-feba-474c-98e0-cfcb03e8e751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:26:31.728291 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-627a129f-feba-474c-98e0-cfcb03e8e751 None None] MFA Rules not processed for user `110fbe0b06eb403bab25cbc03c18d52c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:26:31.729613 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-627a129f-feba-474c-98e0-cfcb03e8e751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:26:31.802858 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1429/2874] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:26:31 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 12:26:31.807474 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c8fade-11a2-4fc2-881d-4cda76bafca7 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:26:31.812149 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:26:31.911338 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c8fade-11a2-4fc2-881d-4cda76bafca7 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:26:31.916159 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e8af47-2cea-4b54-99c9-ddd1c8ec4ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:26:31.916770 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e8af47-2cea-4b54-99c9-ddd1c8ec4ff1 admin admin] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:26:31.917086 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e8af47-2cea-4b54-99c9-ddd1c8ec4ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:26:31.917362 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e8af47-2cea-4b54-99c9-ddd1c8ec4ff1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:26:31.918016 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e8af47-2cea-4b54-99c9-ddd1c8ec4ff1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:26:31.919986 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e8af47-2cea-4b54-99c9-ddd1c8ec4ff1 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:26:31.949346 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1446/2875] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 5 12:26:31 2022] POST /identity/v3/projects => generated 379 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:26:31.953795 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627a129f-feba-474c-98e0-cfcb03e8e751 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:26:31.966680 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627a129f-feba-474c-98e0-cfcb03e8e751 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:26:31.996518 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:26:32.029889 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048f5d9a-dacb-415b-98fb-0b7b483052f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:26:32.030497 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048f5d9a-dacb-415b-98fb-0b7b483052f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:26:32.030771 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048f5d9a-dacb-415b-98fb-0b7b483052f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:26:32.031040 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048f5d9a-dacb-415b-98fb-0b7b483052f2 admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:26:32.031681 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048f5d9a-dacb-415b-98fb-0b7b483052f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:26:32.033623 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048f5d9a-dacb-415b-98fb-0b7b483052f2 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:26:32.055978 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1430/2876] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 5 12:26:31 2022] POST /identity/v3/users => generated 296 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:26:32.060486 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e8af47-2cea-4b54-99c9-ddd1c8ec4ff1 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:26:32.071128 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e8af47-2cea-4b54-99c9-ddd1c8ec4ff1 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:26:32.076130 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c72162-362b-4b58-9d75-fc92531f49fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:26:32.076741 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c72162-362b-4b58-9d75-fc92531f49fe admin admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:26:32.077080 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c72162-362b-4b58-9d75-fc92531f49fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:26:32.077342 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c72162-362b-4b58-9d75-fc92531f49fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:26:32.077998 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c72162-362b-4b58-9d75-fc92531f49fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:26:32.079589 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c72162-362b-4b58-9d75-fc92531f49fe admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:26:32.094575 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1447/2877] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:26:32 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:26:32.099604 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048f5d9a-dacb-415b-98fb-0b7b483052f2 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:26:32.109514 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048f5d9a-dacb-415b-98fb-0b7b483052f2 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:26:32.114092 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367b9067-f617-4757-b7fe-eecde93b7382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:26:32.114730 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367b9067-f617-4757-b7fe-eecde93b7382 admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:26:32.115005 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367b9067-f617-4757-b7fe-eecde93b7382 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:26:32.115277 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367b9067-f617-4757-b7fe-eecde93b7382 admin admin] PATH_INFO: `/v3/projects/382ee7c990c04d269edc4d106a85e6e9/users/0a2d377b9e9a4f1d8ef4d4ed3611af4a/roles/16e2ccc8bd1b497d8cee780c1c7df0d2` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:26:32.129806 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367b9067-f617-4757-b7fe-eecde93b7382 admin admin] RBAC: Authorizing `identity:create_grant(project_id=382ee7c990c04d269edc4d106a85e6e9, user_id=0a2d377b9e9a4f1d8ef4d4ed3611af4a, role_id=16e2ccc8bd1b497d8cee780c1c7df0d2)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:26:32.132471 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367b9067-f617-4757-b7fe-eecde93b7382 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:26:32.146314 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1431/2878] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 5 12:26:32 2022] PUT /identity/v3/projects/382ee7c990c04d269edc4d106a85e6e9/users/0a2d377b9e9a4f1d8ef4d4ed3611af4a/roles/16e2ccc8bd1b497d8cee780c1c7df0d2 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:26:32.150345 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c72162-362b-4b58-9d75-fc92531f49fe admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:26:32.160964 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c72162-362b-4b58-9d75-fc92531f49fe admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:26:32.216553 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a28997-bbf2-4cc2-8aad-6d983c2dc947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:26:32.217117 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a28997-bbf2-4cc2-8aad-6d983c2dc947 admin admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:26:32.217379 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a28997-bbf2-4cc2-8aad-6d983c2dc947 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:26:32.217653 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a28997-bbf2-4cc2-8aad-6d983c2dc947 admin admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:26:32.218283 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a28997-bbf2-4cc2-8aad-6d983c2dc947 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:26:32.219857 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a28997-bbf2-4cc2-8aad-6d983c2dc947 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:26:32.230086 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1448/2879] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:26:32 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:26:32.234745 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367b9067-f617-4757-b7fe-eecde93b7382 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:26:32.245236 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367b9067-f617-4757-b7fe-eecde93b7382 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:26:32.249857 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b303d8b6-d463-46a0-a2a5-4036d92041f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:26:32.250501 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b303d8b6-d463-46a0-a2a5-4036d92041f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:26:32.250782 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b303d8b6-d463-46a0-a2a5-4036d92041f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:26:32.251055 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b303d8b6-d463-46a0-a2a5-4036d92041f1 admin admin] PATH_INFO: `/v3/projects/382ee7c990c04d269edc4d106a85e6e9/users/0a2d377b9e9a4f1d8ef4d4ed3611af4a/roles/16e2ccc8bd1b497d8cee780c1c7df0d2` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:26:32.252989 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b303d8b6-d463-46a0-a2a5-4036d92041f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=382ee7c990c04d269edc4d106a85e6e9, user_id=0a2d377b9e9a4f1d8ef4d4ed3611af4a, role_id=16e2ccc8bd1b497d8cee780c1c7df0d2)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:26:32.255642 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b303d8b6-d463-46a0-a2a5-4036d92041f1 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:26:32.267784 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1432/2880] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 5 12:26:32 2022] PUT /identity/v3/projects/382ee7c990c04d269edc4d106a85e6e9/users/0a2d377b9e9a4f1d8ef4d4ed3611af4a/roles/16e2ccc8bd1b497d8cee780c1c7df0d2 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:26:32.279409 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db91cf79-6f18-4b08-a738-1f00fc5f4763 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:26:32.279691 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db91cf79-6f18-4b08-a738-1f00fc5f4763 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:26:32.279983 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db91cf79-6f18-4b08-a738-1f00fc5f4763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:26:32.307457 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-db91cf79-6f18-4b08-a738-1f00fc5f4763 None None] MFA Rules not processed for user `0a2d377b9e9a4f1d8ef4d4ed3611af4a`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:26:32.308649 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-db91cf79-6f18-4b08-a738-1f00fc5f4763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:26:32.371771 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:26:32.378801 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1449/2881] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:26:32 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:26:32.389359 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b303d8b6-d463-46a0-a2a5-4036d92041f1 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:26:32.391419 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-b303d8b6-d463-46a0-a2a5-4036d92041f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:26:32.448491 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b303d8b6-d463-46a0-a2a5-4036d92041f1 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:26:32.452282 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7963bd5-9611-441c-81d9-a04c318ed563 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37633bbae0c2423c81ccd61ac3a17ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:26:32.452887 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7963bd5-9611-441c-81d9-a04c318ed563 service cinder] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:26:32.453191 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7963bd5-9611-441c-81d9-a04c318ed563 service cinder] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:26:32.453467 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7963bd5-9611-441c-81d9-a04c318ed563 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:26:32.463069 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7963bd5-9611-441c-81d9-a04c318ed563 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:26:32.464501 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7963bd5-9611-441c-81d9-a04c318ed563 service cinder] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:26:32.474057 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1433/2882] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:26:32 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:26:32.940764 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db91cf79-6f18-4b08-a738-1f00fc5f4763 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:26:33.005949 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db91cf79-6f18-4b08-a738-1f00fc5f4763 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:26:33.010879 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da01e02-234a-455a-a861-7a7dce148bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:26:33.011527 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da01e02-234a-455a-a861-7a7dce148bae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:26:33.011805 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da01e02-234a-455a-a861-7a7dce148bae admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:26:33.012079 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da01e02-234a-455a-a861-7a7dce148bae admin admin] PATH_INFO: `/v3/users/110fbe0b06eb403bab25cbc03c18d52c` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:26:33.013492 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da01e02-234a-455a-a861-7a7dce148bae admin admin] RBAC: Authorizing `identity:delete_user(user_id=110fbe0b06eb403bab25cbc03c18d52c)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:26:33.015735 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da01e02-234a-455a-a861-7a7dce148bae admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:26:33.084260 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-4da01e02-234a-455a-a861-7a7dce148bae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '110fbe0b06eb403bab25cbc03c18d52c'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:26:33.084985 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-4da01e02-234a-455a-a861-7a7dce148bae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '110fbe0b06eb403bab25cbc03c18d52c'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:26:33.093681 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-4da01e02-234a-455a-a861-7a7dce148bae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '110fbe0b06eb403bab25cbc03c18d52c'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:26:33.094463 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-4da01e02-234a-455a-a861-7a7dce148bae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '110fbe0b06eb403bab25cbc03c18d52c'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:26:33.110528 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-4da01e02-234a-455a-a861-7a7dce148bae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '110fbe0b06eb403bab25cbc03c18d52c'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:26:33.123568 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1450/2883] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 5 12:26:32 2022] DELETE /identity/v3/users/110fbe0b06eb403bab25cbc03c18d52c => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:26:33.128245 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0117e9b5-14ab-4716-b3e9-8d184d862bd8 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:26:33.128535 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0117e9b5-14ab-4716-b3e9-8d184d862bd8 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:26:33.128810 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0117e9b5-14ab-4716-b3e9-8d184d862bd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:26:33.151899 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-0117e9b5-14ab-4716-b3e9-8d184d862bd8 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:26:33.153213 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-0117e9b5-14ab-4716-b3e9-8d184d862bd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:26:33.217074 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1434/2884] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:26:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:26:33.227681 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da01e02-234a-455a-a861-7a7dce148bae admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:26:33.229194 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-4da01e02-234a-455a-a861-7a7dce148bae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:26:33.290633 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da01e02-234a-455a-a861-7a7dce148bae admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:26:33.294204 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089f8e89-bb1f-470a-b4c4-b597b751a9ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4994b4faa4ec4aa088f3dc32c9c5614d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:26:33.294816 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089f8e89-bb1f-470a-b4c4-b597b751a9ba service neutron] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:26:33.295103 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089f8e89-bb1f-470a-b4c4-b597b751a9ba service neutron] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:26:33.295424 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089f8e89-bb1f-470a-b4c4-b597b751a9ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:26:33.305266 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089f8e89-bb1f-470a-b4c4-b597b751a9ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:26:33.306706 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089f8e89-bb1f-470a-b4c4-b597b751a9ba service neutron] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:26:33.316279 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1451/2885] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:26:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:26:33.613175 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0117e9b5-14ab-4716-b3e9-8d184d862bd8 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:26:33.615433 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-0117e9b5-14ab-4716-b3e9-8d184d862bd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:26:33.628616 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0117e9b5-14ab-4716-b3e9-8d184d862bd8 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:26:33.635150 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407274d6-2ef4-4b6c-9629-2a50eb5b07e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:26:33.635616 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407274d6-2ef4-4b6c-9629-2a50eb5b07e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:26:33.636021 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407274d6-2ef4-4b6c-9629-2a50eb5b07e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:26:33.636964 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407274d6-2ef4-4b6c-9629-2a50eb5b07e8 admin admin] PATH_INFO: `/v3/projects/b9707dadf4b54672af48f04a2c82c5a9` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:26:33.637913 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407274d6-2ef4-4b6c-9629-2a50eb5b07e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9707dadf4b54672af48f04a2c82c5a9)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:26:33.641197 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407274d6-2ef4-4b6c-9629-2a50eb5b07e8 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:26:33.668154 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:26:33.668803 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c342aa-89f8-4b13-8a56-05446c89fb2c None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:26:33.669115 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c342aa-89f8-4b13-8a56-05446c89fb2c None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:26:33.669396 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c342aa-89f8-4b13-8a56-05446c89fb2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:26:33.690872 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-d2c342aa-89f8-4b13-8a56-05446c89fb2c None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:26:33.692145 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-d2c342aa-89f8-4b13-8a56-05446c89fb2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:26:33.700176 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-407274d6-2ef4-4b6c-9629-2a50eb5b07e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9707dadf4b54672af48f04a2c82c5a9', 'request_id': 'req-407274d6-2ef4-4b6c-9629-2a50eb5b07e8'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:26:33.706175 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:26:33.710487 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-407274d6-2ef4-4b6c-9629-2a50eb5b07e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9707dadf4b54672af48f04a2c82c5a9', 'request_id': 'req-407274d6-2ef4-4b6c-9629-2a50eb5b07e8'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:26:33.718674 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-407274d6-2ef4-4b6c-9629-2a50eb5b07e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9707dadf4b54672af48f04a2c82c5a9', 'request_id': 'req-407274d6-2ef4-4b6c-9629-2a50eb5b07e8'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:26:33.730507 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-407274d6-2ef4-4b6c-9629-2a50eb5b07e8 admin admin] The token cache is being invalidate because project b9707dadf4b54672af48f04a2c82c5a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:26:33.730801 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-407274d6-2ef4-4b6c-9629-2a50eb5b07e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:26:33.731460 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-407274d6-2ef4-4b6c-9629-2a50eb5b07e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:26:33.733015 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1435/2886] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 5 12:26:33 2022] DELETE /identity/v3/projects/b9707dadf4b54672af48f04a2c82c5a9 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:26:33.737150 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407274d6-2ef4-4b6c-9629-2a50eb5b07e8 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:26:33.738597 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-407274d6-2ef4-4b6c-9629-2a50eb5b07e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:26:33.760540 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1452/2887] 10.222.0.26 () {58 vars in 1016 bytes} [Mon Sep 5 12:26:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 12:26:33.785731 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c342aa-89f8-4b13-8a56-05446c89fb2c None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:26:33.785731 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-d2c342aa-89f8-4b13-8a56-05446c89fb2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:26:33.817494 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407274d6-2ef4-4b6c-9629-2a50eb5b07e8 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:26:33.825815 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733e0cf0-15b0-4960-9759-d0720a9ff982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:26:33.826910 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733e0cf0-15b0-4960-9759-d0720a9ff982 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:26:33.827427 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733e0cf0-15b0-4960-9759-d0720a9ff982 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:26:33.827971 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733e0cf0-15b0-4960-9759-d0720a9ff982 admin admin] PATH_INFO: `/v3/users/0a2d377b9e9a4f1d8ef4d4ed3611af4a` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:26:33.830003 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733e0cf0-15b0-4960-9759-d0720a9ff982 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a2d377b9e9a4f1d8ef4d4ed3611af4a)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:26:33.834493 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733e0cf0-15b0-4960-9759-d0720a9ff982 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:26:33.861472 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c342aa-89f8-4b13-8a56-05446c89fb2c None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:26:33.867238 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4943a7-7b8b-428e-9229-b973aedbaf28 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb060ff495bc4abb83ff88992fb7be09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:26:33.867870 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4943a7-7b8b-428e-9229-b973aedbaf28 service nova] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:26:33.868204 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4943a7-7b8b-428e-9229-b973aedbaf28 service nova] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:26:33.868483 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4943a7-7b8b-428e-9229-b973aedbaf28 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:26:33.879005 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4943a7-7b8b-428e-9229-b973aedbaf28 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:26:33.881188 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4943a7-7b8b-428e-9229-b973aedbaf28 service nova] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:26:33.891427 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1453/2888] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:26:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 05 12:26:33.892090 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-733e0cf0-15b0-4960-9759-d0720a9ff982 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a2d377b9e9a4f1d8ef4d4ed3611af4a'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:26:33.892772 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-733e0cf0-15b0-4960-9759-d0720a9ff982 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a2d377b9e9a4f1d8ef4d4ed3611af4a'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:26:33.902401 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-733e0cf0-15b0-4960-9759-d0720a9ff982 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a2d377b9e9a4f1d8ef4d4ed3611af4a'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:26:33.903034 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-733e0cf0-15b0-4960-9759-d0720a9ff982 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a2d377b9e9a4f1d8ef4d4ed3611af4a'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:26:33.917154 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-733e0cf0-15b0-4960-9759-d0720a9ff982 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a2d377b9e9a4f1d8ef4d4ed3611af4a'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:26:33.930259 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1436/2889] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 5 12:26:33 2022] DELETE /identity/v3/users/0a2d377b9e9a4f1d8ef4d4ed3611af4a => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:26:34.226242 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4943a7-7b8b-428e-9229-b973aedbaf28 service nova] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:26:34.237124 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4943a7-7b8b-428e-9229-b973aedbaf28 service nova] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:26:34.311672 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c175c8-8bbe-4777-86b4-6f889950f44d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:26:34.312326 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c175c8-8bbe-4777-86b4-6f889950f44d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:26:34.312608 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c175c8-8bbe-4777-86b4-6f889950f44d admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:26:34.312882 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c175c8-8bbe-4777-86b4-6f889950f44d admin admin] PATH_INFO: `/v3/projects/382ee7c990c04d269edc4d106a85e6e9` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:26:34.314070 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c175c8-8bbe-4777-86b4-6f889950f44d admin admin] RBAC: Authorizing `identity:delete_project(project_id=382ee7c990c04d269edc4d106a85e6e9)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:26:34.315996 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c175c8-8bbe-4777-86b4-6f889950f44d admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:26:34.369375 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:26:34.371017 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-d0c175c8-8bbe-4777-86b4-6f889950f44d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '382ee7c990c04d269edc4d106a85e6e9', 'request_id': 'req-d0c175c8-8bbe-4777-86b4-6f889950f44d'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:26:34.380075 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-d0c175c8-8bbe-4777-86b4-6f889950f44d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '382ee7c990c04d269edc4d106a85e6e9', 'request_id': 'req-d0c175c8-8bbe-4777-86b4-6f889950f44d'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:26:34.386085 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-d0c175c8-8bbe-4777-86b4-6f889950f44d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '382ee7c990c04d269edc4d106a85e6e9', 'request_id': 'req-d0c175c8-8bbe-4777-86b4-6f889950f44d'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:26:34.397911 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-d0c175c8-8bbe-4777-86b4-6f889950f44d admin admin] The token cache is being invalidate because project 382ee7c990c04d269edc4d106a85e6e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:26:34.398203 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-d0c175c8-8bbe-4777-86b4-6f889950f44d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:26:34.398869 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-d0c175c8-8bbe-4777-86b4-6f889950f44d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:26:34.400370 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1454/2890] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 5 12:26:34 2022] DELETE /identity/v3/projects/382ee7c990c04d269edc4d106a85e6e9 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:26:34.406190 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1acf506-fcfe-4dd1-b08b-765ae20fa813 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:26:34.406475 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1acf506-fcfe-4dd1-b08b-765ae20fa813 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:26:34.406748 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1acf506-fcfe-4dd1-b08b-765ae20fa813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:26:34.427756 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-c1acf506-fcfe-4dd1-b08b-765ae20fa813 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:26:34.429021 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-c1acf506-fcfe-4dd1-b08b-765ae20fa813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:26:34.451032 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:26:34.498221 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1437/2891] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:26:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:26:34.506559 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51988fa5-4069-4bd5-8b3b-bc12153c39c0 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:26:34.506850 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51988fa5-4069-4bd5-8b3b-bc12153c39c0 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:26:34.507126 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51988fa5-4069-4bd5-8b3b-bc12153c39c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:26:34.528647 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-51988fa5-4069-4bd5-8b3b-bc12153c39c0 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:26:34.529914 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-51988fa5-4069-4bd5-8b3b-bc12153c39c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:26:34.538859 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1455/2892] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:26:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 12:26:34.543300 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1acf506-fcfe-4dd1-b08b-765ae20fa813 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:26:34.553830 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1acf506-fcfe-4dd1-b08b-765ae20fa813 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:26:34.558429 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88470012-783a-44d0-8cc9-24c3a54adc0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:26:34.559034 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88470012-783a-44d0-8cc9-24c3a54adc0e admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:26:34.559312 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88470012-783a-44d0-8cc9-24c3a54adc0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:26:34.559579 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88470012-783a-44d0-8cc9-24c3a54adc0e admin admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:26:34.560956 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88470012-783a-44d0-8cc9-24c3a54adc0e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:26:34.561364 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88470012-783a-44d0-8cc9-24c3a54adc0e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:26:34.562979 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88470012-783a-44d0-8cc9-24c3a54adc0e admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:26:34.575286 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1438/2893] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Sep 5 12:26:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 05 12:26:34.579651 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51988fa5-4069-4bd5-8b3b-bc12153c39c0 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:26:34.590940 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51988fa5-4069-4bd5-8b3b-bc12153c39c0 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:26:34.595691 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea28863-4227-4a58-86f3-e1ee03cb6931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:26:34.596483 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea28863-4227-4a58-86f3-e1ee03cb6931 admin admin] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:26:34.596760 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea28863-4227-4a58-86f3-e1ee03cb6931 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:26:34.597082 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea28863-4227-4a58-86f3-e1ee03cb6931 admin admin] PATH_INFO: `/v3/projects` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:26:34.597737 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea28863-4227-4a58-86f3-e1ee03cb6931 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:26:34.600133 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea28863-4227-4a58-86f3-e1ee03cb6931 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:26:34.629788 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1456/2894] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 5 12:26:34 2022] POST /identity/v3/projects => generated 377 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:26:34.634473 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88470012-783a-44d0-8cc9-24c3a54adc0e admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:26:34.645580 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88470012-783a-44d0-8cc9-24c3a54adc0e admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:26:34.726933 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbe42a8-6720-4571-ab81-282138f54dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:26:34.727555 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbe42a8-6720-4571-ab81-282138f54dc4 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:26:34.727836 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbe42a8-6720-4571-ab81-282138f54dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:26:34.728106 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbe42a8-6720-4571-ab81-282138f54dc4 admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:26:34.728742 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbe42a8-6720-4571-ab81-282138f54dc4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:26:34.730700 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbe42a8-6720-4571-ab81-282138f54dc4 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:26:34.753876 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1439/2895] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 5 12:26:34 2022] POST /identity/v3/users => generated 289 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:26:34.762061 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea28863-4227-4a58-86f3-e1ee03cb6931 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:26:34.773844 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea28863-4227-4a58-86f3-e1ee03cb6931 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:26:34.778740 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88092543-f1e0-49c8-8780-e3aa01fea986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:26:34.779355 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88092543-f1e0-49c8-8780-e3aa01fea986 admin admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:26:34.779673 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88092543-f1e0-49c8-8780-e3aa01fea986 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:26:34.779949 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88092543-f1e0-49c8-8780-e3aa01fea986 admin admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:26:34.780605 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88092543-f1e0-49c8-8780-e3aa01fea986 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:26:34.782327 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88092543-f1e0-49c8-8780-e3aa01fea986 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:26:34.794415 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1457/2896] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:26:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:26:34.798483 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbe42a8-6720-4571-ab81-282138f54dc4 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:26:34.809985 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbe42a8-6720-4571-ab81-282138f54dc4 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:26:34.815137 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbe56b2-d6d0-4bec-bc91-210e87989537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:26:34.815735 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbe56b2-d6d0-4bec-bc91-210e87989537 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:26:34.816015 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbe56b2-d6d0-4bec-bc91-210e87989537 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:26:34.816286 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbe56b2-d6d0-4bec-bc91-210e87989537 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:26:34.816955 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbe56b2-d6d0-4bec-bc91-210e87989537 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:26:34.818577 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbe56b2-d6d0-4bec-bc91-210e87989537 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:26:34.829770 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1440/2897] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:26:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:26:34.834103 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88092543-f1e0-49c8-8780-e3aa01fea986 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:26:34.844671 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88092543-f1e0-49c8-8780-e3aa01fea986 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:26:34.849915 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c19b68-1045-4039-bebc-869c7d60f0a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:26:34.850564 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c19b68-1045-4039-bebc-869c7d60f0a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:26:34.850840 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c19b68-1045-4039-bebc-869c7d60f0a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:26:34.851112 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c19b68-1045-4039-bebc-869c7d60f0a9 admin admin] PATH_INFO: `/v3/projects/2e047326fbc04e359aae1473aa6eacd5/users/278a31af0e1e47698a417c0def2f8ed8/roles/ed72181e1403401facb77dcf33644757` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:26:34.866226 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c19b68-1045-4039-bebc-869c7d60f0a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e047326fbc04e359aae1473aa6eacd5, user_id=278a31af0e1e47698a417c0def2f8ed8, role_id=ed72181e1403401facb77dcf33644757)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:26:34.868856 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c19b68-1045-4039-bebc-869c7d60f0a9 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:26:34.882510 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1458/2898] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 5 12:26:34 2022] PUT /identity/v3/projects/2e047326fbc04e359aae1473aa6eacd5/users/278a31af0e1e47698a417c0def2f8ed8/roles/ed72181e1403401facb77dcf33644757 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:26:34.893069 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a6443c-8c34-4916-828c-52cbe85cc951 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:26:34.893352 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a6443c-8c34-4916-828c-52cbe85cc951 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:26:34.893624 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a6443c-8c34-4916-828c-52cbe85cc951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:26:34.922712 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-34a6443c-8c34-4916-828c-52cbe85cc951 None None] MFA Rules not processed for user `278a31af0e1e47698a417c0def2f8ed8`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:26:34.923927 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-34a6443c-8c34-4916-828c-52cbe85cc951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:26:35.001757 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1441/2899] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:26:34 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:26:35.013409 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c19b68-1045-4039-bebc-869c7d60f0a9 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:26:35.015393 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-82c19b68-1045-4039-bebc-869c7d60f0a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:26:35.076117 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c19b68-1045-4039-bebc-869c7d60f0a9 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:26:35.081291 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511ae10a-9b9d-4fa5-8a68-c290a0787779 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37633bbae0c2423c81ccd61ac3a17ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:26:35.081916 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511ae10a-9b9d-4fa5-8a68-c290a0787779 service cinder] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:26:35.082708 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511ae10a-9b9d-4fa5-8a68-c290a0787779 service cinder] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:26:35.084419 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511ae10a-9b9d-4fa5-8a68-c290a0787779 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:26:35.094582 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511ae10a-9b9d-4fa5-8a68-c290a0787779 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:26:35.096052 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511ae10a-9b9d-4fa5-8a68-c290a0787779 service cinder] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:26:35.108702 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1459/2900] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:26:35 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:26:44.996856 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=87,keystone:INSERT=3 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:26:45.102277 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=60,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:26:46.714541 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a6443c-8c34-4916-828c-52cbe85cc951 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:26:46.776443 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a6443c-8c34-4916-828c-52cbe85cc951 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:26:46.780917 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913d9052-fbba-4a5a-a3c5-ba75c43184c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:26:46.781564 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913d9052-fbba-4a5a-a3c5-ba75c43184c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:26:46.781842 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913d9052-fbba-4a5a-a3c5-ba75c43184c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:26:46.782113 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913d9052-fbba-4a5a-a3c5-ba75c43184c2 admin admin] PATH_INFO: `/v3/users/278a31af0e1e47698a417c0def2f8ed8` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:26:46.783249 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913d9052-fbba-4a5a-a3c5-ba75c43184c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=278a31af0e1e47698a417c0def2f8ed8)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:26:46.785319 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913d9052-fbba-4a5a-a3c5-ba75c43184c2 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:26:46.830373 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-913d9052-fbba-4a5a-a3c5-ba75c43184c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '278a31af0e1e47698a417c0def2f8ed8'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:26:46.831018 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-913d9052-fbba-4a5a-a3c5-ba75c43184c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '278a31af0e1e47698a417c0def2f8ed8'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:26:46.839315 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-913d9052-fbba-4a5a-a3c5-ba75c43184c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '278a31af0e1e47698a417c0def2f8ed8'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:26:46.839957 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-913d9052-fbba-4a5a-a3c5-ba75c43184c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '278a31af0e1e47698a417c0def2f8ed8'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:26:46.853110 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-913d9052-fbba-4a5a-a3c5-ba75c43184c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '278a31af0e1e47698a417c0def2f8ed8'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:26:46.869469 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1442/2901] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 5 12:26:46 2022] DELETE /identity/v3/users/278a31af0e1e47698a417c0def2f8ed8 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:26:46.875868 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f73065d-cae2-4beb-b211-94632f4c41ac None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:26:46.876434 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f73065d-cae2-4beb-b211-94632f4c41ac None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:26:46.876631 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f73065d-cae2-4beb-b211-94632f4c41ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:26:46.898120 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-1f73065d-cae2-4beb-b211-94632f4c41ac None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:26:46.899349 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-1f73065d-cae2-4beb-b211-94632f4c41ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:26:46.959170 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1460/2902] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:26:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:26:46.968904 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913d9052-fbba-4a5a-a3c5-ba75c43184c2 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:26:46.970316 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-913d9052-fbba-4a5a-a3c5-ba75c43184c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:26:47.036814 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913d9052-fbba-4a5a-a3c5-ba75c43184c2 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:26:47.040458 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce6e5ff-fe59-4048-85b2-9b24ed97b55d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4994b4faa4ec4aa088f3dc32c9c5614d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:26:47.041101 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce6e5ff-fe59-4048-85b2-9b24ed97b55d service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:26:47.041380 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce6e5ff-fe59-4048-85b2-9b24ed97b55d service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:26:47.041656 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce6e5ff-fe59-4048-85b2-9b24ed97b55d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:26:47.053187 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce6e5ff-fe59-4048-85b2-9b24ed97b55d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:26:47.054801 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce6e5ff-fe59-4048-85b2-9b24ed97b55d service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:26:47.066007 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1443/2903] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:26:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:26:47.362505 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f73065d-cae2-4beb-b211-94632f4c41ac None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:26:47.365210 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-1f73065d-cae2-4beb-b211-94632f4c41ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:26:47.381889 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f73065d-cae2-4beb-b211-94632f4c41ac None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:26:47.386663 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6840cf-48f1-42d6-bf8b-751c08c88812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:26:47.387423 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6840cf-48f1-42d6-bf8b-751c08c88812 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:26:47.387722 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6840cf-48f1-42d6-bf8b-751c08c88812 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:26:47.387985 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6840cf-48f1-42d6-bf8b-751c08c88812 admin admin] PATH_INFO: `/v3/projects/2e047326fbc04e359aae1473aa6eacd5` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:26:47.389314 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6840cf-48f1-42d6-bf8b-751c08c88812 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e047326fbc04e359aae1473aa6eacd5)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:26:47.391486 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6840cf-48f1-42d6-bf8b-751c08c88812 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:26:47.438372 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-7f6840cf-48f1-42d6-bf8b-751c08c88812 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e047326fbc04e359aae1473aa6eacd5', 'request_id': 'req-7f6840cf-48f1-42d6-bf8b-751c08c88812'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:26:47.446440 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-7f6840cf-48f1-42d6-bf8b-751c08c88812 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e047326fbc04e359aae1473aa6eacd5', 'request_id': 'req-7f6840cf-48f1-42d6-bf8b-751c08c88812'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:26:47.455291 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-7f6840cf-48f1-42d6-bf8b-751c08c88812 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e047326fbc04e359aae1473aa6eacd5', 'request_id': 'req-7f6840cf-48f1-42d6-bf8b-751c08c88812'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:26:47.469950 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-7f6840cf-48f1-42d6-bf8b-751c08c88812 admin admin] The token cache is being invalidate because project 2e047326fbc04e359aae1473aa6eacd5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:26:47.470242 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-7f6840cf-48f1-42d6-bf8b-751c08c88812 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:26:47.470911 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-7f6840cf-48f1-42d6-bf8b-751c08c88812 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:26:47.473657 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1461/2904] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 5 12:26:47 2022] DELETE /identity/v3/projects/2e047326fbc04e359aae1473aa6eacd5 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:26:47.477916 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb8dd6d-30e0-4532-84bc-e3e5b0f640cc None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:26:47.478203 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb8dd6d-30e0-4532-84bc-e3e5b0f640cc None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:26:47.478476 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb8dd6d-30e0-4532-84bc-e3e5b0f640cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:26:47.499034 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-ebb8dd6d-30e0-4532-84bc-e3e5b0f640cc None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:26:47.500229 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-ebb8dd6d-30e0-4532-84bc-e3e5b0f640cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:26:47.518007 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:26:47.563553 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1444/2905] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:26:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:26:47.572741 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4d0395-c9de-4b3c-94f6-6d8fe1af54b9 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:26:47.573058 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4d0395-c9de-4b3c-94f6-6d8fe1af54b9 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:26:47.573335 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4d0395-c9de-4b3c-94f6-6d8fe1af54b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:26:47.592825 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-dc4d0395-c9de-4b3c-94f6-6d8fe1af54b9 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:26:47.594046 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-dc4d0395-c9de-4b3c-94f6-6d8fe1af54b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:26:47.602726 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1462/2906] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:26:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:26:47.607099 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb8dd6d-30e0-4532-84bc-e3e5b0f640cc None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:26:47.617468 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb8dd6d-30e0-4532-84bc-e3e5b0f640cc None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:26:47.621968 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facde41b-5422-4f4d-9e7f-092873ad0a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:26:47.622568 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facde41b-5422-4f4d-9e7f-092873ad0a57 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:26:47.622855 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facde41b-5422-4f4d-9e7f-092873ad0a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:26:47.623127 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facde41b-5422-4f4d-9e7f-092873ad0a57 admin admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:26:47.623771 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facde41b-5422-4f4d-9e7f-092873ad0a57 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:26:47.624072 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facde41b-5422-4f4d-9e7f-092873ad0a57 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:26:47.625716 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facde41b-5422-4f4d-9e7f-092873ad0a57 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:26:47.637531 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1445/2907] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Sep 5 12:26:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:26:47.641984 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4d0395-c9de-4b3c-94f6-6d8fe1af54b9 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:26:47.651597 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4d0395-c9de-4b3c-94f6-6d8fe1af54b9 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:26:47.656214 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b7b4a8-292c-4dac-8f42-1fe87bc0ffec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:26:47.656807 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b7b4a8-292c-4dac-8f42-1fe87bc0ffec admin admin] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:26:47.657115 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b7b4a8-292c-4dac-8f42-1fe87bc0ffec admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:26:47.657385 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b7b4a8-292c-4dac-8f42-1fe87bc0ffec admin admin] PATH_INFO: `/v3/projects` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:26:47.658026 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b7b4a8-292c-4dac-8f42-1fe87bc0ffec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:26:47.659902 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b7b4a8-292c-4dac-8f42-1fe87bc0ffec admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:26:47.686617 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1463/2908] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 5 12:26:47 2022] POST /identity/v3/projects => generated 365 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:26:47.690792 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facde41b-5422-4f4d-9e7f-092873ad0a57 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:26:47.700707 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facde41b-5422-4f4d-9e7f-092873ad0a57 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:26:47.755592 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b642cc98-f765-41f1-97e2-11284842e1c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:26:47.756273 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b642cc98-f765-41f1-97e2-11284842e1c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:26:47.756463 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b642cc98-f765-41f1-97e2-11284842e1c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:26:47.756737 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b642cc98-f765-41f1-97e2-11284842e1c9 admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:26:47.757400 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b642cc98-f765-41f1-97e2-11284842e1c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:26:47.759315 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b642cc98-f765-41f1-97e2-11284842e1c9 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:26:47.781668 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1446/2909] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 5 12:26:47 2022] POST /identity/v3/users => generated 283 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 05 12:26:47.786426 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b7b4a8-292c-4dac-8f42-1fe87bc0ffec admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:26:47.796759 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b7b4a8-292c-4dac-8f42-1fe87bc0ffec admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:26:47.801342 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8548ebd5-1e66-4893-8133-e28255bbde53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:26:47.801931 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8548ebd5-1e66-4893-8133-e28255bbde53 admin admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:26:47.802211 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8548ebd5-1e66-4893-8133-e28255bbde53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:26:47.802484 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8548ebd5-1e66-4893-8133-e28255bbde53 admin admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:26:47.803120 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8548ebd5-1e66-4893-8133-e28255bbde53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:26:47.804689 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8548ebd5-1e66-4893-8133-e28255bbde53 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:26:47.814444 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1464/2910] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:26:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:26:47.818553 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b642cc98-f765-41f1-97e2-11284842e1c9 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:26:47.828538 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b642cc98-f765-41f1-97e2-11284842e1c9 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:26:47.833677 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df9af08-a677-420c-8b1c-f71aa786aaa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:26:47.834265 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df9af08-a677-420c-8b1c-f71aa786aaa2 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:26:47.834546 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df9af08-a677-420c-8b1c-f71aa786aaa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:26:47.834819 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df9af08-a677-420c-8b1c-f71aa786aaa2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:26:47.835455 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df9af08-a677-420c-8b1c-f71aa786aaa2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:26:47.837099 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df9af08-a677-420c-8b1c-f71aa786aaa2 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:26:47.848236 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1447/2911] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:26:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:26:47.852500 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8548ebd5-1e66-4893-8133-e28255bbde53 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:26:47.862683 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8548ebd5-1e66-4893-8133-e28255bbde53 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:26:47.867297 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdb8f32-2ee2-46fa-9d42-128f2ee26531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:26:47.867940 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdb8f32-2ee2-46fa-9d42-128f2ee26531 admin admin] REQUEST_METHOD: `PUT` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:26:47.868216 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdb8f32-2ee2-46fa-9d42-128f2ee26531 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:26:47.868542 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdb8f32-2ee2-46fa-9d42-128f2ee26531 admin admin] PATH_INFO: `/v3/projects/2782aa7c903b4ea69ce3591d4ace992b/users/631e93f75de14b9e9ac8031e0bb2fd64/roles/ed72181e1403401facb77dcf33644757` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:26:47.883077 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdb8f32-2ee2-46fa-9d42-128f2ee26531 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2782aa7c903b4ea69ce3591d4ace992b, user_id=631e93f75de14b9e9ac8031e0bb2fd64, role_id=ed72181e1403401facb77dcf33644757)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:26:47.885758 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdb8f32-2ee2-46fa-9d42-128f2ee26531 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:26:47.899109 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1465/2912] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 5 12:26:47 2022] PUT /identity/v3/projects/2782aa7c903b4ea69ce3591d4ace992b/users/631e93f75de14b9e9ac8031e0bb2fd64/roles/ed72181e1403401facb77dcf33644757 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 12:26:47.909421 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cadf96-07da-41c6-ad80-ecd12b30fcb1 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:26:47.909707 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cadf96-07da-41c6-ad80-ecd12b30fcb1 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:26:47.909984 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cadf96-07da-41c6-ad80-ecd12b30fcb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:26:47.938094 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-07cadf96-07da-41c6-ad80-ecd12b30fcb1 None None] MFA Rules not processed for user `631e93f75de14b9e9ac8031e0bb2fd64`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:26:47.939307 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-07cadf96-07da-41c6-ad80-ecd12b30fcb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:26:48.006311 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1448/2913] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:26:47 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:26:48.018364 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdb8f32-2ee2-46fa-9d42-128f2ee26531 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:26:48.020738 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-8cdb8f32-2ee2-46fa-9d42-128f2ee26531 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:26:48.042390 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:26:48.079706 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdb8f32-2ee2-46fa-9d42-128f2ee26531 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:26:48.084147 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30da648a-6f7f-4310-93b2-f9ee2f225e94 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37633bbae0c2423c81ccd61ac3a17ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:26:48.084750 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30da648a-6f7f-4310-93b2-f9ee2f225e94 service cinder] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:26:48.085070 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30da648a-6f7f-4310-93b2-f9ee2f225e94 service cinder] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:26:48.085340 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30da648a-6f7f-4310-93b2-f9ee2f225e94 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:26:48.094010 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30da648a-6f7f-4310-93b2-f9ee2f225e94 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:26:48.095475 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30da648a-6f7f-4310-93b2-f9ee2f225e94 service cinder] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:26:48.104332 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1466/2914] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:26:48 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:26:58.002976 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:26:58.100268 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=17 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:27:02.099908 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cadf96-07da-41c6-ad80-ecd12b30fcb1 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:27:02.101841 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-07cadf96-07da-41c6-ad80-ecd12b30fcb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:27:02.172216 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cadf96-07da-41c6-ad80-ecd12b30fcb1 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:27:02.176826 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a0f871-eb33-4426-a67c-6cc498a5b820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:27:02.177475 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a0f871-eb33-4426-a67c-6cc498a5b820 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:27:02.177760 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a0f871-eb33-4426-a67c-6cc498a5b820 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:27:02.178034 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a0f871-eb33-4426-a67c-6cc498a5b820 admin admin] PATH_INFO: `/v3/users/00e6ebaaf24040a889df07682cce490b` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:27:02.179177 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a0f871-eb33-4426-a67c-6cc498a5b820 admin admin] RBAC: Authorizing `identity:delete_user(user_id=00e6ebaaf24040a889df07682cce490b)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:27:02.181767 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a0f871-eb33-4426-a67c-6cc498a5b820 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:27:02.234252 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-94a0f871-eb33-4426-a67c-6cc498a5b820 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00e6ebaaf24040a889df07682cce490b'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:27:02.234812 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-94a0f871-eb33-4426-a67c-6cc498a5b820 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00e6ebaaf24040a889df07682cce490b'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:27:02.242899 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-94a0f871-eb33-4426-a67c-6cc498a5b820 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00e6ebaaf24040a889df07682cce490b'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:27:02.243703 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-94a0f871-eb33-4426-a67c-6cc498a5b820 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00e6ebaaf24040a889df07682cce490b'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:27:02.255407 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-94a0f871-eb33-4426-a67c-6cc498a5b820 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00e6ebaaf24040a889df07682cce490b'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:27:02.268507 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1449/2915] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 5 12:27:02 2022] DELETE /identity/v3/users/00e6ebaaf24040a889df07682cce490b => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:27:02.451440 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30da648a-6f7f-4310-93b2-f9ee2f225e94 service cinder] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:27:02.462924 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30da648a-6f7f-4310-93b2-f9ee2f225e94 service cinder] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:27:02.529319 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2424156-4dc8-4ea5-b978-c53d0df5bbc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:27:02.529955 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2424156-4dc8-4ea5-b978-c53d0df5bbc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:27:02.530266 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2424156-4dc8-4ea5-b978-c53d0df5bbc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:27:02.530542 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2424156-4dc8-4ea5-b978-c53d0df5bbc9 admin admin] PATH_INFO: `/v3/projects/e036045fbb844b178d2360fe785161ed` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:27:02.531802 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2424156-4dc8-4ea5-b978-c53d0df5bbc9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e036045fbb844b178d2360fe785161ed)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:27:02.533750 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2424156-4dc8-4ea5-b978-c53d0df5bbc9 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:27:02.583389 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-e2424156-4dc8-4ea5-b978-c53d0df5bbc9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e036045fbb844b178d2360fe785161ed', 'request_id': 'req-e2424156-4dc8-4ea5-b978-c53d0df5bbc9'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:27:02.591059 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-e2424156-4dc8-4ea5-b978-c53d0df5bbc9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e036045fbb844b178d2360fe785161ed', 'request_id': 'req-e2424156-4dc8-4ea5-b978-c53d0df5bbc9'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:27:02.596938 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-e2424156-4dc8-4ea5-b978-c53d0df5bbc9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e036045fbb844b178d2360fe785161ed', 'request_id': 'req-e2424156-4dc8-4ea5-b978-c53d0df5bbc9'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:27:02.608601 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-e2424156-4dc8-4ea5-b978-c53d0df5bbc9 admin admin] The token cache is being invalidate because project e036045fbb844b178d2360fe785161ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:27:02.608904 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-e2424156-4dc8-4ea5-b978-c53d0df5bbc9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:27:02.609567 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-e2424156-4dc8-4ea5-b978-c53d0df5bbc9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:27:02.611085 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1467/2916] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 5 12:27:02 2022] DELETE /identity/v3/projects/e036045fbb844b178d2360fe785161ed => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:27:12.264246 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=53,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:27:12.605519 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=51,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:27:18.114971 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a0f871-eb33-4426-a67c-6cc498a5b820 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:27:18.116417 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-94a0f871-eb33-4426-a67c-6cc498a5b820 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:27:18.129198 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a0f871-eb33-4426-a67c-6cc498a5b820 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:27:18.186471 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d787db24-dc7c-4756-9679-2d8c3186efb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:27:18.187109 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d787db24-dc7c-4756-9679-2d8c3186efb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:27:18.187390 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d787db24-dc7c-4756-9679-2d8c3186efb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:27:18.187661 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d787db24-dc7c-4756-9679-2d8c3186efb6 admin admin] PATH_INFO: `/v3/users/631e93f75de14b9e9ac8031e0bb2fd64` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:27:18.188826 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d787db24-dc7c-4756-9679-2d8c3186efb6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=631e93f75de14b9e9ac8031e0bb2fd64)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:27:18.190782 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d787db24-dc7c-4756-9679-2d8c3186efb6 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:27:18.237481 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-d787db24-dc7c-4756-9679-2d8c3186efb6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '631e93f75de14b9e9ac8031e0bb2fd64'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:27:18.238135 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-d787db24-dc7c-4756-9679-2d8c3186efb6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '631e93f75de14b9e9ac8031e0bb2fd64'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:27:18.246509 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-d787db24-dc7c-4756-9679-2d8c3186efb6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '631e93f75de14b9e9ac8031e0bb2fd64'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:27:18.247157 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-d787db24-dc7c-4756-9679-2d8c3186efb6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '631e93f75de14b9e9ac8031e0bb2fd64'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:27:18.259921 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-d787db24-dc7c-4756-9679-2d8c3186efb6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '631e93f75de14b9e9ac8031e0bb2fd64'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:27:18.273136 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1450/2917] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 5 12:27:18 2022] DELETE /identity/v3/users/631e93f75de14b9e9ac8031e0bb2fd64 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:27:18.277666 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e229344c-86c8-4e9d-a22e-f4cb1286cc93 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:27:18.278149 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e229344c-86c8-4e9d-a22e-f4cb1286cc93 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:27:18.278263 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e229344c-86c8-4e9d-a22e-f4cb1286cc93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:27:18.298233 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-e229344c-86c8-4e9d-a22e-f4cb1286cc93 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:27:18.299366 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-e229344c-86c8-4e9d-a22e-f4cb1286cc93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:27:18.356909 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1468/2918] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:27:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:27:18.366710 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d787db24-dc7c-4756-9679-2d8c3186efb6 admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:27:18.368601 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-d787db24-dc7c-4756-9679-2d8c3186efb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:27:18.427008 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d787db24-dc7c-4756-9679-2d8c3186efb6 admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:27:18.431136 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715914a4-2d51-45ef-baba-d325d0e73a99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4994b4faa4ec4aa088f3dc32c9c5614d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:27:18.431742 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715914a4-2d51-45ef-baba-d325d0e73a99 service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:27:18.432023 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715914a4-2d51-45ef-baba-d325d0e73a99 service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:27:18.432299 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715914a4-2d51-45ef-baba-d325d0e73a99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:27:18.441440 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715914a4-2d51-45ef-baba-d325d0e73a99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:27:18.442953 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715914a4-2d51-45ef-baba-d325d0e73a99 service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:27:18.453947 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1451/2919] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:27:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:27:18.718126 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e229344c-86c8-4e9d-a22e-f4cb1286cc93 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:27:18.719573 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-e229344c-86c8-4e9d-a22e-f4cb1286cc93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:27:18.732259 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e229344c-86c8-4e9d-a22e-f4cb1286cc93 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:27:18.737206 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dd5d61-5e9a-41fe-b2f6-af4cb29edc0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:27:18.737921 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dd5d61-5e9a-41fe-b2f6-af4cb29edc0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:27:18.738208 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dd5d61-5e9a-41fe-b2f6-af4cb29edc0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:27:18.738482 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dd5d61-5e9a-41fe-b2f6-af4cb29edc0f admin admin] PATH_INFO: `/v3/projects/2782aa7c903b4ea69ce3591d4ace992b` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:27:18.739645 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dd5d61-5e9a-41fe-b2f6-af4cb29edc0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2782aa7c903b4ea69ce3591d4ace992b)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:27:18.741615 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dd5d61-5e9a-41fe-b2f6-af4cb29edc0f admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:27:18.792664 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-a0dd5d61-5e9a-41fe-b2f6-af4cb29edc0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2782aa7c903b4ea69ce3591d4ace992b', 'request_id': 'req-a0dd5d61-5e9a-41fe-b2f6-af4cb29edc0f'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:27:18.799188 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-a0dd5d61-5e9a-41fe-b2f6-af4cb29edc0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2782aa7c903b4ea69ce3591d4ace992b', 'request_id': 'req-a0dd5d61-5e9a-41fe-b2f6-af4cb29edc0f'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:27:18.805228 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-a0dd5d61-5e9a-41fe-b2f6-af4cb29edc0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2782aa7c903b4ea69ce3591d4ace992b', 'request_id': 'req-a0dd5d61-5e9a-41fe-b2f6-af4cb29edc0f'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:27:18.816161 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-a0dd5d61-5e9a-41fe-b2f6-af4cb29edc0f admin admin] The token cache is being invalidate because project 2782aa7c903b4ea69ce3591d4ace992b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81719) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:27:18.816478 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-a0dd5d61-5e9a-41fe-b2f6-af4cb29edc0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:27:18.817121 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-a0dd5d61-5e9a-41fe-b2f6-af4cb29edc0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:27:18.818605 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1469/2920] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 5 12:27:18 2022] DELETE /identity/v3/projects/2782aa7c903b4ea69ce3591d4ace992b => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:27:18.823523 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55840c32-fbdd-476b-a861-8b11616cf88b None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:27:18.823828 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55840c32-fbdd-476b-a861-8b11616cf88b None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:27:18.824131 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55840c32-fbdd-476b-a861-8b11616cf88b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:27:18.843680 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-55840c32-fbdd-476b-a861-8b11616cf88b None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:27:18.844871 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-55840c32-fbdd-476b-a861-8b11616cf88b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:27:18.861997 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:27:18.906274 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1452/2921] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:27:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 05 12:27:18.915761 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e53f41-9027-4b4a-854e-8494f7bc5cad None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:27:18.916047 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e53f41-9027-4b4a-854e-8494f7bc5cad None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:27:18.916324 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e53f41-9027-4b4a-854e-8494f7bc5cad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:27:18.936311 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-f9e53f41-9027-4b4a-854e-8494f7bc5cad None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:27:18.937556 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-f9e53f41-9027-4b4a-854e-8494f7bc5cad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:27:18.945610 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1470/2922] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:27:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:27:18.949765 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55840c32-fbdd-476b-a861-8b11616cf88b None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:27:18.959537 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55840c32-fbdd-476b-a861-8b11616cf88b None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:27:18.964394 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4194eeb-a8ba-4e55-8d74-5c297f0573fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:27:18.965034 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4194eeb-a8ba-4e55-8d74-5c297f0573fd admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:27:18.965311 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4194eeb-a8ba-4e55-8d74-5c297f0573fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:27:18.965579 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4194eeb-a8ba-4e55-8d74-5c297f0573fd admin admin] PATH_INFO: `/v3/domains` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:27:18.966222 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4194eeb-a8ba-4e55-8d74-5c297f0573fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81720) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 05 12:27:18.966518 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4194eeb-a8ba-4e55-8d74-5c297f0573fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:27:18.968174 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4194eeb-a8ba-4e55-8d74-5c297f0573fd admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:27:18.980319 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1453/2923] 10.222.0.50 () {58 vars in 1153 bytes} [Mon Sep 5 12:27:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 05 12:27:18.984521 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e53f41-9027-4b4a-854e-8494f7bc5cad None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:27:18.994298 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e53f41-9027-4b4a-854e-8494f7bc5cad None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:27:18.998856 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2fcf80-165b-460c-a002-b01671b35440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:27:18.999444 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2fcf80-165b-460c-a002-b01671b35440 admin admin] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:27:18.999724 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2fcf80-165b-460c-a002-b01671b35440 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:27:18.999995 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2fcf80-165b-460c-a002-b01671b35440 admin admin] PATH_INFO: `/v3/projects` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:27:19.000617 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2fcf80-165b-460c-a002-b01671b35440 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:27:19.002548 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2fcf80-165b-460c-a002-b01671b35440 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:27:19.040729 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1471/2924] 10.222.0.50 () {60 vars in 1153 bytes} [Mon Sep 5 12:27:18 2022] POST /identity/v3/projects => generated 373 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:27:19.044950 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4194eeb-a8ba-4e55-8d74-5c297f0573fd admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:27:19.055048 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4194eeb-a8ba-4e55-8d74-5c297f0573fd admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:27:19.113212 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493319e7-855b-443f-9f34-b7939b2fccae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:27:19.113736 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493319e7-855b-443f-9f34-b7939b2fccae admin admin] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:27:19.114018 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493319e7-855b-443f-9f34-b7939b2fccae admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:27:19.114294 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493319e7-855b-443f-9f34-b7939b2fccae admin admin] PATH_INFO: `/v3/users` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:27:19.114955 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493319e7-855b-443f-9f34-b7939b2fccae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:27:19.116999 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493319e7-855b-443f-9f34-b7939b2fccae admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:27:19.138883 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1454/2925] 10.222.0.50 () {60 vars in 1144 bytes} [Mon Sep 5 12:27:19 2022] POST /identity/v3/users => generated 287 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 05 12:27:19.143080 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2fcf80-165b-460c-a002-b01671b35440 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:27:19.154297 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2fcf80-165b-460c-a002-b01671b35440 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:27:19.159250 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c548ba1-fec8-4456-aca7-04d5978159a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:27:19.159875 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c548ba1-fec8-4456-aca7-04d5978159a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:27:19.160159 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c548ba1-fec8-4456-aca7-04d5978159a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:27:19.160435 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c548ba1-fec8-4456-aca7-04d5978159a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:27:19.161129 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c548ba1-fec8-4456-aca7-04d5978159a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:27:19.162729 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c548ba1-fec8-4456-aca7-04d5978159a7 admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:27:19.174811 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1472/2926] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:27:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:27:19.179077 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493319e7-855b-443f-9f34-b7939b2fccae admin admin] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:27:19.189309 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493319e7-855b-443f-9f34-b7939b2fccae admin admin] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:27:19.193973 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1d0d21-c04b-4c2e-8b06-0290ad1cad77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:27:19.194566 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1d0d21-c04b-4c2e-8b06-0290ad1cad77 admin admin] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:27:19.194848 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1d0d21-c04b-4c2e-8b06-0290ad1cad77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:27:19.195138 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1d0d21-c04b-4c2e-8b06-0290ad1cad77 admin admin] PATH_INFO: `/v3/roles` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:27:19.195802 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1d0d21-c04b-4c2e-8b06-0290ad1cad77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:27:19.197438 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1d0d21-c04b-4c2e-8b06-0290ad1cad77 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:27:19.208649 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1455/2927] 10.222.0.50 () {58 vars in 1122 bytes} [Mon Sep 5 12:27:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 05 12:27:19.213624 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c548ba1-fec8-4456-aca7-04d5978159a7 admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:27:19.223780 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c548ba1-fec8-4456-aca7-04d5978159a7 admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:27:19.229271 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b8d848-b68e-42c7-8c6c-732ab047b8ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:27:19.229936 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b8d848-b68e-42c7-8c6c-732ab047b8ac admin admin] REQUEST_METHOD: `PUT` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:27:19.230241 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b8d848-b68e-42c7-8c6c-732ab047b8ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:27:19.230515 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b8d848-b68e-42c7-8c6c-732ab047b8ac admin admin] PATH_INFO: `/v3/projects/d69c34579020469385378d4b9459e0ff/users/9f79a23f2aab47b1b0c7f2b98cd576e3/roles/ed72181e1403401facb77dcf33644757` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:27:19.248472 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b8d848-b68e-42c7-8c6c-732ab047b8ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=d69c34579020469385378d4b9459e0ff, user_id=9f79a23f2aab47b1b0c7f2b98cd576e3, role_id=ed72181e1403401facb77dcf33644757)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:27:19.251180 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b8d848-b68e-42c7-8c6c-732ab047b8ac admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:27:19.266606 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1473/2928] 10.222.0.50 () {60 vars in 1483 bytes} [Mon Sep 5 12:27:19 2022] PUT /identity/v3/projects/d69c34579020469385378d4b9459e0ff/users/9f79a23f2aab47b1b0c7f2b98cd576e3/roles/ed72181e1403401facb77dcf33644757 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 05 12:27:19.278867 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42270cf9-88e8-412c-8ee1-c426910be4dc None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:27:19.279154 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42270cf9-88e8-412c-8ee1-c426910be4dc None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:27:19.279458 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42270cf9-88e8-412c-8ee1-c426910be4dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:27:19.308360 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-42270cf9-88e8-412c-8ee1-c426910be4dc None None] MFA Rules not processed for user `9f79a23f2aab47b1b0c7f2b98cd576e3`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:27:19.309619 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-42270cf9-88e8-412c-8ee1-c426910be4dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:27:19.377273 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1456/2929] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:27:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:27:19.388375 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b8d848-b68e-42c7-8c6c-732ab047b8ac admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:27:19.390355 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-10b8d848-b68e-42c7-8c6c-732ab047b8ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:27:19.407407 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:27:19.455344 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b8d848-b68e-42c7-8c6c-732ab047b8ac admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:27:19.459029 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba46174-10a6-411c-98cf-d3735eeffd02 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37633bbae0c2423c81ccd61ac3a17ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:27:19.459637 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba46174-10a6-411c-98cf-d3735eeffd02 service cinder] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:27:19.459914 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba46174-10a6-411c-98cf-d3735eeffd02 service cinder] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:27:19.460198 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba46174-10a6-411c-98cf-d3735eeffd02 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:27:19.469547 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba46174-10a6-411c-98cf-d3735eeffd02 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:27:19.471089 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba46174-10a6-411c-98cf-d3735eeffd02 service cinder] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:27:19.480274 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1474/2930] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:27:19 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:27:20.843766 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8a4f9a-1991-4a3c-bfbf-b20bfa255468 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:27:20.844305 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8a4f9a-1991-4a3c-bfbf-b20bfa255468 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:27:20.844305 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8a4f9a-1991-4a3c-bfbf-b20bfa255468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:27:20.864957 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-4b8a4f9a-1991-4a3c-bfbf-b20bfa255468 None None] MFA Rules not processed for user `9f79a23f2aab47b1b0c7f2b98cd576e3`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:27:20.866159 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-4b8a4f9a-1991-4a3c-bfbf-b20bfa255468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:27:20.872937 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1457/2931] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:27:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:27:20.915336 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba46174-10a6-411c-98cf-d3735eeffd02 service cinder] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:27:20.917001 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-1ba46174-10a6-411c-98cf-d3735eeffd02 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:27:20.973928 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba46174-10a6-411c-98cf-d3735eeffd02 service cinder] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:27:20.977475 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d75c72a-9ea6-4200-84fd-eafcc946d848 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b08e831af84a658b0f5b28ad03e4f7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:27:20.978071 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d75c72a-9ea6-4200-84fd-eafcc946d848 service glance] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:27:20.978378 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d75c72a-9ea6-4200-84fd-eafcc946d848 service glance] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:27:20.978654 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d75c72a-9ea6-4200-84fd-eafcc946d848 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:27:20.980367 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-3d75c72a-9ea6-4200-84fd-eafcc946d848 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:27:21.050978 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d75c72a-9ea6-4200-84fd-eafcc946d848 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:27:21.052337 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d75c72a-9ea6-4200-84fd-eafcc946d848 service glance] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:27:21.063419 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1475/2932] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:27:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:27:21.505841 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8a4f9a-1991-4a3c-bfbf-b20bfa255468 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:27:21.507281 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-4b8a4f9a-1991-4a3c-bfbf-b20bfa255468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:27:21.522050 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:27:21.575172 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8a4f9a-1991-4a3c-bfbf-b20bfa255468 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:27:21.578866 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6adc3be-c0d5-4070-b2db-d0febf030bfc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4994b4faa4ec4aa088f3dc32c9c5614d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:27:21.579473 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6adc3be-c0d5-4070-b2db-d0febf030bfc service neutron] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:27:21.579749 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6adc3be-c0d5-4070-b2db-d0febf030bfc service neutron] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:27:21.580019 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6adc3be-c0d5-4070-b2db-d0febf030bfc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:27:21.581904 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-b6adc3be-c0d5-4070-b2db-d0febf030bfc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:27:21.598055 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6adc3be-c0d5-4070-b2db-d0febf030bfc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:27:21.599506 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6adc3be-c0d5-4070-b2db-d0febf030bfc service neutron] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:27:21.612955 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1458/2933] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:27:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:27:31.058607 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=75 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:27:31.606976 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=21 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:27:35.418184 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7078a090-7c9a-45ba-927f-afc62ce341c8 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:27:35.418785 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7078a090-7c9a-45ba-927f-afc62ce341c8 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:27:35.418785 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7078a090-7c9a-45ba-927f-afc62ce341c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:27:35.491390 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-7078a090-7c9a-45ba-927f-afc62ce341c8 None None] MFA Rules not processed for user `bacc8ece8df24bf498c1d55ca2918224`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:27:35.493037 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-7078a090-7c9a-45ba-927f-afc62ce341c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:27:35.575170 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1476/2934] 10.222.0.50 () {58 vars in 1009 bytes} [Mon Sep 5 12:27:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:27:35.623998 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6adc3be-c0d5-4070-b2db-d0febf030bfc service neutron] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:27:35.625538 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-b6adc3be-c0d5-4070-b2db-d0febf030bfc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:27:35.720845 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6adc3be-c0d5-4070-b2db-d0febf030bfc service neutron] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:27:35.725944 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbde4948-b704-4fb7-8de8-b4eb8fc00f61 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2b32d58d964585a24e7c5784a8355f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:27:35.726550 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbde4948-b704-4fb7-8de8-b4eb8fc00f61 service swift] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:27:35.726933 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbde4948-b704-4fb7-8de8-b4eb8fc00f61 service swift] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:27:35.727702 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbde4948-b704-4fb7-8de8-b4eb8fc00f61 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:27:35.736677 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbde4948-b704-4fb7-8de8-b4eb8fc00f61 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:27:35.738321 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbde4948-b704-4fb7-8de8-b4eb8fc00f61 service swift] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:27:35.747196 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1459/2935] 10.222.0.50 () {60 vars in 1384 bytes} [Mon Sep 5 12:27:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 05 12:27:36.291358 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355d8b90-db2b-450c-bcaa-b7a795bc7e0d None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:27:36.291644 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355d8b90-db2b-450c-bcaa-b7a795bc7e0d None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:27:36.291944 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355d8b90-db2b-450c-bcaa-b7a795bc7e0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:27:36.313167 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-355d8b90-db2b-450c-bcaa-b7a795bc7e0d None None] MFA Rules not processed for user `bacc8ece8df24bf498c1d55ca2918224`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:27:36.314389 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-355d8b90-db2b-450c-bcaa-b7a795bc7e0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:27:36.322191 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1477/2936] 10.222.0.50 () {58 vars in 967 bytes} [Mon Sep 5 12:27:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:27:36.335153 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbde4948-b704-4fb7-8de8-b4eb8fc00f61 service swift] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:27:36.346677 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbde4948-b704-4fb7-8de8-b4eb8fc00f61 service swift] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:27:36.352363 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623593a1-826c-407f-9b5e-5567416bf98b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2b32d58d964585a24e7c5784a8355f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:27:36.353023 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623593a1-826c-407f-9b5e-5567416bf98b service swift] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:27:36.353310 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623593a1-826c-407f-9b5e-5567416bf98b service swift] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:27:36.353615 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623593a1-826c-407f-9b5e-5567416bf98b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:27:36.363517 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623593a1-826c-407f-9b5e-5567416bf98b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:27:36.365196 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623593a1-826c-407f-9b5e-5567416bf98b service swift] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:27:36.374580 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1460/2937] 10.222.0.50 () {60 vars in 1384 bytes} [Mon Sep 5 12:27:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 05 12:27:36.611067 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2bbde1-79f8-47ee-a37a-66dfd2886fdb None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:27:36.611971 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2bbde1-79f8-47ee-a37a-66dfd2886fdb None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:27:36.611971 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2bbde1-79f8-47ee-a37a-66dfd2886fdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:27:36.634036 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-6c2bbde1-79f8-47ee-a37a-66dfd2886fdb None None] MFA Rules not processed for user `bacc8ece8df24bf498c1d55ca2918224`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:27:36.635282 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-6c2bbde1-79f8-47ee-a37a-66dfd2886fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:27:36.643157 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1478/2938] 10.222.0.50 () {58 vars in 1009 bytes} [Mon Sep 5 12:27:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:27:36.656358 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623593a1-826c-407f-9b5e-5567416bf98b service swift] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:27:36.668286 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623593a1-826c-407f-9b5e-5567416bf98b service swift] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:27:36.673440 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7d29b6-8eab-495a-b5c3-076656d01a8c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2b32d58d964585a24e7c5784a8355f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:27:36.674059 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7d29b6-8eab-495a-b5c3-076656d01a8c service swift] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:27:36.674347 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7d29b6-8eab-495a-b5c3-076656d01a8c service swift] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:27:36.674621 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7d29b6-8eab-495a-b5c3-076656d01a8c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:27:36.684798 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7d29b6-8eab-495a-b5c3-076656d01a8c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:27:36.686445 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7d29b6-8eab-495a-b5c3-076656d01a8c service swift] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:27:36.695260 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1461/2939] 10.222.0.50 () {60 vars in 1384 bytes} [Mon Sep 5 12:27:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 05 12:27:37.045867 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6484c199-92ea-430c-b40a-009d91c8e519 None None] REQUEST_METHOD: `POST` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:27:37.046125 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6484c199-92ea-430c-b40a-009d91c8e519 None None] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:27:37.046444 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6484c199-92ea-430c-b40a-009d91c8e519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:27:37.067306 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.auth.core [None req-6484c199-92ea-430c-b40a-009d91c8e519 None None] MFA Rules not processed for user `bacc8ece8df24bf498c1d55ca2918224`. Rule list: `[]` (Enabled: `True`). {{(pid=81719) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:27:37.068524 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-6484c199-92ea-430c-b40a-009d91c8e519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:27:37.075956 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1479/2940] 10.222.0.50 () {58 vars in 967 bytes} [Mon Sep 5 12:27:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:27:37.088604 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7d29b6-8eab-495a-b5c3-076656d01a8c service swift] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:27:37.099669 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7d29b6-8eab-495a-b5c3-076656d01a8c service swift] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:27:37.105797 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6645d41-e3b7-476a-8903-615ad71d3075 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2b32d58d964585a24e7c5784a8355f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:27:37.106412 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6645d41-e3b7-476a-8903-615ad71d3075 service swift] REQUEST_METHOD: `GET` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:27:37.106698 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6645d41-e3b7-476a-8903-615ad71d3075 service swift] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:27:37.106969 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6645d41-e3b7-476a-8903-615ad71d3075 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:27:37.115811 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6645d41-e3b7-476a-8903-615ad71d3075 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:27:37.117476 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6645d41-e3b7-476a-8903-615ad71d3075 service swift] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:27:37.125697 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1462/2941] 10.222.0.50 () {60 vars in 1384 bytes} [Mon Sep 5 12:27:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 05 12:27:39.457840 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6484c199-92ea-430c-b40a-009d91c8e519 None None] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:27:39.521482 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6484c199-92ea-430c-b40a-009d91c8e519 None None] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:27:39.526071 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165cf643-e85a-41ab-a505-c06ed64fd44c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:27:39.526724 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165cf643-e85a-41ab-a505-c06ed64fd44c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:27:39.527007 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165cf643-e85a-41ab-a505-c06ed64fd44c admin admin] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:27:39.527281 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165cf643-e85a-41ab-a505-c06ed64fd44c admin admin] PATH_INFO: `/v3/users/9f79a23f2aab47b1b0c7f2b98cd576e3` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:27:39.528419 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165cf643-e85a-41ab-a505-c06ed64fd44c admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f79a23f2aab47b1b0c7f2b98cd576e3)` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:27:39.530370 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165cf643-e85a-41ab-a505-c06ed64fd44c admin admin] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:27:39.579713 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:27:39.581966 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-165cf643-e85a-41ab-a505-c06ed64fd44c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f79a23f2aab47b1b0c7f2b98cd576e3'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:27:39.582914 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-165cf643-e85a-41ab-a505-c06ed64fd44c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f79a23f2aab47b1b0c7f2b98cd576e3'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:27:39.591631 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-165cf643-e85a-41ab-a505-c06ed64fd44c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f79a23f2aab47b1b0c7f2b98cd576e3'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:27:39.592276 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-165cf643-e85a-41ab-a505-c06ed64fd44c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f79a23f2aab47b1b0c7f2b98cd576e3'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:27:39.606239 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.notifications [None req-165cf643-e85a-41ab-a505-c06ed64fd44c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f79a23f2aab47b1b0c7f2b98cd576e3'} {{(pid=81719) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:27:39.620552 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1480/2942] 10.222.0.50 () {58 vars in 1224 bytes} [Mon Sep 5 12:27:39 2022] DELETE /identity/v3/users/9f79a23f2aab47b1b0c7f2b98cd576e3 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:27:39.625814 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e957c09-d517-47b3-84ef-2dd978af0408 None None] REQUEST_METHOD: `POST` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:27:39.626404 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e957c09-d517-47b3-84ef-2dd978af0408 None None] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:27:39.626536 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e957c09-d517-47b3-84ef-2dd978af0408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:27:39.651370 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.auth.core [None req-8e957c09-d517-47b3-84ef-2dd978af0408 None None] MFA Rules not processed for user `5ec42edb9cd44e278afe2e10f9b7de4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81720) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 05 12:27:39.652776 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-8e957c09-d517-47b3-84ef-2dd978af0408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:27:39.723379 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1463/2943] 10.222.0.50 () {58 vars in 958 bytes} [Mon Sep 5 12:27:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 05 12:27:39.734401 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165cf643-e85a-41ab-a505-c06ed64fd44c admin admin] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:27:39.736347 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-165cf643-e85a-41ab-a505-c06ed64fd44c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:27:39.806992 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165cf643-e85a-41ab-a505-c06ed64fd44c admin admin] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:27:39.810665 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8375ac1-a027-492c-b7b4-bedc9e87e169 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4994b4faa4ec4aa088f3dc32c9c5614d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:27:39.811274 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8375ac1-a027-492c-b7b4-bedc9e87e169 service neutron] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:27:39.811550 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8375ac1-a027-492c-b7b4-bedc9e87e169 service neutron] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:27:39.811821 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8375ac1-a027-492c-b7b4-bedc9e87e169 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:27:39.821832 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8375ac1-a027-492c-b7b4-bedc9e87e169 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:27:39.823283 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8375ac1-a027-492c-b7b4-bedc9e87e169 service neutron] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:27:39.833546 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1481/2944] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:27:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:27:40.015055 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e957c09-d517-47b3-84ef-2dd978af0408 None None] Authenticating user token {{(pid=81720) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:27:40.016529 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.fernet_utils [None req-8e957c09-d517-47b3-84ef-2dd978af0408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81720) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:27:40.029629 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e957c09-d517-47b3-84ef-2dd978af0408 None None] Validating token access rules against request {{(pid=81720) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:27:40.042778 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167d830a-2b7f-416d-9ece-40abde7aab08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec42edb9cd44e278afe2e10f9b7de4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7dbd9a59249418592cb2f883c3937fa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81720) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:27:40.043861 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167d830a-2b7f-416d-9ece-40abde7aab08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:27:40.044404 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167d830a-2b7f-416d-9ece-40abde7aab08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:27:40.044885 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167d830a-2b7f-416d-9ece-40abde7aab08 admin admin] PATH_INFO: `/v3/projects/d69c34579020469385378d4b9459e0ff` {{(pid=81720) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:27:40.047234 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167d830a-2b7f-416d-9ece-40abde7aab08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d69c34579020469385378d4b9459e0ff)` {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:27:40.050779 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167d830a-2b7f-416d-9ece-40abde7aab08 admin admin] RBAC: Authorization granted {{(pid=81720) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:27:40.083283 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:27:40.101549 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-167d830a-2b7f-416d-9ece-40abde7aab08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd69c34579020469385378d4b9459e0ff', 'request_id': 'req-167d830a-2b7f-416d-9ece-40abde7aab08'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:27:40.110162 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-167d830a-2b7f-416d-9ece-40abde7aab08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd69c34579020469385378d4b9459e0ff', 'request_id': 'req-167d830a-2b7f-416d-9ece-40abde7aab08'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:27:40.116867 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-167d830a-2b7f-416d-9ece-40abde7aab08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd69c34579020469385378d4b9459e0ff', 'request_id': 'req-167d830a-2b7f-416d-9ece-40abde7aab08'} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:27:40.127580 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-167d830a-2b7f-416d-9ece-40abde7aab08 admin admin] The token cache is being invalidate because project d69c34579020469385378d4b9459e0ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81720) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 05 12:27:40.127880 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-167d830a-2b7f-416d-9ece-40abde7aab08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:27:40.128527 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG keystone.notifications [None req-167d830a-2b7f-416d-9ece-40abde7aab08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81720) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 05 12:27:40.130036 dv-cinder-855189-1-smb devstack@keystone.service[81720]: [pid: 81720|app: 0|req: 1464/2945] 10.222.0.50 () {58 vars in 1233 bytes} [Mon Sep 5 12:27:40 2022] DELETE /identity/v3/projects/d69c34579020469385378d4b9459e0ff => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 05 12:27:49.828980 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=39,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:27:50.124475 dv-cinder-855189-1-smb devstack@keystone.service[81720]: DEBUG dbcounter [-] [81720] Writing DB stats keystone:DELETE=6,keystone:SELECT=14,keystone:INSERT=1 {{(pid=81720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 12:30:16.704613 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8375ac1-a027-492c-b7b4-bedc9e87e169 service neutron] Authenticating user token {{(pid=81719) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 05 12:30:16.706103 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-f8375ac1-a027-492c-b7b4-bedc9e87e169 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:30:16.777650 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8375ac1-a027-492c-b7b4-bedc9e87e169 service neutron] Validating token access rules against request {{(pid=81719) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 05 12:30:16.843897 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b6e7b6-d5f4-46f1-a04a-32bf34d75a3d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5427d0752de4817b6aa25e28c2d9a30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae4f8939fcc040bca99783a77e6ede4d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81719) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 05 12:30:16.844537 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b6e7b6-d5f4-46f1-a04a-32bf34d75a3d service placement] REQUEST_METHOD: `GET` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 05 12:30:16.844821 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b6e7b6-d5f4-46f1-a04a-32bf34d75a3d service placement] SCRIPT_NAME: `/identity` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 05 12:30:16.845301 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b6e7b6-d5f4-46f1-a04a-32bf34d75a3d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81719) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 05 12:30:16.847179 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.fernet_utils [None req-e0b6e7b6-d5f4-46f1-a04a-32bf34d75a3d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81719) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 05 12:30:16.859991 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b6e7b6-d5f4-46f1-a04a-32bf34d75a3d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 05 12:30:16.861671 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b6e7b6-d5f4-46f1-a04a-32bf34d75a3d service placement] RBAC: Authorization granted {{(pid=81719) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 05 12:30:16.873640 dv-cinder-855189-1-smb devstack@keystone.service[81719]: [pid: 81719|app: 0|req: 1482/2946] 10.222.0.50 () {60 vars in 1365 bytes} [Mon Sep 5 12:30:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 05 12:30:26.867915 dv-cinder-855189-1-smb devstack@keystone.service[81719]: DEBUG dbcounter [-] [81719] Writing DB stats keystone:SELECT=58 {{(pid=81719) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}